From llvm-testresults at cs.uiuc.edu Tue Apr 1 02:16:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 04:16:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401091612.7240D2A6C038@llvm.org> http://llvm.org/perf/db_default/v4/nts/24207?compare_to=24205&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24207, Order: 205281, Start Time: 2014-04-01 04:30:46, End Time: 2014-04-01 09:22:00 To: 24205, Order: 205254, Start Time: 2014-03-31 22:59:02, End Time: 2014-04-01 03:47:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 66 (105 on baseline) Performance Improvements: 3 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1043 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 400.18% (2.2721 => 11.3647, std.dev.: 0.1322) MultiSource/Benchmarks/Prolangs-C++/NP/np: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2002-12-13-MishaTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 8.97% (0.3120 => 0.3400, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2240 => 0.2440, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2440 => 0.2560, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.76% (0.2520 => 0.2640, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.9280 => 0.9720, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.95% (1.2161 => 1.2641, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.5120 => 0.5320, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.66% (1.3121 => 1.3601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.61% (1.2201 => 1.2641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.58% (1.3401 => 1.3881, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: 3.57% (0.3360 => 0.3480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.51% (1.2521 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.49% (1.2601 => 1.3041, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.49% (1.2601 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.48% (1.2641 => 1.3081, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.39% (1.2961 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.34% (1.3161 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.33% (1.2001 => 1.2401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.26% (1.2281 => 1.2681, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.8761 => 0.9041, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.18% (1.2561 => 1.2961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.18% (1.2561 => 1.2961, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.02% (1.3241 => 1.3641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.95% (1.2201 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.79% (1.2881 => 1.3241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.79% (1.2921 => 1.3281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (1.3081 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.74% (1.3161 => 1.3521, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.61% (1.2281 => 1.2601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.57% (1.2441 => 1.2761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.42% (1.3201 => 1.3521, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (4.0203 => 4.1163, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.39% (1.3401 => 1.3721, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.29% (5.9320 => 6.0680, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.19% (1.2801 => 1.3081, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (1.3081 => 1.3361, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (2.1481 => 2.1921, std.dev.: 0.0123) MultiSource/Applications/JM/ldecod/ldecod: 1.97% (7.9202 => 8.0762, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (2.8522 => 2.9082, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (1.4361 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (10.6522 => 10.8322, std.dev.: 0.0451) MultiSource/Applications/JM/lencod/lencod: 1.66% (17.8805 => 18.1765, std.dev.: 0.0581) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (5.0200 => 5.1000, std.dev.: 0.0257) MultiSource/Applications/ClamAV/clamscan: 1.45% (17.3522 => 17.6042, std.dev.: 0.0292) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (28.1578 => 28.5018, std.dev.: 0.0371) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5284 => 17.7404, std.dev.: 0.0539) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (15.1522 => 15.3282, std.dev.: 0.0242) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.01% (48.7169 => 49.2089, std.dev.: 0.0474) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.99% (1.1121 => 1.2121, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/hash: 7.26% (0.4960 => 0.5320, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.2680 => 0.2840, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 4.13% (6.6884 => 6.9644, std.dev.: 0.0571) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.11% (3.4082 => 3.5482, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.48% (3.7962 => 3.9282, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.06% (2.9122 => 2.9722, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.74% (4.1363 => 4.2083, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 1.38% (3.1922 => 3.2362, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -16.67% (0.0960 => 0.0800, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -2.57% (7.6365 => 7.4405, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -1.58% (11.9247 => 11.7367, std.dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0016) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0024) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0168) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.30% (1.2601 => 1.3521, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0362) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (10.6960 => 11.3440, std.dev.: 0.0732) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0364) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0248) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: 4.29% (10.8967 => 11.3647, std.dev.: 0.1322) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0451) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (5.8400 => 6.0680, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0123) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0365) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0581) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.59% (4.0122 => 4.1163, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 2.42% (23.7574 => 24.3335, std.dev.: 0.0374) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.29% (48.1088 => 49.2089, std.dev.: 0.0474) MultiSource/Benchmarks/Bullet/bullet: 2.08% (37.0925 => 37.8645, std.dev.: 0.0700) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1490, std.dev.: 0.0593) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0134) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0204) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.24% (28.1538 => 28.5018, std.dev.: 0.0371) MultiSource/Applications/ClamAV/clamscan: 1.13% (17.4082 => 17.6042, std.dev.: 0.0292) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0539) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 6.69% (1.1361 => 1.2121, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 4.63% (6.6564 => 6.9644, std.dev.: 0.0571) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0116) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0128) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.49% (3.2242 => 3.2722, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 02:17:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 04:17:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140401091704.A47652A6C038@llvm.org> http://llvm.org/perf/db_default/v4/nts/24208?compare_to=24198&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24208, Order: 205281, Start Time: 2014-04-01 04:32:30, End Time: 2014-04-01 09:23:13 To: 24198, Order: 205240, Start Time: 2014-03-31 19:36:53, End Time: 2014-04-01 00:24:58 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 89 (153 on baseline) Performance Improvements: 3 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1020 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 407.13% (2.2481 => 11.4007, std.dev.: 0.0773) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/stmtexpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.78% (0.0720 => 0.0920, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 17.95% (0.1560 => 0.1840, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0035) MultiSource/Applications/aha/aha: 13.33% (0.1200 => 0.1360, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.20% (0.1640 => 0.1840, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 9.68% (0.1240 => 0.1360, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.06% (0.3400 => 0.3640, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.35% (0.7560 => 0.8040, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/sieve: 6.10% (0.3280 => 0.3480, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (0.3680 => 0.3880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.26% (1.4441 => 1.5201, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.24% (1.5281 => 1.6081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.11% (1.4881 => 1.5641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.10% (1.5681 => 1.6481, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.03% (1.5121 => 1.5881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.89% (1.4721 => 1.5441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.56% (1.4921 => 1.5601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.52% (1.5921 => 1.6641, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.45% (1.5281 => 1.5961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.40% (1.5441 => 1.6121, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.38% (0.6400 => 0.6680, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.36% (1.4681 => 1.5321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.36% (1.5601 => 1.6281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.31% (1.4841 => 1.5481, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.31% (1.6721 => 1.7441, std.dev.: 0.0114) MultiSource/Benchmarks/sim/sim: 4.30% (0.3720 => 0.3880, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.20% (1.8081 => 1.8841, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.18% (1.9121 => 1.9921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.14% (1.8361 => 1.9121, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.13% (1.7441 => 1.8161, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.94% (1.5241 => 1.5841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.93% (1.6281 => 1.6921, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.88% (1.8561 => 1.9281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.83% (1.7761 => 1.8441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.83% (1.5681 => 1.6281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.83% (1.5681 => 1.6281, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.69% (1.6241 => 1.6841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.65% (1.5361 => 1.5921, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.49% (0.9161 => 0.9481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.41% (1.7601 => 1.8201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.41% (1.6441 => 1.7001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.35% (1.6721 => 1.7281, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.29% (1.7041 => 1.7601, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.28% (1.5840 => 1.6360, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.07% (1.5641 => 1.6121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.02% (1.4561 => 1.5001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.99% (1.6041 => 1.6521, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.92% (1.5080 => 1.5520, std.dev.: 0.0133) MultiSource/Applications/Burg/burg: 2.84% (1.5520 => 1.5960, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.82% (1.7041 => 1.7521, std.dev.: 0.0118) MultiSource/Applications/minisat/minisat: 2.78% (0.8640 => 0.8880, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.72% (1.6201 => 1.6641, std.dev.: 0.0131) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4560 => 0.4680, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (2.1400 => 2.1960, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.55% (4.2323 => 4.3403, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (3.0722 => 3.1482, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.46% (0.4880 => 0.5000, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 2.43% (1.4801 => 1.5161, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 2.40% (1.8361 => 1.8801, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (1.0041 => 1.0281, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (2.3721 => 2.4282, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5480 => 0.5600, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.95% (6.7560 => 6.8880, std.dev.: 0.0360) MultiSource/Applications/JM/lencod/lencod: 1.66% (22.6167 => 22.9928, std.dev.: 0.0489) MultiSource/Applications/SPASS/SPASS: 1.54% (18.7404 => 19.0286, std.dev.: 0.0408) MultiSource/Applications/oggenc/oggenc: 1.52% (7.1324 => 7.2405, std.dev.: 0.0201) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (13.0203 => 13.2083, std.dev.: 0.0432) MultiSource/Benchmarks/Bullet/bullet: 1.35% (39.1446 => 39.6726, std.dev.: 0.0619) MultiSource/Applications/ClamAV/clamscan: 1.22% (19.3484 => 19.5844, std.dev.: 0.0661) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (6.1204 => 6.1924, std.dev.: 0.0190) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.16% (29.3498 => 29.6899, std.dev.: 0.0421) MultiSource/Benchmarks/PAQ8p/paq8p: 1.14% (2.8042 => 2.8362, std.dev.: 0.0101) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.13% (51.4730 => 52.0570, std.dev.: 0.0814) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 27.58% (0.9281 => 1.1841, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.90% (4.5523 => 4.6843, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.78% (3.4482 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.4605 => 7.6565, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5402 => 2.5682, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.02% (1.3841 => 1.3561, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.19% (4.7003 => 4.6443, std.dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.07% (11.3687 => 31.1579, std.dev.: 0.0569) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0112) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0112) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0032) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 25.81% (0.1240 => 0.1560, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.24% (0.1160 => 0.1360, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.55% (0.6200 => 0.7040, std.dev.: 0.0176) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.20% (0.1640 => 0.1840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0195) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.49% (0.7480 => 0.8040, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.35% (1.5241 => 1.6361, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0104) SingleSource/UnitTests/Vector/constpool: 7.30% (10.6247 => 11.4007, std.dev.: 0.0773) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (6.4680 => 6.8880, std.dev.: 0.0360) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.20% (0.9681 => 1.0281, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.4640 => 1.5520, std.dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.99% (9.4842 => 10.0522, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.93% (0.4720 => 0.5000, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.93% (1.4161 => 1.5001, std.dev.: 0.0117) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (1.5480 => 1.6360, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.26% (11.6440 => 12.2560, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.05% (1.5841 => 1.6641, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (1.7921 => 1.8801, std.dev.: 0.0147) MultiSource/Applications/JM/ldecod/ldecod: 4.90% (10.0443 => 10.5363, std.dev.: 0.0366) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.5600 => 1.6360, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0249) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.82% (5.8121 => 6.0921, std.dev.: 0.0562) MultiSource/Applications/JM/lencod/lencod: 4.70% (21.9606 => 22.9928, std.dev.: 0.0489) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.58% (6.5440 => 6.8440, std.dev.: 0.0467) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (6.5080 => 6.7760, std.dev.: 0.0462) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0196) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0112) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.05% (50.0290 => 52.0570, std.dev.: 0.0814) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (3.0282 => 3.1482, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.73% (4.1843 => 4.3403, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 3.68% (4.7880 => 4.9640, std.dev.: 0.0286) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0201) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0163) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0182) MultiSource/Benchmarks/Bullet/bullet: 3.30% (38.4046 => 39.6726, std.dev.: 0.0619) MultiSource/Applications/minisat/minisat: 3.26% (0.8600 => 0.8880, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 3.19% (0.3760 => 0.3880, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 3.19% (18.4404 => 19.0286, std.dev.: 0.0408) MultiSource/Applications/ClamAV/clamscan: 2.84% (19.0444 => 19.5844, std.dev.: 0.0661) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0179) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4560 => 0.4680, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (16.3483 => 16.7683, std.dev.: 0.0577) MultiSource/Applications/kimwitu++/kc: 2.40% (19.6891 => 20.1611, std.dev.: 0.0475) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 2.12% (3.9681 => 4.0521, std.dev.: 0.0317) MultiSource/Applications/lemon/lemon: 1.88% (1.4881 => 1.5161, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 1.58% (2.7922 => 2.8362, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.44% (6.1044 => 6.1924, std.dev.: 0.0190) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.21% (29.3338 => 29.6899, std.dev.: 0.0421) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (13.0563 => 13.2083, std.dev.: 0.0432) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.77% (2.1401 => 2.4562, std.dev.: 0.0428) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 2.21% (3.9842 => 4.0723, std.dev.: 0.0156) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.3161 => 1.3361, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9562 => 3.9962, std.dev.: 0.0152) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.36% (2.9442 => 0.6960, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.34% (1.5641 => 0.6360, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: -7.49% (1.8680 => 1.7280, std.dev.: 0.0261) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -45.90% (91.8497 => 49.6911, std.dev.: 7.1028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.78% (26.0616 => 16.9971, std.dev.: 0.2066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.19% (50.3031 => 33.1061, std.dev.: 0.1548) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.78% (42.1466 => 28.7538, std.dev.: 3.9445) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.1144) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -1.72% (0.6960 => 0.6840, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.14% (1.4041 => 1.3881, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 02:19:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 04:19:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140401091943.345852A6C038@llvm.org> http://llvm.org/perf/db_default/v4/nts/24209?compare_to=24200&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24209, Order: 205281, Start Time: 2014-04-01 04:32:29, End Time: 2014-04-01 09:25:58 To: 24200, Order: 205240, Start Time: 2014-03-31 19:38:14, End Time: 2014-04-01 00:28:57 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 80 (142 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1031 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 405.57% (2.2281 => 11.2647, std.dev.: 0.1272) SingleSource/UnitTests/2003-05-31-CastToBool: 200.00% (0.0080 => 0.0240, std.dev.: 0.0039) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.00% (0.2000 => 0.2280, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.54% (0.1040 => 0.1160, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.76% (2.0721 => 2.2121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.13% (2.0241 => 2.1481, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.84% (2.1241 => 2.2481, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.72% (2.0281 => 2.1441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.67% (1.9041 => 2.0121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.67% (1.9761 => 2.0881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.66% (2.0481 => 2.1641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.60% (1.9281 => 2.0361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.59% (1.9321 => 2.0401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.56% (1.8721 => 1.9761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.53% (1.9521 => 2.0601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.45% (1.9081 => 2.0121, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.41% (0.7400 => 0.7800, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.41% (1.9241 => 2.0281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.40% (2.2241 => 2.3441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.39% (2.0041 => 2.1121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.28% (2.1201 => 2.2321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.27% (1.9721 => 2.0761, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.23% (2.0641 => 2.1721, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.05% (0.7920 => 0.8320, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.02% (1.9921 => 2.0921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.02% (1.9921 => 2.0921, std.dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.96% (2.0161 => 2.1161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.93% (2.1921 => 2.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.84% (2.0641 => 2.1641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.79% (2.3401 => 2.4522, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.73% (2.1121 => 2.2121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.71% (2.0361 => 2.1321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.71% (1.9521 => 2.0441, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.71% (2.0401 => 2.1361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (2.2961 => 2.4041, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.68% (2.2241 => 2.3281, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.66% (2.1441 => 2.2441, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.55% (2.1081 => 2.2041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.41% (2.1761 => 2.2721, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.37% (2.0121 => 2.1001, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.86% (2.2801 => 2.3681, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.80% (1.8961 => 1.9681, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.75% (0.6400 => 0.6640, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.48% (0.9201 => 0.9521, std.dev.: 0.0055) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.09% (1.2960 => 1.3360, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.8401 => 1.8921, std.dev.: 0.0110) MultiSource/Applications/treecc/treecc: 2.61% (2.6080 => 2.6760, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.07% (4.2443 => 4.3323, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.97% (1.0161 => 1.0361, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 1.84% (19.3403 => 19.6964, std.dev.: 0.0457) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (12.9603 => 13.1923, std.dev.: 0.0213) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.65% (6.8000 => 6.9120, std.dev.: 0.0300) MultiSource/Applications/lua/lua: 1.64% (4.8920 => 4.9720, std.dev.: 0.0213) MultiSource/Applications/SPASS/SPASS: 1.63% (18.7125 => 19.0166, std.dev.: 0.0612) MultiSource/Applications/lemon/lemon: 1.62% (1.4841 => 1.5081, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.60% (6.0001 => 6.0961, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.52% (2.3801 => 2.4162, std.dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 1.40% (7.1684 => 7.2685, std.dev.: 0.0231) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.40% (51.3250 => 52.0410, std.dev.: 0.0682) MultiSource/Applications/JM/lencod/lencod: 1.36% (22.6007 => 22.9088, std.dev.: 0.0442) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (16.5843 => 16.7883, std.dev.: 0.0423) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (29.3218 => 29.6659, std.dev.: 0.0380) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 17.52% (0.9361 => 1.1001, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.38% (2.7202 => 2.8122, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.01% (4.1203 => 4.2443, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.78% (3.4482 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.68% (7.4725 => 7.6725, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5402 => 2.5682, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.02% (1.9521 => 1.9721, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (1.3801 => 1.3561, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.45% (17.6723 => 19.6964, std.dev.: 0.0457) MultiSource/Applications/sqlite3/sqlite3: 1420.24% (1.7001 => 25.8456, std.dev.: 0.0558) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.87% (50.1010 => 52.0410, std.dev.: 0.0682) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.80% (1.0520 => 1.0920, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (11.3920 => 12.3240, std.dev.: 0.0628) SingleSource/Benchmarks/Misc/oourafft: 175.17% (11.3407 => 31.2060, std.dev.: 0.0638) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0083, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0099) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0108) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0055) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.45% (1.9161 => 2.2121, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.88% (1.8281 => 2.1001, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.83% (1.8081 => 2.0401, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 11.11% (0.1440 => 0.1600, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.09% (1.9481 => 2.1641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.89% (1.8601 => 2.0441, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0045) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: 8.31% (10.4007 => 11.2647, std.dev.: 0.1272) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.24% (0.3400 => 0.3680, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.11% (0.7400 => 0.8000, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.14% (0.7280 => 0.7800, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.99% (1.0880 => 1.1640, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.78% (0.2360 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (6.4800 => 6.9120, std.dev.: 0.0300) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 6.05% (1.7841 => 1.8921, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/fibo: 5.66% (0.2120 => 0.2240, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.65% (0.7080 => 0.7480, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.58% (0.7880 => 0.8320, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0101) MultiSource/Applications/Burg/burg: 4.97% (1.5280 => 1.6040, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (1.6960 => 1.7800, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (5.8281 => 6.0961, std.dev.: 0.0296) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0179) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.47% (6.5320 => 6.8240, std.dev.: 0.0380) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (9.6042 => 10.0002, std.dev.: 0.0600) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3360 => 0.3480, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.4680 => 0.4840, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops: 3.39% (0.4720 => 0.4880, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0122) MultiSource/Applications/JM/lencod/lencod: 3.10% (22.2206 => 22.9088, std.dev.: 0.0442) MultiSource/Applications/oggenc/oggenc: 3.06% (7.0524 => 7.2685, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (16.3003 => 16.7883, std.dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (5.3960 => 5.5480, std.dev.: 0.0519) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.77% (1.3000 => 1.3360, std.dev.: 0.0131) MultiSource/Applications/SPASS/SPASS: 2.63% (18.5284 => 19.0166, std.dev.: 0.0612) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (4.2243 => 4.3323, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 2.51% (38.6366 => 39.6046, std.dev.: 0.0474) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0158) MultiSource/Applications/JM/ldecod/ldecod: 1.96% (10.2283 => 10.4283, std.dev.: 0.0316) MultiSource/Applications/kimwitu++/kc: 1.61% (19.8291 => 20.1491, std.dev.: 0.0513) MultiSource/Benchmarks/PAQ8p/paq8p: 1.58% (2.7842 => 2.8282, std.dev.: 0.0102) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (13.0363 => 13.1923, std.dev.: 0.0213) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.66% (2.1201 => 2.4522, std.dev.: 0.0497) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.12% (6.5964 => 6.7364, std.dev.: 0.0285) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.63% (3.9442 => 4.0083, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (26.3056 => 26.6697, std.dev.: 0.0450) SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.46% (2.9562 => 0.6960, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: -5.33% (1.8760 => 1.7760, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.90% (94.8339 => 49.4111, std.dev.: 8.8771) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.95% (25.7136 => 16.9851, std.dev.: 0.2229) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.79% (49.9431 => 33.0661, std.dev.: 0.1988) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1066) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0053) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0122) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 02:22:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 04:22:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140401092232.EE8742A6C038@llvm.org> http://llvm.org/perf/db_default/v4/nts/24210?compare_to=24206&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24210, Order: 205281, Start Time: 2014-04-01 04:38:27, End Time: 2014-04-01 09:28:44 To: 24206, Order: 205257, Start Time: 2014-03-31 23:33:33, End Time: 2014-04-01 04:20:19 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 66 (0 on baseline) Performance Improvements: 4 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1042 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 401.77% (2.2721 => 11.4007, std.dev.: 0.1245) SingleSource/Regression/C/2003-05-21-BitfieldHandling: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.83% (0.0960 => 0.1160, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.02% (1.5961 => 1.7561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.97% (1.6041 => 1.7641, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.59% (1.7521 => 1.9201, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.6721 => 1.8241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.07% (1.6321 => 1.7801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.07% (1.5881 => 1.7321, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.04% (1.5921 => 1.7361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.96% (1.6961 => 1.8481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.82% (1.7681 => 1.9241, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.80% (1.7281 => 1.8801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.78% (1.7321 => 1.8841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.75% (1.6921 => 1.8401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.72% (1.7441 => 1.8961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.70% (1.6561 => 1.8001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.61% (1.6721 => 1.8161, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.54% (1.6401 => 1.7801, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.54% (1.6401 => 1.7801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.53% (1.8281 => 1.9841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.49% (1.6481 => 1.7881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.48% (1.6041 => 1.7401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.24% (1.7481 => 1.8921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.19% (1.6601 => 1.7961, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.15% (1.6201 => 1.7521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.14% (1.9161 => 2.0721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.13% (1.6241 => 1.7561, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.6761 => 1.8121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.08% (1.8321 => 1.9801, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.97% (1.6561 => 1.7881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.92% (1.7681 => 1.9081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.63% (1.9921 => 2.1441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.52% (1.5961 => 1.7161, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.50% (1.7601 => 1.8921, std.dev.: 0.0168) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.34% (0.4360 => 0.4680, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.16% (1.9001 => 2.0361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.14% (1.9041 => 2.0401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.02% (1.9361 => 2.0721, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.97% (2.0081 => 2.1481, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (1.0080 => 1.0680, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (4.2243 => 4.3323, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (1.1240 => 1.1520, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (12.9363 => 13.2043, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (3.0402 => 3.0962, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.65% (7.0320 => 7.1480, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.55% (6.2000 => 6.2960, std.dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.29% (12.3920 => 12.5520, std.dev.: 0.0353) MultiSource/Applications/JM/ldecod/ldecod: 1.17% (10.6123 => 10.7363, std.dev.: 0.0443) MultiSource/Applications/oggenc/oggenc: 1.13% (7.1004 => 7.1804, std.dev.: 0.0214) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.89% (1.2681 => 1.3681, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.05% (4.6363 => 4.8243, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.64% (0.9881 => 1.0241, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 2.30% (6.9644 => 7.1244, std.dev.: 0.0547) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.24% (4.1123 => 4.2043, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.96% (3.4642 => 3.5322, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.58% (2.5322 => 2.5722, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (1.3641 => 1.3841, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.22% (4.2523 => 4.3043, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5362 => 2.5642, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/office/office: -13.85% (0.2600 => 0.2240, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.86% (0.2360 => 0.2080, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -8.31% (3.4642 => 3.1762, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.64% (1.7041 => 1.6761, std.dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0100) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 02:23:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 04:23:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140401092332.5F9B62A6C038@llvm.org> http://llvm.org/perf/db_default/v4/nts/24211?compare_to=24201&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24211, Order: 205281, Start Time: 2014-04-01 04:32:28, End Time: 2014-04-01 09:29:46 To: 24201, Order: 205240, Start Time: 2014-03-31 19:45:54, End Time: 2014-04-01 00:40:43 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 73 (153 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1038 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 416.08% (2.2401 => 11.5607, std.dev.: 0.0645) SingleSource/Regression/C/2004-03-15-IndirectGoto: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.23% (0.1040 => 0.1240, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0041) SingleSource/Regression/C/sumarraymalloc: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/rem: 16.67% (0.1200 => 0.1400, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.29% (0.1120 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 11.36% (0.1760 => 0.1960, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 6.76% (0.2960 => 0.3160, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.86% (1.3161 => 1.3801, std.dev.: 0.0093) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.18% (1.3400 => 1.3960, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.89% (1.0280 => 1.0680, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.4160 => 0.4320, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.76% (1.3841 => 1.4361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.54% (1.3561 => 1.4041, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.50% (1.6001 => 1.6561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.47% (1.5001 => 1.5521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.24% (1.6041 => 1.6561, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.21% (1.3721 => 1.4161, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.15% (1.3961 => 1.4401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.15% (1.3961 => 1.4401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.15% (1.5241 => 1.5721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.13% (1.5321 => 1.5801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.06% (1.4361 => 1.4801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.03% (1.4521 => 1.4961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.94% (1.3601 => 1.4001, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.89% (1.5200 => 1.5640, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.82% (1.4201 => 1.4601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.77% (1.4441 => 1.4841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.73% (1.4641 => 1.5041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.68% (1.3441 => 1.3801, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.59% (1.3921 => 1.4281, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (2.1240 => 2.1760, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.44% (1.4761 => 1.5121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.37% (1.3481 => 1.3801, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (2.2321 => 2.2841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.32% (1.5521 => 1.5881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.31% (1.5601 => 1.5961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.29% (1.4001 => 1.4321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.26% (1.4161 => 1.4481, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 2.11% (5.5000 => 5.6160, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.03% (1.3761 => 1.4041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.98% (1.4121 => 1.4401, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.98% (1.0121 => 1.0321, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (12.2843 => 12.5083, std.dev.: 0.0276) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (1.5481 => 1.5761, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2323 => 4.3043, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.65% (1.4561 => 1.4801, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 1.63% (4.9120 => 4.9920, std.dev.: 0.0179) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (3.0162 => 3.0642, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.52% (6.0441 => 6.1361, std.dev.: 0.0333) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.35% (12.1840 => 12.3480, std.dev.: 0.0619) MultiSource/Applications/JM/ldecod/ldecod: 1.31% (10.0803 => 10.2123, std.dev.: 0.0364) MultiSource/Applications/sqlite3/sqlite3: 1.14% (25.1935 => 25.4815, std.dev.: 0.0246) MultiSource/Applications/oggenc/oggenc: 1.11% (6.8244 => 6.9004, std.dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: 1.11% (22.3567 => 22.6047, std.dev.: 0.0528) MultiSource/Applications/SPASS/SPASS: 1.09% (18.7885 => 18.9925, std.dev.: 0.0535) MultiSource/Applications/ClamAV/clamscan: 1.08% (19.5924 => 19.8044, std.dev.: 0.0469) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 18.80% (0.9361 => 1.1121, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/treeadd/treeadd: 11.86% (0.2360 => 0.2640, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.61% (1.2481 => 1.3681, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.40% (0.9401 => 0.9721, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.73% (3.4682 => 3.5282, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1363 => 4.1963, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.08% (11.4287 => 11.5527, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -5.95% (3.3602 => 3.1602, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1925.00% (0.0320 => 0.6480, std.dev.: 0.0088) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0091) SingleSource/Regression/C/sumarray2d: 1100.00% (0.0360 => 0.4320, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0089) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 390.52% (0.2520 => 1.2361, std.dev.: 0.0160) SingleSource/UnitTests/Vector/multiplies: 342.86% (0.0280 => 0.1240, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 263.84% (0.2320 => 0.8441, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 133.33% (0.0360 => 0.0840, std.dev.: 0.0035) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 119.23% (0.1040 => 0.2280, std.dev.: 0.0054) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 80.00% (0.1400 => 0.2520, std.dev.: 0.0092) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0060) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 37.50% (0.1600 => 0.2200, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/ary3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 35.29% (0.0680 => 0.0920, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 34.62% (0.1040 => 0.1400, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.60% (1.2321 => 1.5721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.42% (1.2401 => 1.5801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.64% (1.2481 => 1.5681, std.dev.: 0.0132) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.33% (1.2001 => 1.4801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 23.31% (1.1841 => 1.4601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.13% (1.1761 => 1.4481, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.91% (1.2921 => 1.5881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.81% (1.1401 => 1.4001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 22.77% (1.3001 => 1.5961, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 22.73% (1.1441 => 1.4041, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: 22.70% (1.3920 => 1.7080, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.45% (1.1761 => 1.4401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 22.18% (1.1721 => 1.4321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 22.07% (1.1601 => 1.4161, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.91% (1.1321 => 1.3801, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.87% (1.1521 => 1.4041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.84% (1.1721 => 1.4281, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.48% (1.1361 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.48% (1.1361 => 1.3801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.43% (1.2321 => 1.4961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.21% (1.1881 => 1.4401, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.05% (1.3681 => 1.6561, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.85% (1.2281 => 1.4841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.77% (1.2521 => 1.5121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.50% (1.2881 => 1.5521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.13% (1.2321 => 1.4801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.13% (1.2521 => 1.5041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 19.65% (1.3841 => 1.6561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.31% (1.2841 => 1.5321, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 19.02% (8.5802 => 10.2123, std.dev.: 0.0364) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 15.68% (19.5406 => 22.6047, std.dev.: 0.0528) MultiSource/Benchmarks/nbench/nbench: 15.38% (1.3521 => 1.5601, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.99% (5.3360 => 6.1361, std.dev.: 0.0333) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0252) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 9.87% (11.3843 => 12.5083, std.dev.: 0.0276) MultiSource/Applications/oggenc/oggenc: 9.80% (6.2844 => 6.9004, std.dev.: 0.0189) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.01% (0.4440 => 0.4840, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.59% (5.7280 => 6.2200, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.33% (5.6680 => 6.1400, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2440 => 0.2640, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (11.4440 => 12.3480, std.dev.: 0.0619) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.85% (9.5802 => 10.2362, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (1.4760 => 1.5640, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0172) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.44% (1.3240 => 1.3960, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0150) SingleSource/UnitTests/Vector/constpool: 4.90% (11.0207 => 11.5607, std.dev.: 0.0645) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 4.61% (4.7720 => 4.9920, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (5.3840 => 5.6160, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.13% (0.8721 => 0.9081, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.02% (2.0920 => 2.1760, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (6.8280 => 7.0840, std.dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (2.2081 => 2.2841, std.dev.: 0.0067) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.31% (49.1529 => 50.7809, std.dev.: 0.0860) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 3.02% (19.2243 => 19.8044, std.dev.: 0.0469) MultiSource/Applications/sqlite3/sqlite3: 2.92% (24.7575 => 25.4815, std.dev.: 0.0246) MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (2.7282 => 2.8002, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.90% (1.0521 => 1.0721, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 1.68% (19.7491 => 20.0811, std.dev.: 0.0551) MultiSource/Benchmarks/Bullet/bullet: 1.47% (39.0726 => 39.6486, std.dev.: 0.0523) MultiSource/Applications/siod/siod: 1.45% (2.7562 => 2.7962, std.dev.: 0.0142) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.45% (29.3298 => 29.7539, std.dev.: 0.0575) MultiSource/Applications/SPASS/SPASS: 1.04% (18.7966 => 18.9925, std.dev.: 0.0535) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.74% (6.6644 => 17.1771, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.32% (1.2401 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.54% (3.9842 => 4.3243, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.25% (1.3521 => 1.3961, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.87% (6.8204 => 7.0164, std.dev.: 0.0384) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.60% (3.2362 => 3.3202, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 2.56% (4.0563 => 4.1603, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.55% (1.1001 => 1.1281, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.3085 => 7.4845, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0152) MultiSource/Applications/aha/aha: 1.25% (2.8802 => 2.9162, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -14.96% (7.8605 => 6.6844, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: -8.99% (3.4722 => 3.1602, std.dev.: 0.0085) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0813) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.37% (1.7121 => 1.6201, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.13% (4.5123 => 4.4163, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.00% (0.6000 => 0.5880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0297) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.86% (3.4442 => 3.3802, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -1.41% (5.0963 => 5.0243, std.dev.: 0.0232) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 02:30:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 04:30:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140401093023.7D4742A6C038@llvm.org> http://llvm.org/perf/db_default/v4/nts/24212?compare_to=24197&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24212, Order: 205281, Start Time: 2014-04-01 04:44:09, End Time: 2014-04-01 09:36:37 To: 24197, Order: 205232, Start Time: 2014-03-31 18:42:37, End Time: 2014-03-31 23:32:34 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 68 (138 on baseline) Performance Improvements: 3 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1041 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 411.28% (2.2361 => 11.4327, std.dev.: 0.1325) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.65% (0.1360 => 0.1600, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.29% (0.0840 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.89% (0.1520 => 0.1640, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.9681 => 2.1041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.82% (1.9361 => 2.0681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.71% (1.9681 => 2.1001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.42% (1.9321 => 2.0561, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.25% (0.1920 => 0.2040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.24% (1.9241 => 2.0441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.22% (1.9281 => 2.0481, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.98% (1.9401 => 2.0561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.95% (2.0841 => 2.2081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.76% (2.0841 => 2.2041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.66% (1.9801 => 2.0921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.57% (2.0121 => 2.1241, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.3600 => 0.3800, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.54% (2.0921 => 2.2081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.53% (1.9521 => 2.0601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.51% (2.1761 => 2.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.38% (2.0081 => 2.1161, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.38% (2.2321 => 2.3521, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/lists: 5.33% (0.3000 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.28% (1.9681 => 2.0721, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.24% (1.9841 => 2.0881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.22% (1.9921 => 2.0961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.21% (2.0721 => 2.1801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.16% (2.2481 => 2.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.15% (2.0201 => 2.1241, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.15% (2.0201 => 2.1241, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.14% (2.1801 => 2.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.13% (2.2601 => 2.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.09% (2.0441 => 2.1481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.99% (2.0841 => 2.1881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.97% (2.0921 => 2.1961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.91% (2.2801 => 2.3921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.91% (2.1201 => 2.2241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.70% (2.0441 => 2.1401, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.68% (1.9641 => 2.0561, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.63% (2.2441 => 2.3481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.61% (1.9961 => 2.0881, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.49% (0.3560 => 0.3720, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.03% (2.0841 => 2.1681, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.03% (2.2841 => 2.3761, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/bigfib: 3.72% (0.7520 => 0.7800, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.54% (2.0360 => 2.1080, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/football/football: 3.19% (1.1280 => 1.1640, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.19% (0.3760 => 0.3880, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 2.87% (0.6960 => 0.7160, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (2.2841 => 2.3361, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.93% (6.2240 => 6.3440, std.dev.: 0.0379) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.65% (7.0120 => 7.1280, std.dev.: 0.0392) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (12.9963 => 13.1723, std.dev.: 0.0400) MultiSource/Applications/oggenc/oggenc: 1.34% (7.1484 => 7.2445, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (4.2643 => 4.3163, std.dev.: 0.0176) MultiSource/Applications/JM/lencod/lencod: 1.19% (23.1567 => 23.4328, std.dev.: 0.0302) MultiSource/Applications/ClamAV/clamscan: 1.11% (20.5325 => 20.7605, std.dev.: 0.0394) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 25.95% (0.9401 => 1.1841, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: 10.02% (3.1522 => 3.4682, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.00% (1.2441 => 1.3561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.03% (4.1283 => 4.2123, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.85% (3.4642 => 3.5282, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.1323 => 4.2043, std.dev.: 0.0219) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0761 => 1.0921, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5362 => 2.5682, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.09% (11.4247 => 11.5487, std.dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -37.50% (0.0640 => 0.0400, std.dev.: 0.0082) SingleSource/Regression/C++/EH/ctor_dtor_count: -25.00% (0.0480 => 0.0360, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0095) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/dt: 35.71% (0.0560 => 0.0760, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 23.26% (1.6681 => 2.0561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 23.18% (1.7081 => 2.1041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.11% (1.6961 => 2.0881, std.dev.: 0.0119) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 22.67% (1.6761 => 2.0561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 22.67% (1.8001 => 2.2081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.63% (1.7321 => 2.1241, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.49% (1.6721 => 2.0481, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 22.22% (1.6921 => 2.0681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 22.17% (1.6961 => 2.0721, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.86% (1.7201 => 2.0961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.81% (1.7241 => 2.1001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.80% (1.6881 => 2.0561, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.79% (1.7441 => 2.1241, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.77% (1.7641 => 2.1481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.75% (1.6921 => 2.0601, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.67% (1.6801 => 2.0441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.65% (1.7921 => 2.1801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.61% (1.7401 => 2.1161, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.51% (1.7481 => 2.1241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.46% (1.8081 => 2.1961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.40% (1.8881 => 2.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.39% (1.7201 => 2.0881, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.34% (1.7241 => 2.0921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.28% (1.8041 => 2.1881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.13% (1.8361 => 2.2241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.10% (1.8201 => 2.2041, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.04% (1.7681 => 2.1401, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.81% (1.9801 => 2.3921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.79% (1.8281 => 2.2081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 20.33% (1.9081 => 2.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.24% (1.9761 => 2.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.79% (1.9601 => 2.3481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 19.75% (1.9641 => 2.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 17.24% (0.1160 => 0.1360, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0074) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.81% (0.1480 => 0.1640, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.16% (0.7840 => 0.8480, std.dev.: 0.0179) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.02% (0.2280 => 0.2440, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (0.8601 => 0.9161, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (11.7880 => 12.5240, std.dev.: 0.0620) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.07% (6.7200 => 7.1280, std.dev.: 0.0392) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0206) MultiSource/Benchmarks/nbench/nbench: 5.93% (1.8201 => 1.9281, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: 5.82% (1.1000 => 1.1640, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.5000 => 0.5280, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (1.7280 => 1.8240, std.dev.: 0.0232) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.3600 => 0.3800, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.42% (2.0680 => 2.1800, std.dev.: 0.0285) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0211) MultiSource/Applications/oggenc/oggenc: 4.80% (6.9124 => 7.2445, std.dev.: 0.0107) SingleSource/UnitTests/Vector/constpool: 4.80% (10.9087 => 11.4327, std.dev.: 0.1325) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (9.9842 => 10.4562, std.dev.: 0.0494) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3040 => 0.3160, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (6.8321 => 7.0881, std.dev.: 0.0306) MultiSource/Applications/JM/lencod/lencod: 3.55% (22.6287 => 23.4328, std.dev.: 0.0302) MultiSource/Applications/d/make_dparser: 3.53% (3.9641 => 4.1041, std.dev.: 0.0220) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.39% (1.4160 => 1.4640, std.dev.: 0.0161) MultiSource/Applications/JM/ldecod/ldecod: 3.37% (10.3203 => 10.6683, std.dev.: 0.0472) MultiSource/Applications/SPASS/SPASS: 3.25% (18.4924 => 19.0926, std.dev.: 0.0471) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0200) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.91% (51.1089 => 52.5969, std.dev.: 0.0853) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (2.2721 => 2.3361, std.dev.: 0.0099) MultiSource/Applications/treecc/treecc: 2.75% (2.6200 => 2.6920, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0082) MultiSource/Applications/kimwitu++/kc: 2.70% (19.7371 => 20.2691, std.dev.: 0.0369) MultiSource/Applications/ClamAV/clamscan: 2.55% (20.2445 => 20.7605, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (5.5480 => 5.6720, std.dev.: 0.0416) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (16.5963 => 16.9563, std.dev.: 0.0410) MultiSource/Benchmarks/Bullet/bullet: 2.01% (38.9366 => 39.7206, std.dev.: 0.0807) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (3.0122 => 3.0722, std.dev.: 0.0166) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 1.54% (25.1895 => 25.5776, std.dev.: 0.0626) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0244 => 6.1164, std.dev.: 0.0218) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.21% (29.4578 => 29.8139, std.dev.: 0.0870) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 27.58% (0.9281 => 1.1841, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 13.64% (0.1760 => 0.2000, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.94% (1.2681 => 1.3561, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.51% (4.6083 => 4.8163, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.74% (4.0923 => 4.2043, std.dev.: 0.0219) MultiSource/Applications/minisat/minisat: 2.70% (6.8204 => 7.0044, std.dev.: 0.0477) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0721 => 1.0921, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.43% (4.7563 => 4.8243, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.56% (6.2884 => 1.3481, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/nestedloop: -65.45% (2.9642 => 1.0241, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.24% (1.5881 => 0.5520, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: -61.46% (3.1762 => 1.2241, std.dev.: 0.0064) MultiSource/Applications/obsequi/Obsequi: -33.24% (2.6481 => 1.7680, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.79% (7.4801 => 6.2240, std.dev.: 0.0390) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.46% (7.5041 => 6.3440, std.dev.: 0.0379) MultiSource/Benchmarks/mafft/pairlocalalign: -2.60% (13.5243 => 13.1723, std.dev.: 0.0400) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: -14.26% (7.8005 => 6.6884, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.60% (0.9281 => 0.8761, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -2.40% (5.1603 => 5.0363, std.dev.: 0.0268) MultiSource/Applications/JM/lencod/lencod: -2.36% (8.3085 => 8.1125, std.dev.: 0.0490) MultiSource/Benchmarks/BitBench/five11/five11: -1.71% (2.3401 => 2.3001, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.63% (3.4442 => 3.3882, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 03:33:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 05:33:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401103334.09AB72A6C038@llvm.org> http://llvm.org/perf/db_default/v4/nts/24213?compare_to=24207&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24213, Order: 205282, Start Time: 2014-04-01 05:48:12, End Time: 2014-04-01 10:39:46 To: 24207, Order: 205281, Start Time: 2014-04-01 04:30:46, End Time: 2014-04-01 09:22:00 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (102 on baseline) Performance Improvements: 2 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.00% (0.2400 => 0.2520, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.78% (1.3521 => 1.3761, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.22% (5.4083 => 5.5283, std.dev.: 0.0366) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: -80.00% (0.0200 => 0.0040, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -11.22% (1.2121 => 1.0761, std.dev.: 0.0402) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.41% (0.6240 => 0.6640, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0434) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.76% (10.6960 => 11.3120, std.dev.: 0.0751) SingleSource/UnitTests/Vector/constpool: 5.32% (10.8967 => 11.4767, std.dev.: 0.0806) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0205) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0470) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (10.4082 => 10.8162, std.dev.: 0.0387) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.9200 => 5.1040, std.dev.: 0.0303) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.49% (1.3760 => 1.4240, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0538) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0361) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0485) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0336) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.4400 => 1.4800, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 2.58% (23.7574 => 24.3695, std.dev.: 0.0506) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.7120 => 0.7280, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.22% (48.1088 => 49.1770, std.dev.: 0.0796) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0158) MultiSource/Benchmarks/Bullet/bullet: 2.06% (37.0925 => 37.8565, std.dev.: 0.0530) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0317) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1331, std.dev.: 0.0473) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0140) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0209) MultiSource/Applications/SPASS/SPASS: 1.19% (17.5484 => 17.7564, std.dev.: 0.0411) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0246) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0432) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0111) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.51% (21.1533 => 21.4733, std.dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 1.05% (9.1686 => 9.2646, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.21% (1.2601 => 1.1441, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 05:22:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 07:22:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401122217.C06312A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24214?compare_to=24213&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24214, Order: 205285, Start Time: 2014-04-01 07:38:20, End Time: 2014-04-01 12:28:26 To: 24213, Order: 205282, Start Time: 2014-04-01 05:48:12, End Time: 2014-04-01 10:39:46 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (92 on baseline) Performance Improvements: 1 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (1005 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 7.14% (0.2800 => 0.3000, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.92% (0.2440 => 0.2560, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.37% (0.7120 => 0.7360, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.46% (1.3681 => 1.3881, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.26% (1.2721 => 1.2881, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: 2.05% (0.5840 => 0.5960, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 1.21% (1.3201 => 1.3361, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (4.0723 => 4.1203, std.dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.40% (0.8561 => 0.8441, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0065) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.98% (0.3280 => 0.3640, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.84% (0.6640 => 0.7360, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.82% (1.2281 => 1.3241, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0452) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0684) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: 5.69% (10.8967 => 11.5167, std.dev.: 0.0692) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0337) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0275) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.45% (0.3480 => 0.3600, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0410) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0703) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.0122 => 4.1123, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 2.39% (23.7574 => 24.3255, std.dev.: 0.0581) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0307) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.35% (48.1088 => 49.2370, std.dev.: 0.0782) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (5.8400 => 5.9600, std.dev.: 0.0380) MultiSource/Benchmarks/Bullet/bullet: 1.97% (37.0925 => 37.8245, std.dev.: 0.0751) MultiSource/Applications/kimwitu++/kc: 1.87% (18.8170 => 19.1690, std.dev.: 0.0332) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0195) MultiSource/Applications/SPASS/SPASS: 1.03% (17.5484 => 17.7284, std.dev.: 0.0598) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 24.46% (0.9321 => 1.1601, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0629) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.40% (21.1533 => 21.4493, std.dev.: 0.0957) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (4.0643 => 4.1203, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -1.97% (0.6080 => 0.5960, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 05:35:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 07:35:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401123500.267A82A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24215?compare_to=24214&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24215, Order: 205286, Start Time: 2014-04-01 07:54:13, End Time: 2014-04-01 12:41:14 To: 24214, Order: 205285, Start Time: 2014-04-01 07:38:20, End Time: 2014-04-01 12:28:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (100 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-19-CodegenBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-07-VarArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 29.41% (0.0680 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 26.67% (0.0600 => 0.0760, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.2680 => 0.2800, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.07% (5.9760 => 6.0400, std.dev.: 0.0240) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0761 => 1.0881, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.35% (0.7360 => 0.7040, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0812) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: 5.73% (10.8967 => 11.5207, std.dev.: 0.0806) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0438) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0240) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0179) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0431) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0348) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0094) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0469) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0344) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0312) MultiSource/Applications/sqlite3/sqlite3: 2.27% (23.7574 => 24.2975, std.dev.: 0.0689) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.26% (48.1088 => 49.1970, std.dev.: 0.0804) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8966, std.dev.: 0.0501) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0173) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0444) MultiSource/Applications/kimwitu++/kc: 1.79% (18.8170 => 19.1530, std.dev.: 0.0400) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0216) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0508) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (28.1538 => 28.4498, std.dev.: 0.0488) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0230) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0456) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0110) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.51% (21.1533 => 21.4733, std.dev.: 0.1002) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (25.8896 => 26.1576, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0249) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 06:11:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 08:11:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401131158.606042A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24216?compare_to=24215&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24216, Order: 205287, Start Time: 2014-04-01 08:24:25, End Time: 2014-04-01 13:18:12 To: 24215, Order: 205286, Start Time: 2014-04-01 07:54:13, End Time: 2014-04-01 12:41:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (108 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 6.38% (0.1880 => 0.2000, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4360 => 0.4560, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 83.09% (49.3831 => 90.4137, std.dev.: 8.4605) SingleSource/Benchmarks/Misc-C++/bigfib: 10.29% (0.2720 => 0.3000, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.11% (2.4442 => 2.5202, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout/hash: 1.04% (4.2363 => 4.2803, std.dev.: 0.0136) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0069) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0118) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.76% (10.6960 => 11.3120, std.dev.: 0.0632) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0118) SingleSource/Regression/C++/ofstream_ctor: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (8.1441 => 8.4761, std.dev.: 0.0592) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0179) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0358) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0189) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0414) SingleSource/UnitTests/Vector/constpool: 3.56% (10.8967 => 11.2847, std.dev.: 0.1274) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0425) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0392) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8725, std.dev.: 0.0616) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0270) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.75% (48.1088 => 48.9489, std.dev.: 0.1152) MultiSource/Applications/sqlite3/sqlite3: 1.65% (23.7574 => 24.1495, std.dev.: 0.0530) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0142) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 1.48% (7.8562 => 7.9722, std.dev.: 0.0400) MultiSource/Applications/treecc/treecc: 1.47% (2.4480 => 2.4840, std.dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.6321 => 1.6561, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 1.47% (18.8170 => 19.0930, std.dev.: 0.0528) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 82.45% (49.5551 => 90.4137, std.dev.: 8.4605) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0483) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.22% (4.5043 => 4.6043, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0084) MultiSource/Applications/lua/lua: 1.46% (21.1533 => 21.4613, std.dev.: 0.1081) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: -40.00% (0.0400 => 0.0240, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -35.71% (0.0560 => 0.0360, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 07:12:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 09:12:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401141219.1AB532A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24217?compare_to=24216&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24217, Order: 205288, Start Time: 2014-04-01 09:27:50, End Time: 2014-04-01 14:18:30 To: 24216, Order: 205287, Start Time: 2014-04-01 08:24:25, End Time: 2014-04-01 13:18:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (116 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 25.00% (0.0640 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 25.00% (0.0640 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.04% (0.2840 => 0.3040, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.23% (1.2961 => 1.3121, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.06% (11.3120 => 11.4320, std.dev.: 0.0444) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.83% (0.0960 => 0.1160, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.81% (0.2960 => 0.3280, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.49% (0.3440 => 0.3560, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -8.05% (2.5842 => 2.3761, std.dev.: 0.0679) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: 16.22% (0.1480 => 0.1720, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.28% (1.1601 => 1.2561, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.05% (0.6240 => 0.6680, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0444) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0330) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0097) SingleSource/UnitTests/Vector/constpool: 4.52% (10.8967 => 11.3887, std.dev.: 0.1496) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.9880 => 1.0320, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0286) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0496) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0473) MultiSource/Applications/lua/lua: 2.83% (4.5200 => 4.6480, std.dev.: 0.0358) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0288) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7880 => 0.8040, std.dev.: 0.0051) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.97% (48.1088 => 49.0570, std.dev.: 0.0910) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8165, std.dev.: 0.0788) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0550) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (7.8562 => 7.9962, std.dev.: 0.0332) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0106) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1250, std.dev.: 0.0395) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0112) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0309) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.38% (21.1533 => 21.4453, std.dev.: 0.0643) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0278) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 07:12:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 09:12:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140401141237.A889C2A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24218?compare_to=24208&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24218, Order: 205288, Start Time: 2014-04-01 09:28:30, End Time: 2014-04-01 14:18:53 To: 24208, Order: 205281, Start Time: 2014-04-01 04:32:30, End Time: 2014-04-01 09:23:13 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 10 (136 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 7.41% (0.2160 => 0.2320, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0041) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.65% (1.3160 => 1.3640, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.20% (1.6361 => 1.6721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.20% (1.6641 => 1.6841, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.52% (0.2520 => 0.2760, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lemon/lemon: -1.85% (1.5161 => 1.4881, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.91% (11.3687 => 31.2540, std.dev.: 0.0494) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0122) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0109) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.75% (1.0240 => 1.2160, std.dev.: 0.0191) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.25% (0.2360 => 0.2720, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.26% (0.4240 => 0.4760, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/em3d/em3d: 11.54% (0.2080 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.72% (1.4401 => 1.5801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.47% (1.8161 => 1.9881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.04% (1.4601 => 1.5921, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0059) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.4961 => 1.6241, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.36% (1.4841 => 1.6081, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.01% (1.5481 => 1.6721, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.95% (0.7040 => 0.7600, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: 7.27% (10.6247 => 11.3967, std.dev.: 0.0628) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.21% (1.7761 => 1.9041, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.20% (1.6121 => 1.7281, std.dev.: 0.0116) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.90% (0.3480 => 0.3720, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.23% (1.5401 => 1.6361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.22% (1.4801 => 1.5721, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 6.03% (1.1280 => 1.1960, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (1.7401 => 1.8361, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (11.6440 => 12.2840, std.dev.: 0.0773) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.44% (1.6921 => 1.7841, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (5.8121 => 6.1201, std.dev.: 0.0457) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (9.4842 => 9.9842, std.dev.: 0.0487) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.7400 => 1.8280, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0079) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.74% (1.5201 => 1.5921, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.4640 => 1.5280, std.dev.: 0.0200) MultiSource/Applications/JM/lencod/lencod: 4.30% (21.9606 => 22.9048, std.dev.: 0.0393) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5440 => 6.8160, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0176) MultiSource/Applications/JM/ldecod/ldecod: 4.10% (10.0443 => 10.4563, std.dev.: 0.0563) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0093) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (6.5080 => 6.7520, std.dev.: 0.0569) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.66% (1.3120 => 1.3600, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0039) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.58% (50.0290 => 51.8210, std.dev.: 0.0850) MultiSource/Applications/oggenc/oggenc: 3.49% (6.9844 => 7.2285, std.dev.: 0.0164) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (5.3600 => 5.5400, std.dev.: 0.0410) MultiSource/Benchmarks/Bullet/bullet: 3.08% (38.4046 => 39.5886, std.dev.: 0.0796) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0109) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.02% (1.3240 => 1.3640, std.dev.: 0.0133) MultiSource/Applications/SPASS/SPASS: 2.91% (18.4404 => 18.9766, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 2.76% (4.7880 => 4.9200, std.dev.: 0.0268) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0214) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4560 => 0.4680, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 2.44% (19.0444 => 19.5083, std.dev.: 0.0557) MultiSource/Applications/kimwitu++/kc: 2.13% (19.6891 => 20.1091, std.dev.: 0.0511) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (16.3483 => 16.6843, std.dev.: 0.0494) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.89% (2.1401 => 2.4802, std.dev.: 0.0369) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.24% (3.3002 => 3.4402, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.11% (3.9842 => 4.0683, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9724 => 6.0684, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.63% (2.9442 => 0.6880, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.10% (1.5641 => 0.6240, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: -5.35% (1.8680 => 1.7680, std.dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.16% (91.8497 => 49.4551, std.dev.: 6.5588) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.48% (50.3031 => 32.9581, std.dev.: 0.1898) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.40% (26.0616 => 17.0971, std.dev.: 0.1003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.42% (42.1466 => 28.4818, std.dev.: 0.9488) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.65% (3.1122 => 2.3761, std.dev.: 0.0967) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -13.21% (7.7845 => 6.7564, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0131) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.1563 => 5.0963, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 07:17:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 09:17:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140401141719.B6CA32A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24219?compare_to=24210&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24219, Order: 205288, Start Time: 2014-04-01 09:33:55, End Time: 2014-04-01 14:23:34 To: 24210, Order: 205281, Start Time: 2014-04-01 04:38:27, End Time: 2014-04-01 09:28:44 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 3 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2008-01-07-LongDouble: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/cast-bug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.29% (0.2240 => 0.2560, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/almabench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.17% (1.7161 => 1.7361, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 26.67% (0.0600 => 0.0760, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.63% (0.3440 => 0.3840, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.57% (4.6763 => 4.7963, std.dev.: 0.0266) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.98% (0.4680 => 0.4400, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.55% (3.0962 => 3.0482, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.02% (1.7241 => 1.6721, std.dev.: 0.0186) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 07:18:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 09:18:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140401141846.3F9292A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24220?compare_to=24209&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24220, Order: 205288, Start Time: 2014-04-01 09:31:11, End Time: 2014-04-01 14:25:00 To: 24209, Order: 205281, Start Time: 2014-04-01 04:32:29, End Time: 2014-04-01 09:25:58 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (139 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/EH/class_hierarchy: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.13% (0.1240 => 0.1440, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.76% (0.1360 => 0.1520, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.52% (0.2520 => 0.2760, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.79% (1.1201 => 1.1401, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -1.04% (3.0722 => 3.0402, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.93% (17.6723 => 19.6044, std.dev.: 0.0428) MultiSource/Applications/sqlite3/sqlite3: 1415.30% (1.7001 => 25.7616, std.dev.: 0.0472) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.72% (50.1010 => 51.9650, std.dev.: 0.0528) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.76% (11.3920 => 12.2760, std.dev.: 0.0663) SingleSource/Benchmarks/Misc/oourafft: 175.42% (11.3407 => 31.2340, std.dev.: 0.0907) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9882, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0064) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0040) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0047) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.14% (0.1160 => 0.1440, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0056) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.20% (1.9721 => 2.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.32% (1.9521 => 2.2121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4122, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.93% (1.8441 => 2.0641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.93% (1.9761 => 2.1921, std.dev.: 0.0208) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0108) SingleSource/UnitTests/Vector/constpool: 9.85% (10.4007 => 11.4247, std.dev.: 0.1072) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 9.59% (0.2920 => 0.3200, std.dev.: 0.0048) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.81% (0.6360 => 0.6920, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.60% (6.4800 => 6.9080, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 6.30% (1.0160 => 1.0800, std.dev.: 0.0187) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.84% (0.6160 => 0.6520, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.7280 => 0.7680, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (0.4760 => 0.5000, std.dev.: 0.0090) MultiSource/Applications/Burg/burg: 4.97% (1.5280 => 1.6040, std.dev.: 0.0236) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.50% (9.6042 => 10.0362, std.dev.: 0.0370) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.49% (0.9801 => 1.0241, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0247) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (5.8281 => 6.0521, std.dev.: 0.0306) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (6.5320 => 6.7800, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0182) MultiSource/Applications/oggenc/oggenc: 3.18% (7.0524 => 7.2765, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 2.90% (0.8280 => 0.8520, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 2.84% (4.7920 => 4.9280, std.dev.: 0.0269) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (5.3960 => 5.5480, std.dev.: 0.0387) MultiSource/Applications/treecc/treecc: 2.78% (2.5880 => 2.6600, std.dev.: 0.0193) MultiSource/Benchmarks/Bullet/bullet: 2.68% (38.6366 => 39.6726, std.dev.: 0.0668) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (16.3003 => 16.7163, std.dev.: 0.0557) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (2.1600 => 2.2120, std.dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 2.34% (22.2206 => 22.7407, std.dev.: 0.0632) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (6.5360 => 6.6840, std.dev.: 0.0510) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0119) MultiSource/Applications/SPASS/SPASS: 2.03% (18.5284 => 18.9045, std.dev.: 0.0489) MultiSource/Applications/kimwitu++/kc: 1.63% (19.8291 => 20.1531, std.dev.: 0.0313) MultiSource/Applications/JM/ldecod/ldecod: 1.37% (10.2283 => 10.3683, std.dev.: 0.0483) MultiSource/Applications/siod/siod: 1.31% (2.7522 => 2.7882, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0363 => 13.1763, std.dev.: 0.0266) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7842 => 2.8122, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.34% (2.1201 => 2.4242, std.dev.: 0.0403) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.12% (3.2082 => 3.2762, std.dev.: 0.0139) MultiSource/Applications/minisat/minisat: 1.82% (6.5964 => 6.7164, std.dev.: 0.0419) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (26.3056 => 26.7177, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.28% (3.7442 => 3.7922, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.05% (2.9562 => 0.7080, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: -4.90% (1.8760 => 1.7840, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.20% (94.8339 => 49.1231, std.dev.: 6.3135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.86% (49.9431 => 33.0301, std.dev.: 0.2096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.56% (25.7136 => 17.0851, std.dev.: 0.1151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.68% (37.0863 => 28.6738, std.dev.: 0.3656) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.40% (3.0722 => 2.3841, std.dev.: 0.0619) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.15% (1.2681 => 1.2281, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.31% (2.7722 => 2.7082, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0199) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 07:24:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 09:24:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140401142437.374232A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24221?compare_to=24211&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24221, Order: 205288, Start Time: 2014-04-01 09:34:54, End Time: 2014-04-01 14:30:51 To: 24211, Order: 205281, Start Time: 2014-04-01 04:32:28, End Time: 2014-04-01 09:29:46 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 11 (155 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 11.43% (0.1400 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (0.1800 => 0.2000, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.33% (0.1920 => 0.2080, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5840 => 0.5960, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.76% (0.9081 => 0.9241, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.13% (1.4121 => 1.4281, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.87% (0.3560 => 0.3840, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1925.00% (0.0320 => 0.6480, std.dev.: 0.0074) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0116) SingleSource/Regression/C/sumarray2d: 1100.00% (0.0360 => 0.4320, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 736.84% (0.0760 => 0.6360, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 392.10% (0.2520 => 1.2401, std.dev.: 0.0096) SingleSource/UnitTests/Vector/multiplies: 328.57% (0.0280 => 0.1200, std.dev.: 0.0053) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 262.11% (0.2320 => 0.8401, std.dev.: 0.0088) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 115.38% (0.1040 => 0.2240, std.dev.: 0.0065) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0069) SingleSource/Regression/C/test_indvars: 100.00% (0.0320 => 0.0640, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 82.86% (0.1400 => 0.2560, std.dev.: 0.0072) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 60.00% (0.0800 => 0.1280, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0060) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.57% (0.7040 => 1.0600, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 40.00% (0.1600 => 0.2240, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.60% (1.2321 => 1.5721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.09% (1.2401 => 1.5761, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.64% (1.2481 => 1.5681, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.53% (1.1561 => 1.4281, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.47% (1.1761 => 1.4521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.33% (1.2001 => 1.4801, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 22.46% (1.3001 => 1.5921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 22.26% (1.1321 => 1.3841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.83% (1.1361 => 1.3841, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0117) MultiSource/Applications/obsequi/Obsequi: 21.55% (1.3920 => 1.6920, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.53% (1.1521 => 1.4001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.50% (1.1721 => 1.4241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.48% (1.1361 => 1.3801, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 21.08% (1.2521 => 1.5161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (1.1441 => 1.3841, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.77% (1.2521 => 1.5121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.45% (1.2321 => 1.4841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.20% (1.1881 => 1.4281, std.dev.: 0.0108) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.88% (1.3681 => 1.6401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.56% (1.2881 => 1.5401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.00% (1.2841 => 1.5281, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: 18.84% (8.5802 => 10.1963, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.21% (1.3841 => 1.6361, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 15.68% (1.3521 => 1.5641, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 15.50% (19.5406 => 22.5687, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.77% (5.3360 => 6.1241, std.dev.: 0.0376) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.7400 => 1.9560, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 9.48% (6.2844 => 6.8804, std.dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: 9.07% (11.3843 => 12.4163, std.dev.: 0.0540) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.01% (0.4440 => 0.4840, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.59% (5.7280 => 6.2200, std.dev.: 0.0268) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (11.4440 => 12.3240, std.dev.: 0.0578) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.48% (5.6680 => 6.0920, std.dev.: 0.0357) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0174) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (9.5802 => 10.2322, std.dev.: 0.0481) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.98% (0.7360 => 0.7800, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (1.4760 => 1.5640, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.43% (1.6240 => 1.6960, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: 4.28% (11.0207 => 11.4927, std.dev.: 0.0850) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0145) MultiSource/Applications/lua/lua: 3.77% (4.7720 => 4.9520, std.dev.: 0.0395) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (6.8280 => 7.0640, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0195) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.34% (49.1529 => 50.7969, std.dev.: 0.0692) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 3.05% (5.3840 => 5.5480, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 2.73% (19.2243 => 19.7484, std.dev.: 0.0627) MultiSource/Applications/sqlite3/sqlite3: 2.57% (24.7575 => 25.3935, std.dev.: 0.0324) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 1.74% (19.7491 => 20.0931, std.dev.: 0.0391) MultiSource/Benchmarks/Bullet/bullet: 1.42% (39.0726 => 39.6286, std.dev.: 0.0749) MultiSource/Applications/siod/siod: 1.31% (2.7562 => 2.7922, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0124 => 6.0844, std.dev.: 0.0205) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.12% (29.3298 => 29.6579, std.dev.: 0.0431) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 17.75% (0.9241 => 1.0881, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.64% (1.2401 => 1.3721, std.dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.83% (3.9842 => 4.2963, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0410) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.25% (1.3521 => 1.3961, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.0563 => 4.1643, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.09% (2.9242 => 2.9562, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0038) SingleSource/UnitTests/2003-05-31-LongShifts: -75.00% (0.0160 => 0.0040, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -14.96% (7.8605 => 6.6844, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0307) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.13% (4.5123 => 4.4163, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.86% (3.4442 => 3.3802, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.84% (4.1243 => 4.0483, std.dev.: 0.0293) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.0963 => 5.0323, std.dev.: 0.0224) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 07:27:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 09:27:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140401142706.16DF72A6C039@llvm.org> http://llvm.org/perf/db_default/v4/nts/24222?compare_to=24212&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24222, Order: 205288, Start Time: 2014-04-01 09:41:44, End Time: 2014-04-01 14:33:18 To: 24212, Order: 205281, Start Time: 2014-04-01 04:44:09, End Time: 2014-04-01 09:36:37 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (129 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (957 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/PR491: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/UnitTests/Vector/simple: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) MultiSource/Applications/aha/aha: 12.50% (0.1280 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.74% (2.2961 => 2.2561, std.dev.: 0.0151) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 301.78% (0.4560 => 1.8321, std.dev.: 0.0060) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.35% (1.6961 => 2.0921, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) SingleSource/Regression/C/sumarraymalloc: 22.73% (0.0880 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 22.67% (1.6761 => 2.0561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.63% (1.7321 => 2.1241, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 22.06% (1.6681 => 2.0361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 22.01% (1.7081 => 2.0841, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.01% (1.6721 => 2.0401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.98% (1.6921 => 2.0641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.93% (1.6961 => 2.0681, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.86% (1.7201 => 2.0961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.77% (1.7641 => 2.1481, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.75% (1.6921 => 2.0601, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.58% (1.7241 => 2.0961, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.55% (1.8001 => 2.1881, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.43% (1.6801 => 2.0401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.27% (1.7681 => 2.1441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 21.22% (1.8281 => 2.2161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.20% (1.7921 => 2.1721, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.19% (1.8881 => 2.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.16% (1.7201 => 2.0841, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.02% (1.8081 => 2.1881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.01% (1.9801 => 2.3961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.82% (1.7481 => 2.1121, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.26% (1.8361 => 2.2081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.22% (1.8201 => 2.1881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.43% (1.9761 => 2.3601, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 19.14% (1.9641 => 2.3401, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.79% (1.9801 => 2.3521, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.5560 => 0.6000, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (3.5002 => 3.7562, std.dev.: 0.0245) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 6.81% (1.8201 => 1.9441, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3000 => 0.3200, std.dev.: 0.0039) SingleSource/Regression/C/bigstack: 6.67% (0.1800 => 0.1920, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.25% (0.1920 => 0.2040, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (11.7880 => 12.5040, std.dev.: 0.0633) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.42% (6.7200 => 7.0840, std.dev.: 0.0383) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.10% (0.7840 => 0.8240, std.dev.: 0.0141) SingleSource/Benchmarks/Linpack/linpack-pc: 5.06% (0.3160 => 0.3320, std.dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: 5.02% (10.9087 => 11.4567, std.dev.: 0.0795) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (9.9842 => 10.4642, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.52% (1.2400 => 1.2960, std.dev.: 0.0215) MultiSource/Applications/oggenc/oggenc: 4.40% (6.9124 => 7.2165, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0208) MultiSource/Applications/d/make_dparser: 4.34% (3.9641 => 4.1361, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.23% (0.7560 => 0.7880, std.dev.: 0.0117) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0213) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.92% (0.4080 => 0.4240, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (2.0680 => 2.1480, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.86% (6.8321 => 7.0961, std.dev.: 0.0346) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.67% (1.4160 => 1.4680, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (0.3400 => 0.3520, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.85% (22.6287 => 23.2727, std.dev.: 0.0534) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (10.3203 => 10.6083, std.dev.: 0.0389) MultiSource/Applications/SPASS/SPASS: 2.68% (18.4924 => 18.9885, std.dev.: 0.0515) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.58% (51.1089 => 52.4289, std.dev.: 0.0697) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (2.1560 => 2.2040, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 2.19% (19.7371 => 20.1691, std.dev.: 0.0379) MultiSource/Benchmarks/Bullet/bullet: 2.04% (38.9366 => 39.7326, std.dev.: 0.0849) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (16.5963 => 16.9203, std.dev.: 0.0525) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: 1.84% (20.2445 => 20.6164, std.dev.: 0.0834) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0130) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 1.48% (25.1895 => 25.5616, std.dev.: 0.0452) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0244 => 6.1124, std.dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 28.01% (0.9281 => 1.1881, std.dev.: 0.0124) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.57% (1.2681 => 1.3641, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.51% (4.6083 => 4.8163, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0279) MultiSource/Applications/sqlite3/sqlite3: 2.64% (4.0923 => 4.2003, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4041 => 1.4201, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.50% (6.2884 => 1.3521, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/nestedloop: -65.45% (2.9642 => 1.0241, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/nestedloop: -61.46% (3.1762 => 1.2241, std.dev.: 0.0074) MultiSource/Applications/obsequi/Obsequi: -33.24% (2.6481 => 1.7680, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.36% (7.4801 => 6.2560, std.dev.: 0.0294) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.21% (7.5041 => 6.2880, std.dev.: 0.0329) MultiSource/Benchmarks/mafft/pairlocalalign: -2.84% (13.5243 => 13.1403, std.dev.: 0.0399) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -14.31% (7.8005 => 6.6844, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0078) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0192) MultiSource/Applications/lambda-0_1_3/lambda: -2.25% (5.1603 => 5.0443, std.dev.: 0.0257) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.74% (3.4442 => 3.3842, std.dev.: 0.0180) MultiSource/Benchmarks/BitBench/five11/five11: -1.71% (2.3401 => 2.3001, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 08:30:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 10:30:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401153025.ED7212A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24223?compare_to=24217&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24223, Order: 205289, Start Time: 2014-04-01 10:44:53, End Time: 2014-04-01 15:36:38 To: 24217, Order: 205288, Start Time: 2014-04-01 09:27:50, End Time: 2014-04-01 14:18:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (98 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1000 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 28.57% (0.0840 => 0.1080, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 25.00% (0.0800 => 0.1000, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.12% (0.1320 => 0.1480, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.12% (0.6720 => 0.7400, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 2.00% (4.9920 => 5.0920, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.46% (1.3721 => 1.3921, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 2.74% (2.0441 => 2.1001, std.dev.: 0.0198) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/UnitTests/Vector/divides: 100.00% (0.0120 => 0.0240, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0071) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0144) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0446) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: 4.52% (10.8967 => 11.3887, std.dev.: 0.1092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0508) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0424) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0558) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0282) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 2.11% (37.0925 => 37.8766, std.dev.: 0.0416) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0209, std.dev.: 0.0681) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0758) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (7.8562 => 7.9762, std.dev.: 0.0456) MultiSource/Applications/kimwitu++/kc: 1.49% (18.8170 => 19.0971, std.dev.: 0.0381) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0237) MultiSource/Applications/siod/siod: 1.24% (2.5721 => 2.6041, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.6321 => 1.6521, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.46% (0.9321 => 1.1601, std.dev.: 0.0263) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.63% (6.6564 => 6.9644, std.dev.: 0.0405) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0100) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0102) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0339) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.18% (2.3881 => 2.3121, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 10:17:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 12:17:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401171741.25D032A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24224?compare_to=24223&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24224, Order: 205298, Start Time: 2014-04-01 12:34:12, End Time: 2014-04-01 17:23:55 To: 24223, Order: 205289, Start Time: 2014-04-01 10:44:53, End Time: 2014-04-01 15:36:38 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (107 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/queens: 44.44% (0.0360 => 0.0520, std.dev.: 0.0059) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 28.57% (0.0560 => 0.0720, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.61% (1.3480 => 1.4640, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.65% (0.3440 => 0.3600, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (0.9001 => 0.9201, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.65% (1.4561 => 1.4801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.55% (1.2921 => 1.3121, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 1.52% (1.3121 => 1.3321, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0206) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0141) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.09% (1.3800 => 1.4640, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0419) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (10.4082 => 10.8442, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0203) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0415) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0332) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.16% (1.5200 => 1.5680, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.90% (5.8000 => 5.9680, std.dev.: 0.0437) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0287) MultiSource/Applications/hbd/hbd: 2.62% (1.6800 => 1.7240, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0254) MultiSource/Applications/sqlite3/sqlite3: 2.41% (23.7574 => 24.3295, std.dev.: 0.0421) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.28% (48.1088 => 49.2050, std.dev.: 0.1037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0175) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0378) MultiSource/Benchmarks/Bullet/bullet: 1.90% (37.0925 => 37.7966, std.dev.: 0.0578) MultiSource/Applications/kimwitu++/kc: 1.89% (18.8170 => 19.1730, std.dev.: 0.0743) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0112) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.28% (28.1538 => 28.5138, std.dev.: 0.0472) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0395) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 24.46% (0.9321 => 1.1601, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0597) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0116) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0260) MultiSource/Benchmarks/Olden/tsp/tsp: 1.52% (1.3121 => 1.3321, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.38% (21.1533 => 21.4453, std.dev.: 0.0906) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 10:28:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 12:28:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401172830.510822A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24225?compare_to=24224&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24225, Order: 205304, Start Time: 2014-04-01 12:49:39, End Time: 2014-04-01 17:34:42 To: 24224, Order: 205298, Start Time: 2014-04-01 12:34:12, End Time: 2014-04-01 17:23:55 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (103 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-05-CastFPToUint: 200.00% (0.0080 => 0.0240, std.dev.: 0.0047) SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 10.39% (0.3080 => 0.3400, std.dev.: 0.0080) SingleSource/UnitTests/SignlessTypes/rem: 10.00% (0.1200 => 0.1320, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.16% (1.1400 => 1.1760, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.30% (1.7360 => 1.7760, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.00% (1.8000 => 1.8360, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 20.00% (0.1200 => 0.1440, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/lists: -1.68% (5.9644 => 5.8644, std.dev.: 0.0381) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0894) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.76% (1.7360 => 1.8360, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0486) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0337) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.9640 => 2.0600, std.dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 4.30% (10.4082 => 10.8562, std.dev.: 0.0321) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: 3.74% (10.8967 => 11.3047, std.dev.: 0.1279) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (5.8400 => 6.0480, std.dev.: 0.0226) MultiSource/Applications/JM/lencod/lencod: 3.34% (17.6165 => 18.2045, std.dev.: 0.0456) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0349) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.8000 => 5.9560, std.dev.: 0.0548) MultiSource/Benchmarks/Bullet/bullet: 2.61% (37.0925 => 38.0606, std.dev.: 0.0466) MultiSource/Applications/sqlite3/sqlite3: 2.46% (23.7574 => 24.3415, std.dev.: 0.0530) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0379) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0316) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.35% (48.1088 => 49.2370, std.dev.: 0.0659) MultiSource/Applications/oggenc/oggenc: 2.28% (5.7964 => 5.9284, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0131) MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.97% (1.2200 => 1.2440, std.dev.: 0.0092) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1450, std.dev.: 0.0416) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0402) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (28.1538 => 28.4378, std.dev.: 0.0714) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.89% (0.9321 => 1.1641, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.68% (0.2480 => 0.2720, std.dev.: 0.0087) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0326) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0225) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0064) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/mason/mason: -15.79% (0.0760 => 0.0640, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 11:12:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 13:12:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401181256.691E52A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24226?compare_to=24225&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24226, Order: 205307, Start Time: 2014-04-01 13:26:14, End Time: 2014-04-01 18:19:10 To: 24225, Order: 205304, Start Time: 2014-04-01 12:49:39, End Time: 2014-04-01 17:34:42 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (104 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.12% (0.1320 => 0.1480, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.49% (0.6560 => 0.6920, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.94% (0.4080 => 0.4200, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 1.88% (1.4880 => 1.5160, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.71% (5.8644 => 5.9644, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -1.47% (1.0881 => 1.0721, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0080) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0107) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0383) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0707) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0412) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0052) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0106) SingleSource/UnitTests/Vector/constpool: 4.22% (10.8967 => 11.3567, std.dev.: 0.0933) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0183) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0438) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0382) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0221) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0363) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0393) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.39% (48.1088 => 49.2610, std.dev.: 0.1097) MultiSource/Benchmarks/Bullet/bullet: 2.28% (37.0925 => 37.9365, std.dev.: 0.0750) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0361) MultiSource/Applications/sqlite3/sqlite3: 2.12% (23.7574 => 24.2615, std.dev.: 0.0569) MultiSource/Applications/oggenc/oggenc: 2.07% (5.7964 => 5.9164, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1210, std.dev.: 0.0256) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.6321 => 1.6561, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0554) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 24.46% (0.9321 => 1.1601, std.dev.: 0.0303) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0425) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.00% (25.8896 => 26.1496, std.dev.: 0.0226) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 11:41:27 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 11:41:27 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140401184142.4B8B14EE6170@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14296 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205338 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17579 of 17580) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17580 of 17580) 1 warning(s) in tests. Testing Time: 353.44s ******************** Unresolved Tests (1): LLVM :: CodeGen/R600/setcc-equivalent.ll Expected Passes : 17435 Expected Failures : 101 Unsupported Tests : 43 Unresolved Tests : 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::setcc-equivalent.ll': ******************** TEST 'LLVM :: CodeGen/R600/setcc-equivalent.ll' FAILED ******************** Test has no run line! ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 11:41:27 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 11:41:27 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140401184142.4ADC74EE616F@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14296 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205338 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17579 of 17580) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17580 of 17580) 1 warning(s) in tests. Testing Time: 353.44s ******************** Unresolved Tests (1): LLVM :: CodeGen/R600/setcc-equivalent.ll Expected Passes : 17435 Expected Failures : 101 Unsupported Tests : 43 Unresolved Tests : 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::setcc-equivalent.ll': ******************** TEST 'LLVM :: CodeGen/R600/setcc-equivalent.ll' FAILED ******************** Test has no run line! ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 11:41:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 11:41:42 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140401184155.0D2084EE6193@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18734 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205338 Blamelist: arsenm,emaste,yrnkrn BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 11:41:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 11:41:42 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140401184155.0DD234EE6194@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18734 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205338 Blamelist: arsenm,emaste,yrnkrn BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: include/llvm/Target/TargetLowering.h lib/CodeGen/SelectionDAG/TargetLowering.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Tue 01 Apr 2014 11:21:46 Changed By: arsenm Comments: Add helpers for checking if a value is a target boolean constant.Properties: Files: lib/CodeGen/SelectionDAG/DAGCombiner.cpp test/CodeGen/R600/setcc-equivalent.ll On: http://10.1.1.2/svn/llvm-project For: llvm At: Tue 01 Apr 2014 11:21:46 Changed By: arsenm Comments: Make isSetCCEquivalent respect the TargetBooleanContentsProperties: Files: source/Plugins/Process/Linux/ProcessMonitor.cpp source/Plugins/Process/Linux/ProcessMonitor.h source/Plugins/Process/POSIX/ProcessPOSIX.cpp On: http://10.1.1.2/svn/llvm-project For: lldb At: Tue 01 Apr 2014 11:25:46 Changed By: emaste Comments: Implement ProcessMonitor::Kill for Linux On FreeBSD ptrace(PT_KILL) is used to terminate the traced process (as if PT_CONTINUE had been used with SIGKILL as the signal to be delivered), and is the desired behaviour for ProcessPOSIX::DoDestroy. On Linux, after ptrace(PTRACE_KILL) the traced process still exists and can be interrogated. It is only upon resume that it exits as though it received SIGKILL. As the Linux PTRACE_KILL behaviour is not used by LLDB, rename BringProcessIntoLimbo to Kill, and change the implementation to simply call kill() instead of using ptrace. Thanks to Todd F for testing (Ubuntu 12.04, gcc 4.8.2). Sponsored by: DARPA, AFRL Differential Revision: http://llvm-reviews.chandlerc.com/D3159 Properties: Files: lib/Target/X86/X86AsmPrinter.cpp lib/Target/X86/X86FastISel.cpp lib/Target/X86/X86ISelLowering.cpp lib/Target/X86/X86ISelLowering.h lib/Target/X86/X86Subtarget.h lib/Target/X86/X86TargetMachine.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Tue 01 Apr 2014 11:25:46 Changed By: yrnkrn Comments: isTargetWindows() renamed to isTargetKnownWindowsMSVC() to reflect its current functionality. Based on Takumi NAKAMURA suggestion. Properties: LOGS: From llvm-testresults at cs.uiuc.edu Tue Apr 1 12:09:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 14:09:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401190955.2DE752A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24227?compare_to=24226&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24227, Order: 205313, Start Time: 2014-04-01 14:26:46, End Time: 2014-04-01 19:16:08 To: 24226, Order: 205307, Start Time: 2014-04-01 13:26:14, End Time: 2014-04-01 18:19:10 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (95 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 116.67% (0.0240 => 0.0520, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: 26.67% (0.1200 => 0.1520, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.82% (0.1760 => 0.1880, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.2480 => 0.2640, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.40% (1.1440 => 1.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.23% (1.2961 => 1.3121, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.59% (0.4640 => 0.4760, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.14% (3.5562 => 3.6322, std.dev.: 0.0277) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: -100.00% (0.0160 => 0.0000, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0028) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0118) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0649) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0571) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0209) SingleSource/UnitTests/Vector/constpool: 4.55% (10.8967 => 11.3927, std.dev.: 0.0839) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0407) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0201) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0355) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3480 => 0.3600, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0535) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.05% (23.7574 => 24.2455, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0320) MultiSource/Benchmarks/Bullet/bullet: 1.83% (37.0925 => 37.7725, std.dev.: 0.0584) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0312) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0147) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.76% (48.1088 => 48.9569, std.dev.: 0.1346) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 1.15% (18.8170 => 19.0330, std.dev.: 0.0517) MultiSource/Applications/SPASS/SPASS: 1.03% (17.5484 => 17.7284, std.dev.: 0.0275) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0233) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.83% (3.5322 => 3.6322, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.46% (21.1533 => 21.4613, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: -16.67% (0.0720 => 0.0600, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -15.79% (0.0760 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0297) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 12:16:33 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 12:16:33 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140401191633.515A64EE683F@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14297 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205339 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17579 of 17580) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17580 of 17580) 1 warning(s) in tests. Testing Time: 359.83s ******************** Unresolved Tests (1): LLVM :: CodeGen/R600/setcc-equivalent.ll Expected Passes : 17435 Expected Failures : 101 Unsupported Tests : 43 Unresolved Tests : 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::setcc-equivalent.ll': ******************** TEST 'LLVM :: CodeGen/R600/setcc-equivalent.ll' FAILED ******************** Test has no run line! ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Tue Apr 1 12:11:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 14:11:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140401191115.B86A82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24228?compare_to=24218&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24228, Order: 205313, Start Time: 2014-04-01 14:26:55, End Time: 2014-04-01 19:17:32 To: 24218, Order: 205288, Start Time: 2014-04-01 09:28:30, End Time: 2014-04-01 14:18:53 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 12 (138 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-02-04-DivRem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2008-04-20-LoopBug2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/Vector/sumarray-dbl: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/strcat: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.00% (0.1200 => 0.1320, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.00% (1.0800 => 1.1880, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.11% (0.1480 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.47% (0.7160 => 0.7480, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 10.14% (0.2760 => 0.3040, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.67% (1.2001 => 1.2441, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -1.44% (1.1121 => 1.0961, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.28% (11.3687 => 31.1819, std.dev.: 0.0739) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0095) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.23% (0.1040 => 0.1240, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: 16.13% (0.1240 => 0.1440, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.19% (0.3640 => 0.4120, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.44% (1.4401 => 1.5761, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.89% (1.4841 => 1.6161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.59% (1.8161 => 1.9721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.53% (1.5481 => 1.6801, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0106) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.66% (1.7761 => 1.9121, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.50% (1.7841 => 1.9001, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.45% (1.1160 => 1.1880, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0341) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.00% (6.4680 => 6.8560, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (11.6440 => 12.3400, std.dev.: 0.0705) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.93% (1.4161 => 1.5001, std.dev.: 0.0125) SingleSource/UnitTests/Vector/constpool: 5.87% (10.6247 => 11.2487, std.dev.: 0.1146) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.77% (1.4561 => 1.5401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (9.4842 => 10.0242, std.dev.: 0.0430) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 5.56% (1.0080 => 1.0640, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.32% (1.5801 => 1.6641, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.21% (0.7680 => 0.8080, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.18% (1.4681 => 1.5441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0166) MultiSource/Applications/hbd/hbd: 4.61% (1.7360 => 1.8160, std.dev.: 0.0181) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 4.37% (21.9606 => 22.9208, std.dev.: 0.0378) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (10.0443 => 10.4723, std.dev.: 0.0483) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (6.5080 => 6.7720, std.dev.: 0.0405) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.03% (50.0290 => 52.0450, std.dev.: 0.0774) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (6.5440 => 6.8000, std.dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0154) MultiSource/Applications/oggenc/oggenc: 3.49% (6.9844 => 7.2285, std.dev.: 0.0168) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.35% (4.1843 => 4.3243, std.dev.: 0.0149) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0429) MultiSource/Benchmarks/Bullet/bullet: 3.15% (38.4046 => 39.6126, std.dev.: 0.0652) MultiSource/Applications/SPASS/SPASS: 2.89% (18.4404 => 18.9725, std.dev.: 0.0484) MultiSource/Applications/ClamAV/clamscan: 2.67% (19.0444 => 19.5524, std.dev.: 0.0444) MultiSource/Applications/kimwitu++/kc: 2.48% (19.6891 => 20.1771, std.dev.: 0.0499) MultiSource/Benchmarks/MallocBench/gs/gs: 2.46% (5.3600 => 5.4920, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.3483 => 16.7003, std.dev.: 0.0398) MultiSource/Applications/d/make_dparser: 2.02% (3.9681 => 4.0481, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 1.91% (2.7162 => 2.7682, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (6.1044 => 6.1764, std.dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.27% (2.1401 => 2.4882, std.dev.: 0.0427) SingleSource/Benchmarks/Misc-C++/bigfib: 13.43% (0.2680 => 0.3040, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.13% (7.4205 => 7.6525, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.01% (3.9842 => 4.0643, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.22% (2.9442 => 0.7000, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.62% (1.5641 => 0.6160, std.dev.: 0.0130) MultiSource/Applications/obsequi/Obsequi: -6.64% (1.8680 => 1.7440, std.dev.: 0.0244) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.15% (91.8497 => 49.4631, std.dev.: 6.3600) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.27% (26.0616 => 17.1291, std.dev.: 0.1208) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.04% (50.3031 => 33.1821, std.dev.: 0.2058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.37% (42.1466 => 28.9258, std.dev.: 0.4008) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.78% (3.1122 => 2.3721, std.dev.: 0.0750) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 12:15:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 14:15:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140401191534.6DF312A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24229?compare_to=24219&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24229, Order: 205314, Start Time: 2014-04-01 14:32:11, End Time: 2014-04-01 19:21:49 To: 24219, Order: 205288, Start Time: 2014-04-01 09:33:55, End Time: 2014-04-01 14:23:34 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 200.00% (0.0080 => 0.0240, std.dev.: 0.0048) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 40.00% (0.0400 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.76% (0.1640 => 0.1800, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.64% (0.9081 => 0.9321, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.86% (1.7201 => 1.7521, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/nestedloop: 1.47% (1.0921 => 1.1081, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.31% (3.0482 => 3.0882, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.06% (1.8841 => 1.9041, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.58% (0.6480 => 0.7360, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.27% (3.8402 => 4.0042, std.dev.: 0.0426) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.11% (1.6721 => 1.7241, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 12:20:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 14:20:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140401192038.192D62A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24230?compare_to=24220&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24230, Order: 205314, Start Time: 2014-04-01 14:33:07, End Time: 2014-04-01 19:26:54 To: 24220, Order: 205288, Start Time: 2014-04-01 09:31:11, End Time: 2014-04-01 14:25:00 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 2 (125 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1110 (954 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.13% (0.1240 => 0.1440, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.05% (17.6723 => 19.6244, std.dev.: 0.0541) MultiSource/Applications/sqlite3/sqlite3: 1418.36% (1.7001 => 25.8136, std.dev.: 0.0397) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.71% (50.1010 => 51.9610, std.dev.: 0.0925) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (1.0520 => 1.1080, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (11.3920 => 12.3600, std.dev.: 0.0448) SingleSource/Benchmarks/Misc/oourafft: 174.43% (11.3407 => 31.1219, std.dev.: 0.0903) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0122, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0107) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 321.32% (0.4320 => 1.8201, std.dev.: 0.0054) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 26.09% (0.0920 => 0.1160, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.00% (0.1920 => 0.2400, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.14% (0.1160 => 0.1440, std.dev.: 0.0061) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.61% (1.9161 => 2.1961, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.86% (2.1361 => 2.4322, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.72% (1.8361 => 2.0881, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.30% (1.9241 => 2.1801, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.94% (2.1441 => 2.4001, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0150) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.68% (0.3720 => 0.4080, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.20% (0.3480 => 0.3800, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.82% (1.0880 => 1.1840, std.dev.: 0.0336) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.16% (0.1960 => 0.2120, std.dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: 8.00% (10.4007 => 11.2327, std.dev.: 0.1272) MultiSource/Applications/spiff/spiff: 7.87% (1.0160 => 1.0960, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0080) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (6.4800 => 6.8520, std.dev.: 0.0557) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.9960 => 1.0520, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (5.8281 => 6.0961, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (6.5320 => 6.8160, std.dev.: 0.0457) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (9.6042 => 10.0202, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.05% (0.2960 => 0.3080, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0084) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.68% (0.5440 => 0.5640, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.7480 => 1.8080, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (6.5360 => 6.7560, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0131) MultiSource/Applications/hbd/hbd: 3.24% (1.7280 => 1.7840, std.dev.: 0.0181) MultiSource/Applications/oggenc/oggenc: 2.95% (7.0524 => 7.2605, std.dev.: 0.0242) MultiSource/Applications/lua/lua: 2.84% (4.7920 => 4.9280, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 2.70% (38.6366 => 39.6806, std.dev.: 0.0676) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (5.3960 => 5.5400, std.dev.: 0.0419) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.2206 => 22.8087, std.dev.: 0.0574) MultiSource/Applications/SPASS/SPASS: 2.50% (18.5284 => 18.9925, std.dev.: 0.0377) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (16.3003 => 16.7083, std.dev.: 0.0643) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0151) MultiSource/Applications/kimwitu++/kc: 1.59% (19.8291 => 20.1451, std.dev.: 0.0266) MultiSource/Applications/JM/ldecod/ldecod: 1.56% (10.2283 => 10.3883, std.dev.: 0.0471) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.78% (2.1201 => 2.4122, std.dev.: 0.0756) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0018) MultiSource/Applications/obsequi/Obsequi: 3.13% (2.0441 => 2.1081, std.dev.: 0.0190) MultiSource/Applications/minisat/minisat: 2.24% (6.5964 => 6.7444, std.dev.: 0.0531) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (4.0003 => 4.0883, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (26.3056 => 26.6937, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (3.7442 => 3.7962, std.dev.: 0.0196) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.59% (2.9562 => 0.6920, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.23% (1.5881 => 0.5680, std.dev.: 0.0062) MultiSource/Applications/obsequi/Obsequi: -4.90% (1.8760 => 1.7840, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.87% (94.8339 => 49.4391, std.dev.: 6.3458) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.89% (49.9431 => 33.0181, std.dev.: 0.1270) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.45% (25.7136 => 17.1131, std.dev.: 0.2523) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.0702) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.44% (37.0863 => 28.7658, std.dev.: 0.6150) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -6.77% (1.3001 => 1.2121, std.dev.: 0.0241) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0323) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0088) MultiSource/Applications/lua/lua: -1.14% (21.8014 => 21.5533, std.dev.: 0.0951) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 12:27:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 14:27:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140401192748.025302A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24231?compare_to=24222&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24231, Order: 205314, Start Time: 2014-04-01 14:41:29, End Time: 2014-04-01 19:34:03 To: 24222, Order: 205288, Start Time: 2014-04-01 09:41:44, End Time: 2014-04-01 14:33:18 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (139 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: 33.33% (0.0480 => 0.0640, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.74% (0.7800 => 0.8560, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.90% (0.3480 => 0.3720, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.25% (0.1920 => 0.2040, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.42% (0.4960 => 0.5080, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.22% (1.8040 => 1.8440, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.05% (2.1480 => 2.1920, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.06% (3.7562 => 3.7962, std.dev.: 0.0114) MultiSource/Applications/SPASS/SPASS: 1.03% (18.9885 => 19.1845, std.dev.: 0.0449) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/2003-06-08-BaseType: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0038) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0072) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/member-function-pointers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0051) SingleSource/UnitTests/Threads/2010-12-08-tls: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 22.72% (1.7081 => 2.0961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.40% (1.6961 => 2.0761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 22.30% (1.6681 => 2.0401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 22.22% (1.6921 => 2.0681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 22.17% (1.7681 => 2.1601, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.17% (1.7321 => 2.1161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 22.17% (1.6961 => 2.0721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.96% (1.6761 => 2.0441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.86% (1.7201 => 2.0961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.80% (1.6881 => 2.0561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.78% (1.8001 => 2.1921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.77% (1.7641 => 2.1481, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.65% (1.7921 => 2.1801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.51% (1.8041 => 2.1921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.43% (1.6801 => 2.0401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.40% (1.8881 => 2.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.39% (1.7201 => 2.0881, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.29% (1.6721 => 2.0281, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.28% (1.7481 => 2.1201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.24% (1.8081 => 2.1921, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.21% (1.9801 => 2.4001, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.15% (1.7401 => 2.1081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.11% (1.7241 => 2.0881, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 21.01% (1.8281 => 2.2121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.88% (1.7241 => 2.0841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.88% (1.8201 => 2.2001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.84% (1.8041 => 2.1801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.80% (1.6921 => 2.0441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.70% (1.8361 => 2.2161, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.32% (1.9881 => 2.3921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.71% (1.9081 => 2.2841, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.43% (1.9761 => 2.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.39% (1.9601 => 2.3401, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 19.14% (1.9641 => 2.3401, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.99% (1.9801 => 2.3561, std.dev.: 0.0076) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.46% (3.5002 => 3.7962, std.dev.: 0.0114) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 7.32% (0.1640 => 0.1760, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.9920 => 1.0600, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.71% (1.7280 => 1.8440, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.35% (11.7880 => 12.5360, std.dev.: 0.0815) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.7200 => 7.1400, std.dev.: 0.0342) MultiSource/Benchmarks/nbench/nbench: 6.15% (1.8201 => 1.9321, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.00% (2.0680 => 2.1920, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.42% (0.8120 => 0.8560, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.10% (0.7840 => 0.8240, std.dev.: 0.0142) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.09% (9.9842 => 10.4922, std.dev.: 0.0493) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: 4.88% (10.9087 => 11.4407, std.dev.: 0.1035) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 4.75% (6.9124 => 7.2405, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0062) MultiSource/Applications/d/make_dparser: 4.54% (3.9641 => 4.1441, std.dev.: 0.0289) MultiSource/Applications/lua/lua: 4.51% (4.7920 => 5.0080, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.39% (6.8321 => 7.1321, std.dev.: 0.0303) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.27% (0.4680 => 0.4880, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 4.12% (2.6200 => 2.7280, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 3.74% (18.4924 => 19.1845, std.dev.: 0.0449) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.1440 => 1.1840, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0202) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (10.3203 => 10.6643, std.dev.: 0.0344) MultiSource/Applications/JM/lencod/lencod: 3.25% (22.6287 => 23.3648, std.dev.: 0.0452) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.99% (2.2721 => 2.3401, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.84% (4.2203 => 4.3403, std.dev.: 0.0099) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.79% (51.1089 => 52.5329, std.dev.: 0.1212) MultiSource/Applications/kimwitu++/kc: 2.78% (19.7371 => 20.2851, std.dev.: 0.0356) MultiSource/Applications/siod/siod: 2.61% (2.7562 => 2.8282, std.dev.: 0.0149) MultiSource/Benchmarks/Bullet/bullet: 2.57% (38.9366 => 39.9366, std.dev.: 0.0757) MultiSource/Applications/ClamAV/clamscan: 2.55% (20.2445 => 20.7605, std.dev.: 0.0673) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (16.5963 => 16.9363, std.dev.: 0.0518) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.99% (6.0244 => 6.1444, std.dev.: 0.0224) MultiSource/Applications/sqlite3/sqlite3: 1.84% (25.1895 => 25.6536, std.dev.: 0.0399) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (29.4578 => 29.7699, std.dev.: 0.0888) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.86% (0.9281 => 1.1681, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.31% (1.2681 => 1.3481, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.60% (4.6083 => 4.8203, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0266) MultiSource/Applications/sqlite3/sqlite3: 2.83% (4.0923 => 4.2083, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (3.4402 => 3.5322, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9604 => 6.0684, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (4.2443 => 4.3083, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.43% (6.2884 => 1.3561, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/nestedloop: -65.45% (2.9642 => 1.0241, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/nestedloop: -61.59% (3.1762 => 1.2201, std.dev.: 0.0082) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0187) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (7.4801 => 6.2520, std.dev.: 0.0474) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.51% (7.5041 => 6.3400, std.dev.: 0.0400) MultiSource/Benchmarks/mafft/pairlocalalign: -2.04% (13.5243 => 13.2483, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -14.31% (7.8005 => 6.6844, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.59% (2.6082 => 2.3841, std.dev.: 0.0829) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.39% (5.8884 => 5.5123, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: -2.36% (8.3085 => 8.1125, std.dev.: 0.0235) MultiSource/Applications/lambda-0_1_3/lambda: -2.25% (5.1603 => 5.0443, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.86% (3.4442 => 3.3802, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 12:28:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 14:28:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140401192847.5ACF92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24232?compare_to=24221&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24232, Order: 205314, Start Time: 2014-04-01 14:38:50, End Time: 2014-04-01 19:35:02 To: 24221, Order: 205288, Start Time: 2014-04-01 09:34:54, End Time: 2014-04-01 14:30:51 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 18 (168 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-18-LoopBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.74% (0.0920 => 0.1120, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.05% (0.0840 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.39% (0.0920 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.62% (0.1280 => 0.1480, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0032) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: 8.89% (0.1800 => 0.1960, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.06% (0.6600 => 0.7000, std.dev.: 0.0141) MultiSource/Applications/sgefa/sgefa: 3.15% (0.5080 => 0.5240, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.31% (1.5281 => 1.5481, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.96% (0.9681 => 1.0161, std.dev.: 0.0168) MultiSource/Applications/lemon/lemon: 4.11% (0.9721 => 1.0121, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.50% (3.5202 => 3.6082, std.dev.: 0.0290) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4001 => 1.4161, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.13% (1.4161 => 1.4321, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: -23.08% (0.0520 => 0.0400, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1937.50% (0.0320 => 0.6520, std.dev.: 0.0059) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0080) SingleSource/Regression/C/sumarray2d: 1100.00% (0.0360 => 0.4320, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 726.32% (0.0760 => 0.6280, std.dev.: 0.0103) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 396.87% (0.2520 => 1.2521, std.dev.: 0.0187) SingleSource/UnitTests/Vector/multiplies: 328.57% (0.0280 => 0.1200, std.dev.: 0.0078) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 267.28% (0.2320 => 0.8521, std.dev.: 0.0066) SingleSource/Regression/C++/EH/simple_throw: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0068) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 115.38% (0.1040 => 0.2240, std.dev.: 0.0057) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 80.00% (0.1400 => 0.2520, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.98% (0.7040 => 1.0840, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.42% (1.2401 => 1.5801, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 25.32% (1.2481 => 1.5641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.68% (1.2481 => 1.5561, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.87% (1.1561 => 1.4321, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.81% (1.1761 => 1.4561, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.66% (1.2001 => 1.4841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.91% (1.2921 => 1.5881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.81% (1.1401 => 1.4001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 22.77% (1.3001 => 1.5961, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 22.52% (1.1721 => 1.4361, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.45% (1.1761 => 1.4401, std.dev.: 0.0143) MultiSource/Applications/obsequi/Obsequi: 22.41% (1.3920 => 1.7040, std.dev.: 0.0258) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 22.22% (0.1080 => 0.1320, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.83% (1.1361 => 1.3841, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.83% (1.1361 => 1.3841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.71% (1.2161 => 1.4801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.68% (1.1441 => 1.3921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.50% (1.2281 => 1.4921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 21.40% (1.2521 => 1.5201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (1.1441 => 1.3841, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.93% (0.1720 => 0.2080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.78% (1.2321 => 1.4881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.56% (1.2841 => 1.5481, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.54% (1.1881 => 1.4321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.45% (1.2321 => 1.4841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.18% (1.2881 => 1.5481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.00% (1.2001 => 1.4401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (1.3681 => 1.6361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 19.02% (8.5802 => 10.2123, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.78% (1.3841 => 1.6441, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 16.96% (0.4480 => 0.5240, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 16.01% (19.5406 => 22.6687, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 14.79% (1.3521 => 1.5521, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.62% (5.3360 => 6.1161, std.dev.: 0.0560) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0254) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0060) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.87% (0.1840 => 0.2040, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 9.98% (11.3843 => 12.5203, std.dev.: 0.0348) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.95% (0.7640 => 0.8400, std.dev.: 0.0152) MultiSource/Applications/oggenc/oggenc: 9.93% (6.2844 => 6.9084, std.dev.: 0.0205) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.89% (5.6680 => 6.1720, std.dev.: 0.0318) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.59% (5.7280 => 6.2200, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.02% (0.6480 => 0.7000, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (11.4440 => 12.3560, std.dev.: 0.0570) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (9.5802 => 10.2442, std.dev.: 0.0331) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.69% (1.1240 => 1.1880, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0085) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0265) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.39% (0.4560 => 0.4760, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0313) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0095) SingleSource/UnitTests/Vector/constpool: 4.25% (11.0207 => 11.4887, std.dev.: 0.0767) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0163) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.80% (2.2081 => 2.2921, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0180) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.62% (49.1529 => 50.9329, std.dev.: 0.0891) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (6.8280 => 7.0720, std.dev.: 0.0381) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.4320 => 1.4800, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (5.3840 => 5.5600, std.dev.: 0.0489) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 3.10% (19.2243 => 19.8204, std.dev.: 0.0544) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (2.7282 => 2.8082, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 2.76% (24.7575 => 25.4415, std.dev.: 0.0405) MultiSource/Benchmarks/Bullet/bullet: 2.27% (39.0726 => 39.9606, std.dev.: 0.0869) MultiSource/Applications/kimwitu++/kc: 2.05% (19.7491 => 20.1531, std.dev.: 0.0404) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.0124 => 6.1244, std.dev.: 0.0170) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0131) MultiSource/Applications/SPASS/SPASS: 1.60% (18.7966 => 19.0965, std.dev.: 0.0243) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.36% (29.3298 => 29.7299, std.dev.: 0.0620) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.27% (16.7083 => 16.9203, std.dev.: 0.0492) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (3.0402 => 3.0762, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.68% (1.2401 => 1.3601, std.dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.55% (1.3521 => 1.4001, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 2.82% (6.8204 => 7.0124, std.dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 2.43% (0.9881 => 1.0121, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.3085 => 7.4845, std.dev.: 0.0517) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4001 => 1.4161, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -15.06% (7.8605 => 6.6764, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -8.52% (3.4722 => 3.1762, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0569) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/fldry: -3.33% (0.6000 => 0.5800, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.22% (4.5123 => 4.4123, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.04% (4.1243 => 4.0403, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.63% (3.4442 => 3.3882, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.0963 => 5.0323, std.dev.: 0.0207) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 12:48:48 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 12:48:48 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140401194848.D8D7C4EE6D44@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18736 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205349 Blamelist: arsenm,hfinkel,redstar,rnk,rsmith,yrnkrn Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 13:15:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 13:15:20 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase3 - tree health Message-ID: <20140401201525.D14604EE72B4@lab.llvm.org> The Buildbot has detected a restored build on builder phase3 - tree health while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase3%20-%20tree%20health/builds/2322 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205244 Blamelist: aaronballman,arsenm,compnerd,d0k,dsanders,emaste,hfinkel,majnemer,probinson,rafael,tmroeder,yrnkrn Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 1 13:29:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 15:29:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401202925.EE74F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24233?compare_to=24227&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24233, Order: 205317, Start Time: 2014-04-01 15:44:57, End Time: 2014-04-01 20:35:39 To: 24227, Order: 205313, Start Time: 2014-04-01 14:26:46, End Time: 2014-04-01 19:16:08 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (97 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/exception_spec_test: 100.00% (0.0160 => 0.0320, std.dev.: 0.0057) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Oscar: 20.00% (0.0600 => 0.0720, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) SingleSource/Benchmarks/SmallPT/smallpt: 12.12% (0.1320 => 0.1480, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.61% (0.7360 => 0.7920, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.72% (0.5080 => 0.5320, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.02% (0.6960 => 0.7240, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: 3.18% (1.2560 => 1.2960, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.93% (1.2441 => 1.2681, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.19% (1.3401 => 1.3561, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.18% (1.3601 => 1.3761, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0060) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.1481 => 1.2321, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0586) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0369) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0480) SingleSource/UnitTests/Vector/constpool: 4.63% (10.8967 => 11.4007, std.dev.: 0.1360) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0363) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0177) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0517) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0526) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0427) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0374) MultiSource/Applications/obsequi/Obsequi: 2.53% (1.2640 => 1.2960, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0375) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0727) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.17% (48.1088 => 49.1528, std.dev.: 0.1030) MultiSource/Benchmarks/Bullet/bullet: 2.08% (37.0925 => 37.8646, std.dev.: 0.0892) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0163) MultiSource/Applications/oggenc/oggenc: 1.86% (5.7964 => 5.9044, std.dev.: 0.0116) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 1.38% (18.8170 => 19.0770, std.dev.: 0.0362) MultiSource/Applications/SPASS/SPASS: 1.03% (17.5484 => 17.7284, std.dev.: 0.0446) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 4.51% (6.6564 => 6.9564, std.dev.: 0.0581) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 15:08:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 15:08:30 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140401220830.8EC5E4EE83CD@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18743 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205360 Blamelist: dblaikie BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: lib/CodeGen/AsmPrinter/DebugLocEntry.h lib/CodeGen/AsmPrinter/DwarfDebug.h On: http://10.1.1.2/svn/llvm-project For: llvm At: Tue 01 Apr 2014 15:01:45 Changed By: dblaikie Comments: DebugInfo: Split DebugLocEntry into its own file. It seems big enough that it deserves its own file - but it is header only, so there's no need for another cpp file, etc.Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 15:08:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 15:08:30 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140401220830.7840A4EE83CC@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14305 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205360 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': command test $dir/Makefile -ot /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/$dir/Makefile ); then \ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/autoconf/mkinstalldirs $dir; \ /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/$dir/Makefile $dir/Makefile; \ fi; \ (make -C $dir all ) || exit 1; \ done make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 15:08:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 15:08:30 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140401220830.8EDBD4EE83CE@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18743 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205360 Blamelist: dblaikie BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 15:08:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 15:08:30 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140401220830.76EBC4EE83CA@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14305 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205360 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': command test $dir/Makefile -ot /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/$dir/Makefile ); then \ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/autoconf/mkinstalldirs $dir; \ /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/$dir/Makefile $dir/Makefile; \ fi; \ (make -C $dir all ) || exit 1; \ done make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Tue Apr 1 15:14:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 17:14:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401221448.2AD882A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24234?compare_to=24233&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24234, Order: 205328, Start Time: 2014-04-01 17:32:13, End Time: 2014-04-01 22:21:02 To: 24233, Order: 205317, Start Time: 2014-04-01 15:44:57, End Time: 2014-04-01 20:35:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (94 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (1001 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 28.57% (0.0560 => 0.0720, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.00% (0.2400 => 0.2640, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wc: 9.68% (0.2480 => 0.2720, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.63% (0.9121 => 0.9361, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (1.2481 => 1.2761, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.37% (1.1681 => 1.1841, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0054) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2160 => 0.2320, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (10.6960 => 11.3960, std.dev.: 0.0407) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (6.0160 => 6.3600, std.dev.: 0.0416) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: 4.85% (10.8967 => 11.4247, std.dev.: 0.1076) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0178) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0336) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0478) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.95% (8.1441 => 8.3841, std.dev.: 0.0600) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0215) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0597) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 2.17% (23.7574 => 24.2735, std.dev.: 0.0564) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0189) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (5.8400 => 5.9400, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0142) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (7.8562 => 7.9842, std.dev.: 0.0332) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.60% (48.1088 => 48.8769, std.dev.: 0.0846) MultiSource/Benchmarks/Bullet/bullet: 1.48% (37.0925 => 37.6406, std.dev.: 0.0800) MultiSource/Applications/kimwitu++/kc: 1.23% (18.8170 => 19.0490, std.dev.: 0.0332) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0270) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0413) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0091) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0269) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.36% (21.1533 => 21.4413, std.dev.: 0.0597) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.03% (1.2601 => 1.1841, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 15:41:11 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 15:41:11 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140401224112.0E1AC4EE892E@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building compiler-rt. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18744 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205362 Blamelist: dblaikie,garious Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 1 15:47:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 17:47:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401224736.744E42A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24235?compare_to=24234&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24235, Order: 205331, Start Time: 2014-04-01 18:09:01, End Time: 2014-04-01 22:53:49 To: 24234, Order: 205328, Start Time: 2014-04-01 17:32:13, End Time: 2014-04-01 22:21:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (98 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0016) SingleSource/UnitTests/2006-02-04-DivRem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 45.45% (0.0440 => 0.0640, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2240 => 0.2400, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: 6.49% (0.3080 => 0.3280, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (5.7084 => 5.7804, std.dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0564) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: 4.26% (10.8967 => 11.3607, std.dev.: 0.1000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (8.1441 => 8.4561, std.dev.: 0.0384) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0184) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0292) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0094) MultiSource/Applications/lua/lua: 2.74% (4.5200 => 4.6440, std.dev.: 0.0427) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0493) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (4.9200 => 5.0280, std.dev.: 0.0396) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0446) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: 1.70% (37.0925 => 37.7246, std.dev.: 0.0352) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.65% (48.1088 => 48.9009, std.dev.: 0.0788) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0134) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 5.47% (6.6564 => 7.0204, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0144) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.59% (21.1533 => 21.4893, std.dev.: 0.0737) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0306) MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (25.8896 => 26.1616, std.dev.: 0.0216) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.18% (2.3881 => 2.3121, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 16:16:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 18:16:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140401231614.1E70A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24236?compare_to=24235&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24236, Order: 205336, Start Time: 2014-04-01 18:30:11, End Time: 2014-04-01 23:22:28 To: 24235, Order: 205331, Start Time: 2014-04-01 18:09:01, End Time: 2014-04-01 22:53:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 22 (107 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: 55.56% (0.0360 => 0.0560, std.dev.: 0.0063) MultiSource/Benchmarks/llubenchmark/llu: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/SmallPT/smallpt: 15.62% (0.1280 => 0.1480, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0960 => 0.1080, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.98% (0.3440 => 0.3680, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 5.31% (0.4520 => 0.4760, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.4400 => 0.4600, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.01% (1.3960 => 1.4520, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3000 => 0.3120, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6880 => 0.7120, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.08% (0.5200 => 0.5360, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.7640 => 1.8160, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.19% (1.2801 => 1.3081, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.62% (1.2321 => 1.2521, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 1.35% (5.0280 => 5.0960, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.07% (5.9720 => 6.0360, std.dev.: 0.0227) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.49% (2.5282 => 2.6922, std.dev.: 0.0575) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0169) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0132) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.69% (1.1441 => 1.2321, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/lists: 6.85% (0.2920 => 0.3120, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0437) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0743) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0039) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.72% (1.1880 => 1.2560, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (1.3760 => 1.4520, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash: 5.31% (0.4520 => 0.4760, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.24% (0.7640 => 0.8040, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0199) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.4400 => 0.4600, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0333) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0620) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0164) SingleSource/UnitTests/Vector/constpool: 3.74% (10.8967 => 11.3047, std.dev.: 0.1499) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0181) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0532) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0186) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0439) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.90% (5.8000 => 5.9680, std.dev.: 0.0424) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 2.34% (23.7574 => 24.3135, std.dev.: 0.0442) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1929, std.dev.: 0.1156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0392) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8486, std.dev.: 0.0679) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0310) MultiSource/Applications/kimwitu++/kc: 1.70% (18.8170 => 19.1370, std.dev.: 0.0411) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0163) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0406) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 24.89% (0.9321 => 1.1641, std.dev.: 0.0213) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout/lists: 2.96% (5.8164 => 5.9884, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.5522 => 3.5122, std.dev.: 0.0100) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 17:05:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 19:05:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402000508.1535B2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24237?compare_to=24236&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24237, Order: 205349, Start Time: 2014-04-01 19:22:23, End Time: 2014-04-02 00:11:22 To: 24236, Order: 205336, Start Time: 2014-04-01 18:30:11, End Time: 2014-04-01 23:22:28 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (96 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/FloatMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.79% (0.0760 => 0.0880, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.81% (0.1080 => 0.1240, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 3.31% (0.4840 => 0.5000, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 25.00% (0.1600 => 0.2000, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.45% (1.3641 => 1.4521, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0328) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (10.6960 => 11.3360, std.dev.: 0.0689) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0364) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: 4.52% (10.8967 => 11.3887, std.dev.: 0.1201) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0152) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0320) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0532) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0374) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0394) MultiSource/Applications/JM/lencod/lencod: 2.23% (17.6165 => 18.0085, std.dev.: 0.0777) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0152) MultiSource/Benchmarks/Bullet/bullet: 2.00% (37.0925 => 37.8326, std.dev.: 0.0550) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0506) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0210, std.dev.: 0.1203) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 1.49% (18.8170 => 19.0970, std.dev.: 0.0270) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0193) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.23% (6.6564 => 7.0044, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0069) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0322) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0251) MultiSource/Applications/lua/lua: 1.53% (21.1533 => 21.4773, std.dev.: 0.0738) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/mason/mason: -21.05% (0.0760 => 0.0600, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones/fhourstones: -11.36% (0.1760 => 0.1560, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.52% (1.2601 => 1.1401, std.dev.: 0.0335) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 17:12:02 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 17:12:02 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140402001206.2AC7B4EE97B7@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/721 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205244 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp4CYkfgexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp4CYkfgexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpT3oPHbexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpT3oPHbexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Tue Apr 1 17:08:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 19:08:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402000811.109772A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24238?compare_to=24228&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24238, Order: 205349, Start Time: 2014-04-01 19:23:51, End Time: 2014-04-02 00:14:28 To: 24228, Order: 205313, Start Time: 2014-04-01 14:26:55, End Time: 2014-04-01 19:17:32 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (144 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/IntMM: 100.00% (0.0240 => 0.0480, std.dev.: 0.0028) SingleSource/Regression/C++/short_circuit_dtor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.33% (0.1920 => 0.2080, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.60% (0.6160 => 0.6320, std.dev.: 0.0061) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.08% (1.3480 => 1.3760, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.8561 => 1.8881, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.44% (1.6641 => 1.6881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.26% (1.9001 => 1.9241, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (6.8560 => 6.9360, std.dev.: 0.0221) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.62% (0.2320 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 5.21% (0.3840 => 0.4040, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3761 => 1.3921, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -24.00% (0.1000 => 0.0760, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.95% (11.3687 => 31.2580, std.dev.: 0.0685) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0057) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0124) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0057) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/mandel-text: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 27.78% (0.0720 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0180) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.56% (0.1800 => 0.2080, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.90% (0.6200 => 0.7000, std.dev.: 0.0177) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.26% (0.4240 => 0.4760, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.26% (1.4561 => 1.6201, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.72% (1.4401 => 1.5801, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.62% (1.1640 => 1.2760, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.47% (1.8161 => 1.9881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.89% (1.4841 => 1.6161, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0109) MultiSource/Applications/spiff/spiff: 8.73% (1.0080 => 1.0960, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.66% (1.5241 => 1.6561, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (1.0240 => 1.1120, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.53% (1.5481 => 1.6801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.43% (0.3320 => 0.3600, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.36% (1.4841 => 1.6081, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.21% (1.6081 => 1.7401, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.24% (6.4680 => 6.9360, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.04% (0.2840 => 0.3040, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 6.90% (1.5080 => 1.6120, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: 6.78% (10.6247 => 11.3447, std.dev.: 0.1304) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.60% (11.6440 => 12.4120, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.38% (0.1880 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.23% (1.5401 => 1.6361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (5.8121 => 6.1281, std.dev.: 0.0168) MultiSource/Applications/SIBsim4/SIBsim4: 5.36% (1.7921 => 1.8881, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.31% (9.4842 => 9.9882, std.dev.: 0.0429) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.16% (0.6200 => 0.6520, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 5.10% (10.0443 => 10.5563, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0054) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.88% (1.3120 => 1.3760, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.64% (2.3281 => 2.4362, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0198) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.52% (6.5440 => 6.8400, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 4.19% (21.9606 => 22.8808, std.dev.: 0.0524) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/gs/gs: 4.10% (5.3600 => 5.5800, std.dev.: 0.0463) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.07% (50.0290 => 52.0650, std.dev.: 0.1281) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0261) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (6.5080 => 6.7480, std.dev.: 0.0601) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0404) MultiSource/Benchmarks/Bullet/bullet: 3.33% (38.4046 => 39.6846, std.dev.: 0.0675) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (2.0440 => 2.1120, std.dev.: 0.0170) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0228) MultiSource/Applications/SPASS/SPASS: 3.21% (18.4404 => 19.0325, std.dev.: 0.0564) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0207) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 2.95% (19.6891 => 20.2691, std.dev.: 0.0354) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (16.3483 => 16.7643, std.dev.: 0.0315) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5284, std.dev.: 0.0540) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (6.1044 => 6.1764, std.dev.: 0.0217) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0352) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.00% (0.1200 => 0.1440, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.57% (2.1401 => 2.5162, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.78% (0.3600 => 0.3880, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: 2.53% (2.0521 => 2.1041, std.dev.: 0.0171) MultiSource/Applications/sqlite3/sqlite3: 2.41% (3.9842 => 4.0803, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.8481 => 0.8641, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: -6.00% (1.8680 => 1.7560, std.dev.: 0.0166) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -45.87% (91.8497 => 49.7191, std.dev.: 6.2001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.93% (26.0616 => 16.9571, std.dev.: 0.2305) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.81% (50.3031 => 32.7940, std.dev.: 0.2844) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.15% (42.1466 => 28.5978, std.dev.: 0.3194) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.68% (3.1122 => 2.3441, std.dev.: 0.0744) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0184) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 17:11:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 19:11:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402001117.5050F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24239?compare_to=24229&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24239, Order: 205349, Start Time: 2014-04-01 19:28:08, End Time: 2014-04-02 00:17:31 To: 24229, Order: 205314, Start Time: 2014-04-01 14:32:11, End Time: 2014-04-01 19:21:49 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (0 on baseline) Performance Improvements: 29 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1074 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-20-FoldBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-26-Shorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/Vector/sumarray-dbl: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.33% (0.1200 => 0.1360, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.76% (0.4640 => 0.5000, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash: 3.39% (0.4720 => 0.4880, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 23.61% (7.3885 => 9.1326, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.34% (0.2320 => 0.2560, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.16% (2.0761 => 2.1001, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/multiplies: -13.33% (0.1800 => 0.1560, std.dev.: 0.0038) SingleSource/Regression/C/sumarray2d: -8.64% (0.6480 => 0.5920, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.97% (1.7521 => 1.7001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.55% (1.7241 => 1.6801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.55% (2.0401 => 1.9881, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.05% (1.7521 => 1.7161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (1.8401 => 1.8041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.93% (2.0761 => 2.0361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.91% (1.8801 => 1.8441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.82% (1.9801 => 1.9441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.81% (1.9881 => 1.9521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.79% (1.7841 => 1.7521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.76% (1.8201 => 1.7881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.71% (1.8761 => 1.8441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.68% (1.9041 => 1.8721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.60% (1.7521 => 1.7241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.59% (1.7601 => 1.7321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.54% (1.8161 => 1.7881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.49% (2.1481 => 2.1161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.47% (1.9001 => 1.8721, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: -1.45% (7.1924 => 7.0884, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.34% (1.7881 => 1.7641, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.22% (16.9923 => 16.7843, std.dev.: 0.0670) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.20% (2.3321 => 2.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.16% (2.0681 => 2.0441, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.87% (3.3842 => 3.0162, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.9526 => 8.7405, std.dev.: 0.0111) MultiSource/Benchmarks/sim/sim: -1.37% (4.9723 => 4.9043, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -26.37% (0.7280 => 0.5360, std.dev.: 0.0146) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 17:21:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 19:21:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140402002102.46FE72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24240?compare_to=24230&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24240, Order: 205349, Start Time: 2014-04-01 19:33:21, End Time: 2014-04-02 00:27:17 To: 24230, Order: 205314, Start Time: 2014-04-01 14:33:07, End Time: 2014-04-01 19:26:54 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 8 (135 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 66.67% (0.0240 => 0.0400, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.47% (0.2360 => 0.2560, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 2.17% (1.8401 => 1.8801, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/SmallPT/smallpt: -10.26% (0.1560 => 0.1400, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.13% (2.1241 => 2.1001, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.02% (17.6723 => 19.6204, std.dev.: 0.0375) MultiSource/Applications/sqlite3/sqlite3: 1411.30% (1.7001 => 25.6936, std.dev.: 0.0380) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.51% (50.1010 => 51.8610, std.dev.: 0.0682) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.78% (11.3920 => 12.3920, std.dev.: 0.0553) SingleSource/Benchmarks/Misc/oourafft: 174.96% (11.3407 => 31.1819, std.dev.: 0.0895) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9922, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0073) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0108) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0105) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.88% (1.8281 => 2.1001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.16% (1.8361 => 2.0961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.78% (1.9161 => 2.1801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.53% (1.8921 => 2.1481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.33% (1.8601 => 2.1081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.30% (2.1361 => 2.4202, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.06% (1.9601 => 2.2161, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.98% (1.9721 => 2.2281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.31% (2.1441 => 2.4081, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (1.9761 => 2.2041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.50% (1.8081 => 2.0161, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: 10.87% (0.1840 => 0.2040, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.83% (1.7721 => 1.9641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/EH/except: 10.34% (0.2320 => 0.2560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.27% (2.1041 => 2.3201, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.11% (1.8201 => 2.0041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.80% (1.7961 => 1.9721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.59% (1.8361 => 2.0121, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.35% (1.7961 => 1.9641, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.81% (0.6360 => 0.6920, std.dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: 8.38% (10.4007 => 11.2727, std.dev.: 0.1051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.2120 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0216) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (6.4800 => 6.8680, std.dev.: 0.0298) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 5.12% (1.0160 => 1.0680, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0294) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.81% (1.6641 => 1.7441, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.81% (1.7480 => 1.8320, std.dev.: 0.0161) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (9.6042 => 10.0482, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 4.19% (1.5280 => 1.5920, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (5.8281 => 6.0561, std.dev.: 0.0369) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (6.5320 => 6.7840, std.dev.: 0.0315) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3960 => 5.5760, std.dev.: 0.0351) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.25% (0.6160 => 0.6360, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 2.90% (0.8280 => 0.8520, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (6.5360 => 6.7240, std.dev.: 0.0489) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0161) MultiSource/Applications/lua/lua: 2.50% (4.7920 => 4.9120, std.dev.: 0.0417) MultiSource/Applications/oggenc/oggenc: 2.44% (7.0524 => 7.2245, std.dev.: 0.0229) MultiSource/Applications/JM/lencod/lencod: 2.43% (22.2206 => 22.7607, std.dev.: 0.0780) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (2.3401 => 2.3961, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (16.3003 => 16.6683, std.dev.: 0.0573) MultiSource/Benchmarks/Bullet/bullet: 2.22% (38.6366 => 39.4926, std.dev.: 0.0845) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0142) MultiSource/Applications/SPASS/SPASS: 2.05% (18.5284 => 18.9085, std.dev.: 0.0449) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0158) MultiSource/Applications/kimwitu++/kc: 1.29% (19.8291 => 20.0851, std.dev.: 0.0794) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (10.2283 => 10.3603, std.dev.: 0.0437) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/moments: 18.18% (0.0880 => 0.1040, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.34% (2.1201 => 2.4242, std.dev.: 0.0547) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0041 => 1.0281, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 2.18% (6.5964 => 6.7404, std.dev.: 0.0360) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 1.52% (26.3056 => 26.7057, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.32% (2.9562 => 0.7000, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0035) MultiSource/Applications/obsequi/Obsequi: -4.69% (1.8760 => 1.7880, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.68% (94.8339 => 49.6151, std.dev.: 6.3107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.67% (49.9431 => 33.1261, std.dev.: 0.1748) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.56% (25.7136 => 17.0851, std.dev.: 0.1744) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.0715) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.77% (37.0863 => 28.6418, std.dev.: 0.7386) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.42% (1.2681 => 1.2121, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -1.12% (21.8014 => 21.5573, std.dev.: 0.0546) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 17:25:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 19:25:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140402002559.BFC4D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24241?compare_to=24231&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24241, Order: 205351, Start Time: 2014-04-01 19:40:05, End Time: 2014-04-02 00:32:14 To: 24231, Order: 205314, Start Time: 2014-04-01 14:41:29, End Time: 2014-04-01 19:34:03 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (130 on baseline) Performance Improvements: 26 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1071 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.57% (0.0840 => 0.1080, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/em3d/em3d: 11.11% (0.2160 => 0.2400, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.62% (0.3560 => 0.3760, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.5000 => 0.5280, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 2.95% (1.2201 => 1.2561, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 24.27% (7.3525 => 9.1366, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/strcat: 12.12% (0.1320 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 8.60% (0.3720 => 0.4040, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.16% (3.9442 => 4.1083, std.dev.: 0.0634) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.16% (2.0721 => 2.0961, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -30.00% (0.0800 => 0.0560, std.dev.: 0.0080) SingleSource/UnitTests/Vector/multiplies: -15.91% (0.1760 => 0.1480, std.dev.: 0.0048) SingleSource/Regression/C/sumarray2d: -8.89% (0.7200 => 0.6560, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: -6.67% (0.3000 => 0.2800, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -4.92% (0.2440 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.29% (2.0961 => 2.0481, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.22% (2.3401 => 2.2881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.19% (2.1921 => 2.1441, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.17% (2.4001 => 2.3481, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.13% (2.0681 => 2.0241, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.92% (2.2921 => 2.2481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.85% (2.1601 => 2.1201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.81% (2.2121 => 2.1721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.70% (2.1201 => 2.0841, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.64% (2.2001 => 2.1641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.47% (2.1801 => 2.1481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.46% (2.1921 => 2.1601, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.46% (7.1321 => 7.0281, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.34% (2.0961 => 2.0681, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: -1.33% (7.2405 => 7.1444, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.28% (2.1801 => 2.1521, std.dev.: 0.0108) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (13.2483 => 13.0963, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.12% (2.1481 => 2.1241, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.89% (3.3802 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -1.14% (4.2083 => 4.1603, std.dev.: 0.0162) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0037) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0115) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.99% (1.6961 => 2.0521, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.14% (1.6881 => 2.0281, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.91% (1.7681 => 2.1201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.91% (1.7081 => 2.0481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.86% (1.6721 => 2.0041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.62% (1.6921 => 2.0241, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.31% (1.7401 => 2.0761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.07% (1.8881 => 2.2481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.85% (1.8041 => 2.1441, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.58% (1.9801 => 2.3481, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/ffbench: 17.24% (0.1160 => 0.1360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.11% (0.1480 => 0.1600, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (3.5002 => 3.7562, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.45% (0.2480 => 0.2640, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.62% (0.3560 => 0.3760, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.5000 => 0.5280, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.12% (11.7880 => 12.3920, std.dev.: 0.0822) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.84% (0.9920 => 1.0400, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.82% (6.7200 => 7.0440, std.dev.: 0.0571) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (9.9842 => 10.4562, std.dev.: 0.0391) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: 4.58% (10.9087 => 11.4087, std.dev.: 0.1094) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.1440 => 1.1920, std.dev.: 0.0113) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0262) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (1.6481 => 1.7161, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.92% (0.4080 => 0.4240, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.6801 => 1.7441, std.dev.: 0.0156) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.56% (1.3480 => 1.3960, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/sieve: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 3.43% (3.9641 => 4.1001, std.dev.: 0.0261) MultiSource/Applications/oggenc/oggenc: 3.36% (6.9124 => 7.1444, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (6.8321 => 7.0281, std.dev.: 0.0328) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (10.3203 => 10.6043, std.dev.: 0.0353) MultiSource/Applications/SPASS/SPASS: 2.75% (18.4924 => 19.0006, std.dev.: 0.0575) MultiSource/Applications/JM/lencod/lencod: 2.72% (22.6287 => 23.2447, std.dev.: 0.0700) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.21% (51.1089 => 52.2409, std.dev.: 0.0929) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (4.2203 => 4.3083, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 1.97% (19.7371 => 20.1251, std.dev.: 0.0323) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (3.0122 => 3.0682, std.dev.: 0.0108) MultiSource/Benchmarks/Bullet/bullet: 1.82% (38.9366 => 39.6446, std.dev.: 0.0896) MultiSource/Applications/ClamAV/clamscan: 1.62% (20.2445 => 20.5725, std.dev.: 0.0788) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (16.5963 => 16.8563, std.dev.: 0.0452) MultiSource/Applications/sqlite3/sqlite3: 1.25% (25.1895 => 25.5055, std.dev.: 0.0385) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/strcat: 8.82% (0.1360 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2681 => 1.3601, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.51% (4.6083 => 4.8163, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 3.23% (6.8204 => 7.0404, std.dev.: 0.0262) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 1.66% (4.0923 => 4.1603, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.82% (6.2884 => 1.3321, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0049) MultiSource/Applications/obsequi/Obsequi: -32.93% (2.6481 => 1.7760, std.dev.: 0.0187) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.95% (7.4801 => 6.2120, std.dev.: 0.0533) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.69% (7.5041 => 6.2520, std.dev.: 0.0456) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0048) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: -3.16% (13.5243 => 13.0963, std.dev.: 0.0405) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0063) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -14.31% (7.8005 => 6.6844, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (5.1603 => 5.0403, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0146) MultiSource/Benchmarks/mafft/pairlocalalign: -1.05% (25.7976 => 25.5256, std.dev.: 0.0269) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (2.3401 => 2.3161, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 17:30:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 19:30:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140402003015.D397E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24242?compare_to=24232&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24242, Order: 205351, Start Time: 2014-04-01 19:41:17, End Time: 2014-04-02 00:36:23 To: 24232, Order: 205314, Start Time: 2014-04-01 14:38:50, End Time: 2014-04-01 19:35:02 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (152 on baseline) Performance Improvements: 18 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1085 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 4.05% (0.2960 => 0.3080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 3.90% (0.3080 => 0.3200, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.76% (0.8521 => 0.8841, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/nestedloop: 3.68% (0.6520 => 0.6760, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 62.50% (0.0320 => 0.0520, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: 5.21% (0.3840 => 0.4040, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.16% (2.0721 => 2.0961, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/multiplies: -13.33% (0.1200 => 0.1040, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: -7.41% (0.4320 => 0.4000, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.58% (1.5481 => 1.5081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.51% (1.4321 => 1.3961, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.33% (1.5481 => 1.5121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.95% (1.4361 => 1.4081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.76% (1.5881 => 1.5601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.62% (1.4841 => 1.4601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.61% (1.4881 => 1.4641, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.57% (2.2921 => 2.2561, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.50% (6.1244 => 6.0324, std.dev.: 0.0322) MultiSource/Applications/oggenc/oggenc: -1.22% (6.9084 => 6.8244, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.11% (16.9203 => 16.7323, std.dev.: 0.0436) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.22% (3.3882 => 3.0082, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.43% (1.4001 => 1.3521, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/bisort/bisort: -2.13% (0.7520 => 0.7360, std.dev.: 0.0061) MultiSource/Benchmarks/sim/sim: -1.21% (4.9723 => 4.9123, std.dev.: 0.0190) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2012.50% (0.0320 => 0.6760, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/Puzzle: 1206.53% (0.1240 => 1.6201, std.dev.: 0.0099) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 388.93% (0.2520 => 1.2321, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/nestedloop: 281.08% (0.2320 => 0.8841, std.dev.: 0.0068) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0062) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0057) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0063) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0048) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 55.00% (0.0800 => 0.1240, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0134) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0110) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 22.41% (1.3920 => 1.7040, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/puzzle: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.79% (1.1721 => 1.4041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.73% (1.1761 => 1.4081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 18.60% (8.5802 => 10.1763, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.53% (1.1441 => 1.3561, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.89% (1.2521 => 1.4761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.39% (1.2881 => 1.5121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 15.31% (19.5406 => 22.5327, std.dev.: 0.0432) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (5.3360 => 6.0961, std.dev.: 0.0362) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.7400 => 1.9560, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.01% (0.4440 => 0.4840, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 8.99% (11.3843 => 12.4083, std.dev.: 0.0378) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.68% (5.6680 => 6.1600, std.dev.: 0.0325) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 8.59% (6.2844 => 6.8244, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.31% (5.7280 => 6.2040, std.dev.: 0.0327) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (11.4440 => 12.2400, std.dev.: 0.0753) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (9.5802 => 10.2282, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.7360 => 0.7840, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6120 => 0.6480, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3040 => 0.3200, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (0.4960 => 0.5200, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (1.6240 => 1.6920, std.dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.1480 => 1.1960, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 4.16% (5.3840 => 5.6080, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: 3.96% (11.0207 => 11.4567, std.dev.: 0.0669) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.88% (1.3400 => 1.3920, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0215) MultiSource/Applications/lua/lua: 3.27% (4.7720 => 4.9280, std.dev.: 0.0354) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.18% (49.1529 => 50.7169, std.dev.: 0.0881) MultiSource/Applications/ClamAV/clamscan: 2.75% (19.2243 => 19.7524, std.dev.: 0.0404) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (6.8280 => 7.0080, std.dev.: 0.0398) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 2.21% (24.7575 => 25.3055, std.dev.: 0.0568) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0134) MultiSource/Applications/siod/siod: 1.45% (2.7562 => 2.7962, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 1.44% (39.0726 => 39.6366, std.dev.: 0.0688) MultiSource/Applications/kimwitu++/kc: 1.44% (19.7491 => 20.0331, std.dev.: 0.0615) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.68% (1.2401 => 1.3601, std.dev.: 0.0198) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0187) MultiSource/Benchmarks/llubenchmark/llu: 6.64% (5.1203 => 5.4603, std.dev.: 0.1183) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.24% (0.9881 => 1.0201, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.56% (4.0563 => 4.1603, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.63% (0.7360 => 0.7480, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0141) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0080) MultiSource/Applications/aha/aha: 1.11% (2.8802 => 2.9122, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -15.01% (7.8605 => 6.6804, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.66% (3.4442 => 3.0082, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: -8.99% (3.4722 => 3.1602, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0601) MultiSource/Applications/siod/siod: -6.17% (2.9842 => 2.8002, std.dev.: 0.0273) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.13% (4.5123 => 4.4163, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0208) MultiSource/Benchmarks/sim/sim: -1.68% (4.9963 => 4.9123, std.dev.: 0.0190) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0226) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (2.3401 => 2.3161, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 7.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 18:24:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 20:24:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402012422.201122A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24243?compare_to=24237&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24243, Order: 205353, Start Time: 2014-04-01 20:41:39, End Time: 2014-04-02 01:30:36 To: 24237, Order: 205349, Start Time: 2014-04-01 19:22:23, End Time: 2014-04-02 00:11:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (100 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR640: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 46.15% (0.0520 => 0.0760, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 37.50% (0.0640 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.74% (0.0920 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 3.59% (1.0040 => 1.0400, std.dev.: 0.0126) MultiSource/Benchmarks/nbench/nbench: 2.27% (1.2320 => 1.2600, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.00% (0.0480 => 0.0360, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.67% (0.0600 => 0.0760, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0420) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.6840 => 0.7160, std.dev.: 0.0109) SingleSource/UnitTests/Vector/constpool: 4.48% (10.8967 => 11.3847, std.dev.: 0.1045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0421) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0133) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (1.5200 => 1.5720, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0456) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0374) MultiSource/Applications/Burg/burg: 2.74% (1.4600 => 1.5000, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (5.8400 => 5.9640, std.dev.: 0.0445) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8726, std.dev.: 0.0882) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.93% (48.1088 => 49.0368, std.dev.: 0.1029) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0597) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (7.8562 => 7.9842, std.dev.: 0.0436) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0486) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0097) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 5.29% (6.6564 => 7.0084, std.dev.: 0.0383) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0112) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0285) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.00% (25.8896 => 26.1496, std.dev.: 0.0271) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3361 => 2.3081, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 20:12:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 22:12:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402031221.67EFE2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24244?compare_to=24243&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24244, Order: 205365, Start Time: 2014-04-01 22:29:47, End Time: 2014-04-02 03:18:35 To: 24243, Order: 205353, Start Time: 2014-04-01 20:41:39, End Time: 2014-04-02 01:30:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (93 on baseline) Performance Improvements: 2 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 15.38% (0.1560 => 0.1800, std.dev.: 0.0079) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.82% (0.1360 => 0.1480, std.dev.: 0.0044) MultiSource/Applications/obsequi/Obsequi: 3.53% (1.2480 => 1.2920, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3560 => 0.3680, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.08% (1.7320 => 1.7680, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/family/family: -25.00% (0.0480 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.42% (1.0240 => 0.9480, std.dev.: 0.0287) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1480 => 0.1680, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.82% (1.2281 => 1.3241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.53% (1.1681 => 1.2561, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.13% (10.6960 => 11.3520, std.dev.: 0.0590) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (6.0160 => 6.3680, std.dev.: 0.0321) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: 4.26% (10.8967 => 11.3607, std.dev.: 0.1224) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.88% (8.1441 => 8.4601, std.dev.: 0.0464) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0257) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0364) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 2.73% (10.4082 => 10.6922, std.dev.: 0.0507) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 2.18% (17.6165 => 18.0005, std.dev.: 0.0457) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: 1.59% (37.0925 => 37.6806, std.dev.: 0.0532) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.53% (48.1088 => 48.8449, std.dev.: 0.0983) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 1.38% (23.7574 => 24.0855, std.dev.: 0.0546) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.31% (0.9161 => 0.9281, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 1.11% (18.8170 => 19.0250, std.dev.: 0.0612) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 5.17% (6.6564 => 7.0004, std.dev.: 0.0295) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.47% (21.1533 => 21.4653, std.dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (25.8896 => 26.1536, std.dev.: 0.0168) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.18% (2.3881 => 2.3121, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 20:42:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 22:42:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402034206.83ACB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24245?compare_to=24244&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24245, Order: 205368, Start Time: 2014-04-01 23:02:37, End Time: 2014-04-02 03:48:20 To: 24244, Order: 205365, Start Time: 2014-04-01 22:29:47, End Time: 2014-04-02 03:18:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (100 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: 7.69% (0.2080 => 0.2240, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.11% (1.0960 => 1.1520, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.58% (0.6200 => 0.6360, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.31% (1.5560 => 1.5920, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.89% (1.2721 => 1.2961, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 4.41% (0.2720 => 0.2840, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.66% (1.1481 => 1.2361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.27% (1.1561 => 1.2401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.64% (1.1441 => 1.2201, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (10.6960 => 11.3960, std.dev.: 0.0455) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.35% (1.1961 => 1.2721, std.dev.: 0.0177) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.3160 => 0.3360, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 5.21% (10.8967 => 11.4647, std.dev.: 0.0690) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.92% (6.0160 => 6.3120, std.dev.: 0.0491) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0163) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (8.1441 => 8.4401, std.dev.: 0.0634) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3480 => 0.3600, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0399) MultiSource/Applications/lua/lua: 2.92% (4.5200 => 4.6520, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 2.47% (17.6165 => 18.0525, std.dev.: 0.0529) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (4.9200 => 5.0400, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (5.8400 => 5.9600, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (4.9000 => 4.9920, std.dev.: 0.0173) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.85% (48.1088 => 48.9969, std.dev.: 0.0961) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (7.8562 => 7.9802, std.dev.: 0.0471) MultiSource/Benchmarks/Bullet/bullet: 1.50% (37.0925 => 37.6485, std.dev.: 0.0832) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 1.45% (23.7574 => 24.1015, std.dev.: 0.0520) MultiSource/Applications/kimwitu++/kc: 1.25% (18.8170 => 19.0530, std.dev.: 0.0492) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 24.46% (0.9321 => 1.1601, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 5.53% (6.6564 => 7.0244, std.dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0102) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0257) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (0.6000 => 0.6160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.38% (21.1533 => 21.4453, std.dev.: 0.0515) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (25.8896 => 26.1536, std.dev.: 0.0232) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 21:16:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Apr 2014 23:16:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402041606.6B7D92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24246?compare_to=24245&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24246, Order: 205370, Start Time: 2014-04-01 23:30:26, End Time: 2014-04-02 04:21:49 To: 24245, Order: 205368, Start Time: 2014-04-01 23:02:37, End Time: 2014-04-02 03:48:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 19 (98 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/ackermann: 200.00% (0.0080 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/UnitTests/2003-08-11-VaListArg: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 18.75% (0.0640 => 0.0760, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 10.26% (0.1560 => 0.1720, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 8.33% (0.1920 => 0.2080, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.2480 => 0.2680, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (0.2160 => 0.2280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 5.43% (0.3680 => 0.3880, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (0.4440 => 0.4600, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.49% (0.6880 => 0.7120, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (1.2401 => 1.2641, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.56% (1.2801 => 1.3001, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 33.33% (0.0600 => 0.0800, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 8.04% (0.4480 => 0.4840, std.dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -14.81% (0.1080 => 0.0920, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 16.22% (0.1480 => 0.1720, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.12% (1.2361 => 1.3241, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.10% (1.2401 => 1.3281, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0484) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.85% (1.3681 => 1.4481, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 4.77% (10.8967 => 11.4167, std.dev.: 0.1232) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.4400 => 0.4600, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0329) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0287) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0455) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (10.4082 => 10.7042, std.dev.: 0.0447) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0480) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0501) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (5.8400 => 5.9600, std.dev.: 0.0363) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.75% (48.1088 => 48.9489, std.dev.: 0.1017) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0306) MultiSource/Applications/sqlite3/sqlite3: 1.53% (23.7574 => 24.1215, std.dev.: 0.0454) MultiSource/Benchmarks/Bullet/bullet: 1.16% (37.0925 => 37.5245, std.dev.: 0.1122) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 33.33% (0.0600 => 0.0800, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.95% (0.7280 => 0.7640, std.dev.: 0.0122) MultiSource/Applications/minisat/minisat: 4.69% (6.6564 => 6.9684, std.dev.: 0.0367) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.58% (0.9601 => 1.0041, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0055) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0089) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0022) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0482) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (25.8896 => 26.1736, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -2.31% (1.3841 => 1.3521, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 9.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 22:01:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 00:01:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402050138.4201E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24247?compare_to=24246&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24247, Order: 205374, Start Time: 2014-04-02 00:18:42, End Time: 2014-04-02 05:07:51 To: 24246, Order: 205370, Start Time: 2014-04-01 23:30:26, End Time: 2014-04-02 04:21:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (95 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.84% (0.0760 => 0.1040, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 5.81% (0.6880 => 0.7280, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.71% (0.2800 => 0.2960, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.78% (1.3521 => 1.3761, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.23% (1.2961 => 1.3121, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.19% (1.3401 => 1.3561, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -4.35% (0.4600 => 0.4400, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1480 => 0.1680, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (10.6960 => 11.3240, std.dev.: 0.0625) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: 5.47% (10.8967 => 11.4927, std.dev.: 0.1446) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.71% (0.7640 => 0.8000, std.dev.: 0.0133) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (8.1441 => 8.4321, std.dev.: 0.0669) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0328) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0301) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.9640 => 2.0160, std.dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: 2.63% (17.6165 => 18.0805, std.dev.: 0.0537) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0386) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.99% (48.1088 => 49.0650, std.dev.: 0.0651) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0282) MultiSource/Benchmarks/Bullet/bullet: 1.77% (37.0925 => 37.7485, std.dev.: 0.0731) MultiSource/Applications/sqlite3/sqlite3: 1.68% (23.7574 => 24.1575, std.dev.: 0.0464) MultiSource/Applications/kimwitu++/kc: 1.55% (18.8170 => 19.1090, std.dev.: 0.0567) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0334) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0256) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0134) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0240) MultiSource/Applications/lua/lua: 1.57% (21.1533 => 21.4853, std.dev.: 0.1082) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -10.78% (0.4080 => 0.3640, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 22:06:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 00:06:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402050615.96E9A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24248?compare_to=24238&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24248, Order: 205374, Start Time: 2014-04-02 00:21:43, End Time: 2014-04-02 05:12:30 To: 24238, Order: 205349, Start Time: 2014-04-01 19:23:51, End Time: 2014-04-02 00:14:28 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (131 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (957 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/printargs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/Vector/divides: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C/globalrefs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.14% (0.3360 => 0.3600, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (1.0001 => 1.0241, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.24% (1.6081 => 1.6281, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.20% (1.6681 => 1.6881, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.74% (11.3687 => 31.2340, std.dev.: 0.0475) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0085) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0070) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0032) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 47.06% (0.0680 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0180) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 12.73% (0.6600 => 0.7440, std.dev.: 0.0132) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.83% (1.4241 => 1.5641, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.07% (1.4561 => 1.5881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.03% (1.8161 => 1.9801, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.78% (1.5481 => 1.6841, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.77% (0.4560 => 0.4960, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (1.0240 => 1.1120, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.36% (1.4841 => 1.6081, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.88% (1.7761 => 1.9161, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.59% (1.5281 => 1.6441, std.dev.: 0.0116) SingleSource/UnitTests/Vector/constpool: 7.57% (10.6247 => 11.4287, std.dev.: 0.1386) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.34% (1.5801 => 1.6961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.4680 => 6.8840, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.23% (1.5401 => 1.6361, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.19% (1.1640 => 1.2360, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.13% (1.4361 => 1.5241, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.04% (1.4561 => 1.5441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0113) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.36% (11.6440 => 12.2680, std.dev.: 0.0711) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (9.4842 => 9.9842, std.dev.: 0.0345) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (5.8121 => 6.1121, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.95% (0.8881 => 0.9321, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0167) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.65% (6.5440 => 6.8480, std.dev.: 0.0311) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0191) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.0443 => 10.4923, std.dev.: 0.0384) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: 3.95% (21.9606 => 22.8288, std.dev.: 0.0478) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (2.0440 => 2.1240, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0072) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.71% (50.0290 => 51.8850, std.dev.: 0.0896) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0089) MultiSource/Applications/lua/lua: 3.43% (4.7880 => 4.9520, std.dev.: 0.0279) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (6.5080 => 6.7240, std.dev.: 0.0450) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (5.3600 => 5.5320, std.dev.: 0.0431) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 3.04% (6.9844 => 7.1964, std.dev.: 0.0247) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0180) MultiSource/Benchmarks/Bullet/bullet: 2.87% (38.4046 => 39.5086, std.dev.: 0.0601) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0149) MultiSource/Applications/ClamAV/clamscan: 2.29% (19.0444 => 19.4804, std.dev.: 0.0564) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (16.3483 => 16.7203, std.dev.: 0.0430) MultiSource/Applications/SPASS/SPASS: 2.21% (18.4404 => 18.8486, std.dev.: 0.0700) MultiSource/Applications/siod/siod: 2.06% (2.7162 => 2.7722, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 2.01% (19.6891 => 20.0851, std.dev.: 0.0404) MultiSource/Applications/d/make_dparser: 1.61% (3.9681 => 4.0321, std.dev.: 0.0224) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.52% (2.1401 => 2.4722, std.dev.: 0.0318) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0295) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0287) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0330) MultiSource/Applications/sqlite3/sqlite3: 2.41% (3.9842 => 4.0803, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (3.9562 => 4.0003, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.22% (2.9442 => 0.7000, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.36% (1.5641 => 0.6200, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: -4.71% (1.8680 => 1.7800, std.dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.47% (91.8497 => 49.1671, std.dev.: 6.4524) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.55% (26.0616 => 17.0571, std.dev.: 0.1754) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.09% (50.3031 => 33.1541, std.dev.: 0.1854) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.48% (42.1466 => 28.8778, std.dev.: 0.4079) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.0688) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 22:07:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 00:07:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402050756.6B7862A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24249?compare_to=24239&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24249, Order: 205374, Start Time: 2014-04-02 00:24:49, End Time: 2014-04-02 05:14:11 To: 24239, Order: 205349, Start Time: 2014-04-01 19:28:08, End Time: 2014-04-02 00:17:31 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/treeadd/treeadd: 50.00% (0.0400 => 0.0600, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/div: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Regression/C++/EH/class_hierarchy: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Regression/C/test_indvars: 12.00% (0.1000 => 0.1120, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 9.68% (0.1240 => 0.1360, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 3.90% (0.3080 => 0.3200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.30% (1.8521 => 1.8761, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 35.71% (0.0560 => 0.0760, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.17% (0.3240 => 0.3440, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0129) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 4.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 22:21:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 00:21:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140402052128.DB5302A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24250?compare_to=24240&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24250, Order: 205378, Start Time: 2014-04-02 00:34:51, End Time: 2014-04-02 05:27:43 To: 24240, Order: 205349, Start Time: 2014-04-01 19:33:21, End Time: 2014-04-02 00:27:17 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (129 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 10.71% (0.1120 => 0.1240, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 8.33% (0.2880 => 0.3120, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.2520 => 0.2680, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.91% (0.7160 => 0.7440, std.dev.: 0.0081) SingleSource/Benchmarks/Linpack/linpack-pc: 3.66% (0.3280 => 0.3400, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.96% (0.5400 => 0.5560, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.83% (0.6560 => 0.6680, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.33% (2.1081 => 2.1361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.16% (2.4202 => 2.4482, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.82% (17.6723 => 19.5843, std.dev.: 0.0571) MultiSource/Applications/sqlite3/sqlite3: 1412.71% (1.7001 => 25.7176, std.dev.: 0.0433) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.58% (50.1010 => 51.8930, std.dev.: 0.0867) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.25% (11.3920 => 12.3320, std.dev.: 0.0553) SingleSource/Benchmarks/Misc/oourafft: 175.06% (11.3407 => 31.1939, std.dev.: 0.0568) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9882, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0137) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 400.00% (0.0040 => 0.0200, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 321.32% (0.4320 => 1.8201, std.dev.: 0.0062) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.67% (0.1440 => 0.1680, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.44% (1.8561 => 2.1241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.20% (1.9721 => 2.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.16% (1.8361 => 2.0961, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0140) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0100) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.93% (1.9761 => 2.1921, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.02% (1.8361 => 2.0201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.79% (1.9201 => 2.1081, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: 8.81% (10.4007 => 11.3167, std.dev.: 0.1269) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.81% (0.6360 => 0.6920, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.7400 => 0.7920, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0086) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.9960 => 1.0560, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.86% (6.4800 => 6.8600, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.6960 => 1.7840, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0081) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (5.8281 => 6.0401, std.dev.: 0.0457) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (9.6042 => 9.9442, std.dev.: 0.0503) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0175) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0309) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (5.3960 => 5.5640, std.dev.: 0.0428) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.82% (6.5320 => 6.7160, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (6.5360 => 6.6960, std.dev.: 0.0442) MultiSource/Applications/oggenc/oggenc: 2.44% (7.0524 => 7.2245, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: 2.38% (38.6366 => 39.5566, std.dev.: 0.0530) MultiSource/Applications/SPASS/SPASS: 2.29% (18.5284 => 18.9524, std.dev.: 0.0325) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (16.3003 => 16.6683, std.dev.: 0.0601) MultiSource/Applications/d/make_dparser: 2.21% (3.9761 => 4.0641, std.dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: 2.11% (22.2206 => 22.6887, std.dev.: 0.0565) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (3.0562 => 3.1122, std.dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 1.45% (10.2283 => 10.3763, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (4.2243 => 4.2843, std.dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: 1.35% (19.8291 => 20.0971, std.dev.: 0.0690) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: 27.27% (0.0880 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.02% (2.1201 => 2.3961, std.dev.: 0.0449) MultiSource/Applications/siod/siod: 4.89% (2.8642 => 3.0042, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.18% (5.0243 => 5.1843, std.dev.: 0.0042) MultiSource/Applications/obsequi/Obsequi: 2.94% (2.0441 => 2.1041, std.dev.: 0.0193) MultiSource/Benchmarks/Olden/tsp/tsp: 2.48% (1.2881 => 1.3201, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.94% (6.5964 => 6.7244, std.dev.: 0.0273) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.50% (3.7442 => 3.8002, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0177) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (26.3056 => 26.6617, std.dev.: 0.0326) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.86% (2.9562 => 0.6840, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: -6.82% (1.8760 => 1.7480, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.93% (94.8339 => 49.3791, std.dev.: 8.1362) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.66% (49.9431 => 33.1301, std.dev.: 0.1096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.53% (25.7136 => 17.0931, std.dev.: 0.1051) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.0830) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.14% (37.0863 => 28.5058, std.dev.: 0.5011) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -1.25% (21.8014 => 21.5293, std.dev.: 0.0544) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 22:24:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 00:24:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140402052454.EAF362A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24251?compare_to=24241&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24251, Order: 205378, Start Time: 2014-04-02 00:39:41, End Time: 2014-04-02 05:31:11 To: 24241, Order: 205351, Start Time: 2014-04-01 19:40:05, End Time: 2014-04-02 00:32:14 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (117 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (967 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 3.37% (0.8320 => 0.8600, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.16% (2.0761 => 2.1001, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.86% (0.9561 => 1.0121, std.dev.: 0.0189) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0036) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0111) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0061) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/Vector/simple: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.59% (1.7681 => 2.1321, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.18% (1.7641 => 2.1201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.05% (1.6761 => 2.0121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.86% (1.6921 => 2.0281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.72% (1.7441 => 2.0881, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.62% (1.6721 => 2.0001, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.30% (1.7201 => 2.0521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.46% (1.8201 => 2.1561, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.21% (1.9761 => 2.3161, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0037) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.63% (0.7840 => 0.8360, std.dev.: 0.0190) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.79% (1.7280 => 1.8280, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (6.7200 => 7.0920, std.dev.: 0.0502) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.99% (11.7880 => 12.3760, std.dev.: 0.0718) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 4.71% (1.0200 => 1.0680, std.dev.: 0.0178) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0135) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: 4.07% (10.9087 => 11.3527, std.dev.: 0.1267) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.69% (9.9842 => 10.3522, std.dev.: 0.0561) MultiSource/Applications/lua/lua: 3.67% (4.7920 => 4.9680, std.dev.: 0.0322) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (6.8321 => 7.0721, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 3.24% (6.9124 => 7.1364, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0199) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (10.3203 => 10.6323, std.dev.: 0.0308) MultiSource/Applications/d/make_dparser: 2.93% (3.9641 => 4.0801, std.dev.: 0.0292) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0091) MultiSource/Applications/SPASS/SPASS: 2.66% (18.4924 => 18.9846, std.dev.: 0.0607) MultiSource/Applications/JM/lencod/lencod: 2.56% (22.6287 => 23.2087, std.dev.: 0.0468) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0087) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.24% (51.1089 => 52.2529, std.dev.: 0.1290) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2203 => 4.3123, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 2.07% (19.7371 => 20.1451, std.dev.: 0.0480) MultiSource/Benchmarks/Bullet/bullet: 2.04% (38.9366 => 39.7326, std.dev.: 0.0756) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (16.5963 => 16.8723, std.dev.: 0.0637) MultiSource/Applications/ClamAV/clamscan: 1.62% (20.2445 => 20.5725, std.dev.: 0.0593) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 1.31% (2.7562 => 2.7922, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (2.2721 => 2.3001, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0244 => 6.0964, std.dev.: 0.0206) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.43% (0.9281 => 1.1641, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.89% (1.2681 => 1.3681, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.69% (4.6083 => 4.8243, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0498) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.20% (5.0963 => 5.2083, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9604 => 6.0684, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.68% (4.7563 => 4.8363, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.37% (4.0923 => 4.1483, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.50% (6.2884 => 1.3521, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.83% (3.1762 => 1.2441, std.dev.: 0.0143) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0189) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.11% (7.4801 => 6.2000, std.dev.: 0.0321) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.10% (7.5041 => 6.2960, std.dev.: 0.0354) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -3.28% (13.5243 => 13.0803, std.dev.: 0.0279) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -14.26% (7.8005 => 6.6884, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (5.1603 => 5.0403, std.dev.: 0.0191) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -1.03% (11.6527 => 11.5327, std.dev.: 0.0121) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 1 22:34:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 00:34:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140402053436.061912A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24252?compare_to=24242&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24252, Order: 205378, Start Time: 2014-04-02 00:43:48, End Time: 2014-04-02 05:40:53 To: 24242, Order: 205351, Start Time: 2014-04-01 19:41:17, End Time: 2014-04-02 00:36:23 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 14 (158 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0018) SingleSource/UnitTests/Threads/2010-12-08-tls: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 33.33% (0.0480 => 0.0640, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.33% (0.1440 => 0.1560, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.04% (0.4480 => 0.4840, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 6.76% (0.2960 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.38% (0.1880 => 0.2000, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.49% (0.3640 => 0.3840, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.65% (0.6040 => 0.6200, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.42% (1.4081 => 1.4281, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.03% (7.0080 => 7.0800, std.dev.: 0.0230) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 8.62% (0.2320 => 0.2520, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.08% (1.7281 => 1.6921, std.dev.: 0.0130) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 1206.53% (0.1240 => 1.6201, std.dev.: 0.0103) SingleSource/Regression/C/sumarray2d: 1033.33% (0.0360 => 0.4080, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 398.45% (0.2520 => 1.2561, std.dev.: 0.0133) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 282.80% (0.2320 => 0.8881, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0050) SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0062) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0074) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0056) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 55.11% (0.7040 => 1.0920, std.dev.: 0.0066) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.79% (1.1721 => 1.4041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0119) MultiSource/Applications/obsequi/Obsequi: 19.54% (1.3920 => 1.6640, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.41% (1.2161 => 1.4521, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 18.28% (8.5802 => 10.1483, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.00% (1.2001 => 1.4041, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 15.33% (19.5406 => 22.5367, std.dev.: 0.0450) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.17% (5.3360 => 6.0921, std.dev.: 0.0338) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.64% (0.1760 => 0.2000, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0144) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.04% (0.4320 => 0.4840, std.dev.: 0.0122) MultiSource/Applications/sgefa/sgefa: 11.61% (0.4480 => 0.5000, std.dev.: 0.0109) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 8.59% (6.2844 => 6.8244, std.dev.: 0.0188) MultiSource/Benchmarks/mafft/pairlocalalign: 8.57% (11.3843 => 12.3603, std.dev.: 0.0499) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.11% (0.4440 => 0.4800, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (5.6680 => 6.1000, std.dev.: 0.0456) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (11.4440 => 12.3160, std.dev.: 0.0784) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.40% (5.7280 => 6.1520, std.dev.: 0.0542) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.06% (0.6800 => 0.7280, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3600 => 0.3840, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (9.5802 => 10.2122, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.42% (0.8721 => 0.9281, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 6.00% (0.2000 => 0.2120, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0099) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (6.8280 => 7.0800, std.dev.: 0.0230) SingleSource/UnitTests/Vector/constpool: 3.63% (11.0207 => 11.4207, std.dev.: 0.0726) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (1.2320 => 1.2720, std.dev.: 0.0132) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.23% (49.1529 => 50.7409, std.dev.: 0.0895) MultiSource/Applications/lua/lua: 2.93% (4.7720 => 4.9120, std.dev.: 0.0451) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0090) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.49% (2.0920 => 2.1440, std.dev.: 0.0191) MultiSource/Applications/ClamAV/clamscan: 2.46% (19.2243 => 19.6964, std.dev.: 0.0752) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.44% (0.4920 => 0.5040, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 2.15% (24.7575 => 25.2895, std.dev.: 0.0411) MultiSource/Applications/kimwitu++/kc: 2.11% (19.7491 => 20.1651, std.dev.: 0.0518) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: 1.57% (39.0726 => 39.6846, std.dev.: 0.0561) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.03% (1.2401 => 1.3521, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.08% (0.5920 => 0.6280, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.31% (3.3122 => 3.4882, std.dev.: 0.0621) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0340) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.60% (3.2362 => 3.3202, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 2.56% (4.0563 => 4.1603, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.42% (1.6521 => 1.6921, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0086) MultiSource/Applications/aha/aha: 1.11% (2.8802 => 2.9122, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.09% (2.9242 => 2.9562, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -15.01% (7.8605 => 6.6804, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.99% (3.4722 => 3.1602, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0946) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.13% (4.5123 => 4.4163, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3401 => 2.3081, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.0963 => 5.0363, std.dev.: 0.0178) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 23:26:45 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 23:26:45 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140402062645.37CAA4EECD4C@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18760 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205398 Blamelist: dblaikie BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: include/clang/AST/PrettyPrinter.h lib/AST/Decl.cpp lib/AST/TemplateBase.cpp lib/AST/TypePrinter.cpp lib/Parse/ParseDeclCXX.cpp lib/Sema/SemaTemplate.cpp test/Analysis/cfg.cpp test/CXX/expr/expr.prim/expr.prim.lambda/p19.cpp test/CodeGenCXX/destructors.cpp test/CodeGenCXX/microsoft-abi-structors.cpp test/CodeGenCXX/microsoft-abi-virtual-member-pointers.cpp test/CodeGenCXX/predefined-expr.cpp test/Layout/ms-x86-alias-avoidance-padding.cpp test/Modules/namespaces.cpp test/OpenMP/threadprivate_messages.cpp test/Parser/cxx0x-lambda-expressions.cpp test/Sema/switch.c test/SemaCXX/ms-interface.cpp test/SemaCXX/undefined-internal.cpp test/SemaCXX/warn-shadow.cpp test/SemaCXX/warn-sign-conversion.cpp unittests/ASTMatchers/ASTMatchersTest.cpp On: http://10.1.1.2/svn/llvm-project For: cfe At: Tue 01 Apr 2014 23:05:46 Changed By: dblaikie Comments: Render anonymous entities as '(anonymous )' (and lambdas as '(lambda at ... )') For namespaces, this is consistent with mangling and GCC's debug info behavior. For structs, GCC uses but we prefer consistency between all anonymous entities but don't want to confuse them with template arguments, etc, so we'll just go with parens in all cases.Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 23:26:45 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 23:26:45 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140402062645.37C5F4EECD4B@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18760 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205398 Blamelist: dblaikie BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 23:26:44 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 23:26:44 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140402062644.F3DB34EECD45@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14322 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205398 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17583 of 17583) 1 warning(s) in tests. Testing Time: 335.28s ******************** Failing Tests (2): Clang :: SemaCXX/dllexport.cpp Clang :: SemaCXX/dllimport.cpp Expected Passes : 17437 Expected Failures : 101 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::dllexport.cpp': Command Output (stderr): -- error: 'error' diagnostics expected but not seen: File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 61: '::InternalGlobal' must have external linkage when declared 'dllexport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 130: '::internalFunc' must have external linkage when declared 'dllexport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 169: '::internalFuncTmpl' must have external linkage when declared 'dllexport' error: 'error' diagnostics seen but not expected: File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 61: '(anonymous namespace)::InternalGlobal' must have external linkage when declared 'dllexport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 130: '(anonymous namespace)::internalFunc' must have external linkage when declared 'dllexport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 169: '(anonymous namespace)::internalFuncTmpl' must have external linkage when declared 'dllexport' 6 errors generated. -- ******************** Last 15 lines of 'Clang::dllimport.cpp': Command Output (stderr): -- error: 'error' diagnostics expected but not seen: File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 83: '::InternalGlobal' must have external linkage when declared 'dllimport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 161: '::internalFunc' must have external linkage when declared 'dllimport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 202: '::internalFuncTmpl' must have external linkage when declared 'dllimport' error: 'error' diagnostics seen but not expected: File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 83: '(anonymous namespace)::InternalGlobal' must have external linkage when declared 'dllimport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 161: '(anonymous namespace)::internalFunc' must have external linkage when declared 'dllimport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 202: '(anonymous namespace)::internalFuncTmpl' must have external linkage when declared 'dllimport' 6 errors generated. -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Tue Apr 1 23:26:44 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 01 Apr 2014 23:26:44 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140402062644.F32F24EECD44@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14322 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205398 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17583 of 17583) 1 warning(s) in tests. Testing Time: 335.28s ******************** Failing Tests (2): Clang :: SemaCXX/dllexport.cpp Clang :: SemaCXX/dllimport.cpp Expected Passes : 17437 Expected Failures : 101 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::dllexport.cpp': Command Output (stderr): -- error: 'error' diagnostics expected but not seen: File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 61: '::InternalGlobal' must have external linkage when declared 'dllexport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 130: '::internalFunc' must have external linkage when declared 'dllexport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 169: '::internalFuncTmpl' must have external linkage when declared 'dllexport' error: 'error' diagnostics seen but not expected: File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 61: '(anonymous namespace)::InternalGlobal' must have external linkage when declared 'dllexport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 130: '(anonymous namespace)::internalFunc' must have external linkage when declared 'dllexport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllexport.cpp Line 169: '(anonymous namespace)::internalFuncTmpl' must have external linkage when declared 'dllexport' 6 errors generated. -- ******************** Last 15 lines of 'Clang::dllimport.cpp': Command Output (stderr): -- error: 'error' diagnostics expected but not seen: File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 83: '::InternalGlobal' must have external linkage when declared 'dllimport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 161: '::internalFunc' must have external linkage when declared 'dllimport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 202: '::internalFuncTmpl' must have external linkage when declared 'dllimport' error: 'error' diagnostics seen but not expected: File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 83: '(anonymous namespace)::InternalGlobal' must have external linkage when declared 'dllimport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 161: '(anonymous namespace)::internalFunc' must have external linkage when declared 'dllimport' File /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/SemaCXX/dllimport.cpp Line 202: '(anonymous namespace)::internalFuncTmpl' must have external linkage when declared 'dllimport' 6 errors generated. -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Tue Apr 1 23:20:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 01:20:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402062046.07CF92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24253?compare_to=24247&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24253, Order: 205379, Start Time: 2014-04-02 01:37:42, End Time: 2014-04-02 06:27:00 To: 24247, Order: 205374, Start Time: 2014-04-02 00:18:42, End Time: 2014-04-02 05:07:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (105 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 30.00% (0.0400 => 0.0520, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.4040 => 0.4200, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 2.74% (1.6041 => 1.6481, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4600 => 0.4720, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.54% (0.9441 => 0.9681, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 2.14% (2.4320 => 2.4840, std.dev.: 0.0177) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 62.50% (0.0320 => 0.0520, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.42% (1.2401 => 1.3321, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.27% (1.1561 => 1.2401, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0622) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (6.0160 => 6.3640, std.dev.: 0.0331) SingleSource/UnitTests/Vector/constpool: 4.74% (10.8967 => 11.4127, std.dev.: 0.1194) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0500) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0371) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0237) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0327) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0443) MultiSource/Applications/hbd/hbd: 2.62% (1.6800 => 1.7240, std.dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0501) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0429) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0255) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8885, std.dev.: 0.0622) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.12% (48.1088 => 49.1289, std.dev.: 0.0984) MultiSource/Applications/sqlite3/sqlite3: 1.79% (23.7574 => 24.1815, std.dev.: 0.0557) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1131, std.dev.: 0.0458) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 24.89% (0.9321 => 1.1641, std.dev.: 0.0239) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0087) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0489) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0225) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0173) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0289) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0299) MultiSource/Applications/lua/lua: 1.47% (21.1533 => 21.4653, std.dev.: 0.0682) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) SingleSource/Benchmarks/SmallPT/smallpt: 1.31% (14.0009 => 14.1849, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -19.05% (0.0840 => 0.0680, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.35% (2.3881 => 2.3081, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 00:13:54 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 00:13:54 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140402071405.53F974EED4E5@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18761 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205400 Blamelist: dblaikie Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 2 01:05:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 03:05:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402080507.E21E92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24254?compare_to=24253&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24254, Order: 205387, Start Time: 2014-04-02 03:21:59, End Time: 2014-04-02 08:11:21 To: 24253, Order: 205379, Start Time: 2014-04-02 01:37:42, End Time: 2014-04-02 06:27:00 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (94 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.00% (0.0640 => 0.0800, std.dev.: 0.0053) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: 10.34% (0.1160 => 0.1280, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.76% (0.1640 => 0.1800, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.52% (0.3680 => 0.3920, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.9280 => 0.9640, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 42.86% (0.0280 => 0.0400, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.2521 => 1.2761, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -9.09% (0.2640 => 0.2400, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.91% (2.3081 => 2.2641, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 13.13% (0.3960 => 0.4480, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/sieve: 10.26% (0.3120 => 0.3440, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.89% (1.2161 => 1.3121, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.27% (1.1561 => 1.2401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 6.77% (1.2401 => 1.3241, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (10.6960 => 11.3920, std.dev.: 0.0413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0655) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0179) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0343) SingleSource/UnitTests/Vector/constpool: 4.04% (10.8967 => 11.3367, std.dev.: 0.1483) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0217) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0348) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0122) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (10.4082 => 10.7162, std.dev.: 0.0373) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 2.52% (17.6165 => 18.0605, std.dev.: 0.0444) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9126, std.dev.: 0.0933) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0342) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (5.8400 => 5.9600, std.dev.: 0.0315) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.94% (48.1088 => 49.0410, std.dev.: 0.0792) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0152) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0378) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0322) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.36% (21.1533 => 21.4413, std.dev.: 0.0890) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0294) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: -4.90% (0.4080 => 0.3880, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.78% (0.8641 => 0.8401, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 01:49:23 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 01:49:23 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140402084938.000DF4EEE1F2@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14325 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205407 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17582 of 17583) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17583 of 17583) 1 warning(s) in tests. Testing Time: 400.28s ******************** Failing Tests (1): Clang Tools :: clang-tidy/static-analyzer.cpp Expected Passes : 17438 Expected Failures : 101 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang Tools::static-analyzer.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:16:12: error: expected string not found in input // CHECK: warning: Attempt to free released memory [clang-analyzer-unix.Malloc] ^ :2:2: note: scanning from here delete p; ^ :13:171: note: possible intended match here /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:15:3: warning: Attempt to free released memory [clang-analyzer-alpha.unix.MallocWithAnnotations] ^ -- ******************** Last 15 lines of 'warnings (3)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests // CHECK: warning: Attempt to free released memory [clang-analyzer-unix.Malloc] /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:15:3: warning: Attempt to free released memory [clang-analyzer-alpha.unix.MallocWithAnnotations] From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 01:49:23 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 01:49:23 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140402084937.F3A0A4EEE1F1@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14325 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205407 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17582 of 17583) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17583 of 17583) 1 warning(s) in tests. Testing Time: 400.28s ******************** Failing Tests (1): Clang Tools :: clang-tidy/static-analyzer.cpp Expected Passes : 17438 Expected Failures : 101 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang Tools::static-analyzer.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:16:12: error: expected string not found in input // CHECK: warning: Attempt to free released memory [clang-analyzer-unix.Malloc] ^ :2:2: note: scanning from here delete p; ^ :13:171: note: possible intended match here /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:15:3: warning: Attempt to free released memory [clang-analyzer-alpha.unix.MallocWithAnnotations] ^ -- ******************** Last 15 lines of 'warnings (3)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests // CHECK: warning: Attempt to free released memory [clang-analyzer-unix.Malloc] /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:15:3: warning: Attempt to free released memory [clang-analyzer-alpha.unix.MallocWithAnnotations] From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 01:49:38 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 01:49:38 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140402084949.522C94EEE1FB@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18763 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205407 Blamelist: djasper BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 01:49:38 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 01:49:38 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140402084949.5238F4EEE1FC@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18763 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205407 Blamelist: djasper BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: clang-tidy/tool/ClangTidyMain.cpp On: http://10.1.1.2/svn/llvm-project For: clang-tools-extra At: Wed 02 Apr 2014 01:36:05 Changed By: djasper Comments: Disable a few clang-tidy checks by default. The goal is to be able to run clang-tidy on LLVM files without further configuration for now. Once llvm.org/PR19306 is addressed, we can add a configuration file instead and choose other defaults.Properties: LOGS: From llvm-testresults at cs.uiuc.edu Wed Apr 2 02:22:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 04:22:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402092217.43F6E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24255?compare_to=24254&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24255, Order: 205393, Start Time: 2014-04-02 04:41:30, End Time: 2014-04-02 09:28:25 To: 24254, Order: 205387, Start Time: 2014-04-02 03:21:59, End Time: 2014-04-02 08:11:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (99 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: 57.14% (0.0280 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: 25.00% (0.0640 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.86% (0.2840 => 0.3120, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 5.08% (0.2360 => 0.2480, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 2.67% (1.4960 => 1.5360, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (0.9400 => 0.9640, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.70% (0.1840 => 0.2000, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.43% (0.8401 => 0.8521, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -4.46% (0.4480 => 0.4280, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.53% (1.1681 => 1.2561, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.41% (1.2481 => 1.3281, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.23% (1.1561 => 1.2281, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (1.3760 => 1.4520, std.dev.: 0.0157) SingleSource/UnitTests/Vector/constpool: 5.29% (10.8967 => 11.4727, std.dev.: 0.0972) MultiSource/Applications/Burg/burg: 5.21% (1.4600 => 1.5360, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0047) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0177) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.68% (8.1441 => 8.4441, std.dev.: 0.0603) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (10.4082 => 10.7082, std.dev.: 0.0328) MultiSource/Applications/lua/lua: 2.65% (4.5200 => 4.6400, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0271) MultiSource/Benchmarks/Bullet/bullet: 2.58% (37.0925 => 38.0486, std.dev.: 0.0432) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0457) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0114) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.92% (48.1088 => 49.0330, std.dev.: 0.0770) MultiSource/Applications/sqlite3/sqlite3: 1.65% (23.7574 => 24.1495, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0123) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0651, std.dev.: 0.0398) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 24.89% (0.9321 => 1.1641, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0367) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2403 => 4.1963, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 02:36:50 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 02:36:50 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140402093651.116404EEE8E1@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18764 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205408 Blamelist: djasper Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 2 03:00:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 05:00:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402100034.EA6A52A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24256?compare_to=24248&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24256, Order: 205393, Start Time: 2014-04-02 05:16:04, End Time: 2014-04-02 10:06:19 To: 24248, Order: 205374, Start Time: 2014-04-02 00:21:43, End Time: 2014-04-02 05:12:30 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 6 (142 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-02-DependentPHI: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/2008-04-18-LoopBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.4440 => 0.4640, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: 4.35% (0.3680 => 0.3840, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.24% (11.3687 => 31.1779, std.dev.: 0.0936) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0071) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0030) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0024) SingleSource/UnitTests/vla: 50.00% (0.0320 => 0.0480, std.dev.: 0.0033) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.92% (0.2920 => 0.3560, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.1080 => 0.1240, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.32% (0.6200 => 0.6840, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.74% (1.5601 => 1.7121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.72% (1.4401 => 1.5801, std.dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.43% (0.4240 => 0.4640, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.03% (1.8161 => 1.9801, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.96% (1.6521 => 1.8001, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.27% (1.5481 => 1.6761, std.dev.: 0.0146) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.22% (1.4601 => 1.5801, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.99% (1.5521 => 1.6761, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.83% (1.7361 => 1.8721, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.82% (1.4841 => 1.6001, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.69% (1.6121 => 1.7361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: 7.53% (10.6247 => 11.4247, std.dev.: 0.1078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.82% (0.7040 => 0.7520, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.08% (1.4481 => 1.5361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.93% (1.4841 => 1.5721, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.77% (1.4561 => 1.5401, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (11.6440 => 12.3000, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: 5.56% (1.0080 => 1.0640, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.8881 => 0.9361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (9.4842 => 9.9842, std.dev.: 0.0358) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.13% (6.4680 => 6.8000, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0187) MultiSource/Applications/JM/ldecod/ldecod: 4.54% (10.0443 => 10.5003, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.47% (5.8121 => 6.0721, std.dev.: 0.0371) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.05% (0.2960 => 0.3080, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: 3.90% (21.9606 => 22.8168, std.dev.: 0.0448) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (6.5080 => 6.7520, std.dev.: 0.0358) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.68% (1.7400 => 1.8040, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.0440 => 2.1160, std.dev.: 0.0237) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.43% (50.0290 => 51.7450, std.dev.: 0.0495) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.4720 => 0.4880, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.7921 => 1.8521, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 3.16% (38.4046 => 39.6166, std.dev.: 0.0772) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.12% (6.5440 => 6.7480, std.dev.: 0.0577) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (5.3600 => 5.5240, std.dev.: 0.0578) MultiSource/Applications/oggenc/oggenc: 2.92% (6.9844 => 7.1884, std.dev.: 0.0267) MultiSource/Applications/treecc/treecc: 2.79% (2.5840 => 2.6560, std.dev.: 0.0163) MultiSource/Applications/SPASS/SPASS: 2.78% (18.4404 => 18.9524, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (3.0282 => 3.1122, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.65% (1.6601 => 1.7041, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (16.3483 => 16.7483, std.dev.: 0.0464) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0070) MultiSource/Applications/siod/siod: 2.21% (2.7162 => 2.7762, std.dev.: 0.0161) MultiSource/Applications/d/make_dparser: 2.12% (3.9681 => 4.0521, std.dev.: 0.0226) MultiSource/Applications/ClamAV/clamscan: 1.91% (19.0444 => 19.4084, std.dev.: 0.0434) MultiSource/Applications/kimwitu++/kc: 1.60% (19.6891 => 20.0051, std.dev.: 0.0289) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0530) MultiSource/Applications/siod/siod: 5.17% (2.8602 => 3.0082, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0018) MultiSource/Applications/obsequi/Obsequi: 2.92% (2.0521 => 2.1121, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.82% (4.6763 => 4.8083, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.63% (2.9442 => 0.6880, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: -6.42% (1.8680 => 1.7480, std.dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.37% (91.8497 => 49.2631, std.dev.: 6.4542) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.41% (26.0616 => 17.0931, std.dev.: 0.1161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.34% (50.3031 => 33.0301, std.dev.: 0.1648) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.37% (42.1466 => 28.5018, std.dev.: 0.4477) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.0700) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0050) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (1.3761 => 1.3521, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0088) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0143) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.14% (1.4041 => 1.3881, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 03:01:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 05:01:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402100127.0FBCE2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24257?compare_to=24249&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24257, Order: 205393, Start Time: 2014-04-02 05:17:46, End Time: 2014-04-02 10:07:09 To: 24249, Order: 205374, Start Time: 2014-04-02 00:24:49, End Time: 2014-04-02 05:14:11 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 4 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: 57.14% (0.0280 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 31.25% (0.0640 => 0.0840, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0055) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 9.09% (0.2200 => 0.2400, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 7.14% (0.1680 => 0.1800, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.09% (1.8281 => 1.8481, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.49% (2.9562 => 2.7642, std.dev.: 0.0641) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.40% (4.8203 => 4.6563, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.93% (4.7763 => 4.6843, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.14% (4.2003 => 4.1523, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 03:18:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 05:18:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140402101817.7B84A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24258?compare_to=24250&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24258, Order: 205393, Start Time: 2014-04-02 05:31:17, End Time: 2014-04-02 10:24:32 To: 24250, Order: 205378, Start Time: 2014-04-02 00:34:51, End Time: 2014-04-02 05:27:43 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (132 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (950 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-14-AtExit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 9.68% (0.3720 => 0.4080, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1920 => 0.2080, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.32% (0.3280 => 0.3520, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists1: 5.49% (0.3640 => 0.3840, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0027) MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.83% (1.3080 => 1.3320, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 62.50% (0.0320 => 0.0520, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/mst/mst: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.14% (4.4963 => 4.5923, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.75% (17.6723 => 19.5723, std.dev.: 0.0479) MultiSource/Applications/sqlite3/sqlite3: 1412.48% (1.7001 => 25.7136, std.dev.: 0.0536) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.27% (50.1010 => 51.7410, std.dev.: 0.0623) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (11.3920 => 12.2520, std.dev.: 0.0654) SingleSource/Benchmarks/Misc/oourafft: 174.89% (11.3407 => 31.1739, std.dev.: 0.0809) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9962, std.dev.: 0.0164) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0056) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 19.23% (0.1040 => 0.1240, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0070) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.88% (1.8281 => 2.1001, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.38% (1.8081 => 2.0681, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.28% (1.8201 => 2.0801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.86% (2.1361 => 2.4322, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.79% (0.1160 => 0.1320, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.79% (1.8561 => 2.1121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.78% (1.9161 => 2.1801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.76% (1.8601 => 2.1161, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.72% (1.8361 => 2.0881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.11% (1.8921 => 2.1401, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.02% (2.0281 => 2.2921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.98% (1.9721 => 2.2281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.79% (1.8761 => 2.1161, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 12.65% (1.9601 => 2.2081, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.55% (1.9121 => 2.1521, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.29% (1.9521 => 2.1921, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.74% (2.1121 => 2.3601, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.38% (2.1441 => 2.3881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/em3d/em3d: 11.32% (0.2120 => 0.2360, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.06% (1.7721 => 1.9681, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.8441 => 2.0401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.53% (1.9001 => 2.1001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.42% (1.9201 => 2.1201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.02% (1.8361 => 2.0201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.00% (1.8801 => 2.0681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.67% (1.8201 => 1.9961, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0103) SingleSource/UnitTests/Vector/constpool: 9.54% (10.4007 => 11.3927, std.dev.: 0.1481) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.43% (0.6360 => 0.6960, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.25% (1.8601 => 2.0321, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.13% (1.7961 => 1.9601, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0030) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.67% (0.1800 => 0.1920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 6.67% (0.3600 => 0.3840, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.68% (6.4800 => 6.8480, std.dev.: 0.0320) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0170) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0083) MultiSource/Applications/hbd/hbd: 4.17% (1.7280 => 1.8000, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (5.8281 => 6.0601, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.95% (0.7080 => 0.7360, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.75% (9.6042 => 9.9642, std.dev.: 0.0502) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (6.5320 => 6.7480, std.dev.: 0.0591) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.12% (1.6641 => 1.7161, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 3.04% (5.3960 => 5.5600, std.dev.: 0.0324) MultiSource/Applications/lua/lua: 2.84% (4.7920 => 4.9280, std.dev.: 0.0313) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1600 => 2.2200, std.dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: 2.71% (38.6366 => 39.6846, std.dev.: 0.0998) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.63% (6.5360 => 6.7080, std.dev.: 0.0443) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (16.3003 => 16.7163, std.dev.: 0.0554) MultiSource/Applications/JM/lencod/lencod: 2.39% (22.2206 => 22.7527, std.dev.: 0.0373) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 2.22% (18.5284 => 18.9405, std.dev.: 0.0480) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (2.3401 => 2.3921, std.dev.: 0.0110) MultiSource/Applications/d/make_dparser: 1.71% (3.9761 => 4.0441, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (10.2283 => 10.4003, std.dev.: 0.0323) MultiSource/Applications/kimwitu++/kc: 1.23% (19.8291 => 20.0731, std.dev.: 0.0488) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.80% (2.1201 => 2.4762, std.dev.: 0.0435) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0368) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0020) MultiSource/Applications/obsequi/Obsequi: 2.54% (2.0441 => 2.0961, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.50% (4.4803 => 4.5923, std.dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.88% (6.5964 => 6.7204, std.dev.: 0.0412) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (26.3056 => 26.6857, std.dev.: 0.0246) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8521 => 0.8641, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.73% (2.9562 => 0.6880, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: -7.04% (1.8760 => 1.7440, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.00% (94.8339 => 49.3151, std.dev.: 8.4550) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.84% (49.9431 => 33.0421, std.dev.: 0.1783) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.62% (25.7136 => 17.0691, std.dev.: 0.1161) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.0871) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.84% (37.0863 => 28.9858, std.dev.: 0.6007) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0163) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 03:20:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 05:20:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140402102001.730FD2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24259?compare_to=24251&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24259, Order: 205393, Start Time: 2014-04-02 05:34:41, End Time: 2014-04-02 10:26:14 To: 24251, Order: 205378, Start Time: 2014-04-02 00:39:41, End Time: 2014-04-02 05:31:11 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (139 on baseline) Performance Improvements: 4 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-03-NotTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 44.44% (0.0360 => 0.0520, std.dev.: 0.0062) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.43% (0.1400 => 0.1560, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 8.70% (0.1840 => 0.2000, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.51% (0.1880 => 0.2040, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.11% (0.1480 => 0.1600, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (0.3680 => 0.3880, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.94% (0.3240 => 0.3400, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.31% (2.1321 => 2.1041, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.55% (2.9322 => 2.8282, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.48% (4.8243 => 4.6563, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.93% (4.7763 => 4.6843, std.dev.: 0.0299) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0064) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0059) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0119) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.28% (1.6961 => 2.0401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.90% (1.6881 => 2.0241, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.81% (1.6961 => 2.0321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.67% (1.7081 => 2.0441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.63% (1.7321 => 2.0721, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.33% (1.6761 => 2.0001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.30% (1.7201 => 2.0521, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.28% (1.6801 => 2.0041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.07% (1.8041 => 2.1481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.05% (1.7641 => 2.1001, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.00% (1.7681 => 2.1041, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.97% (1.7921 => 2.1321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.91% (1.6921 => 2.0121, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.91% (1.6921 => 2.0121, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.76% (1.7481 => 2.0761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.64% (1.8881 => 2.2401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 18.44% (1.8001 => 2.1321, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 17.91% (1.9881 => 2.3441, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.80% (1.8201 => 2.1441, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/tsp/tsp: 17.65% (0.1360 => 0.1600, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.65% (1.8361 => 2.1601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.61% (1.9081 => 2.2441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.14% (1.9601 => 2.2961, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.11% (1.9641 => 2.3001, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.80% (1.9761 => 2.3081, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.42% (0.6120 => 0.6880, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.51% (0.1880 => 0.2040, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.17% (3.5002 => 3.7162, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.7800 => 0.8280, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3600 => 0.3800, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (6.7200 => 7.0920, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.53% (11.7880 => 12.4400, std.dev.: 0.0960) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.12% (0.8601 => 0.9041, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0175) SingleSource/UnitTests/Vector/constpool: 4.58% (10.9087 => 11.4087, std.dev.: 0.1153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (9.9842 => 10.4042, std.dev.: 0.0637) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.1440 => 1.1920, std.dev.: 0.0185) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (1.6481 => 1.7161, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.6801 => 1.7441, std.dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.67% (1.4160 => 1.4680, std.dev.: 0.0165) MultiSource/Applications/d/make_dparser: 3.63% (3.9641 => 4.1081, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 3.42% (4.7920 => 4.9560, std.dev.: 0.0404) MultiSource/Applications/oggenc/oggenc: 3.30% (6.9124 => 7.1404, std.dev.: 0.0206) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (10.3203 => 10.6443, std.dev.: 0.0263) MultiSource/Applications/SPASS/SPASS: 2.92% (18.4924 => 19.0326, std.dev.: 0.0642) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.92% (1.3720 => 1.4120, std.dev.: 0.0139) MultiSource/Applications/treecc/treecc: 2.90% (2.6200 => 2.6960, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.81% (6.8321 => 7.0241, std.dev.: 0.0510) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (2.0440 => 2.0960, std.dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: 2.47% (22.6287 => 23.1887, std.dev.: 0.0614) MultiSource/Benchmarks/Bullet/bullet: 2.41% (38.9366 => 39.8766, std.dev.: 0.1314) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 2.13% (19.7371 => 20.1571, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (3.0122 => 3.0762, std.dev.: 0.0081) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.11% (51.1089 => 52.1849, std.dev.: 0.1236) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.79% (6.0244 => 6.1324, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.71% (16.5963 => 16.8803, std.dev.: 0.0602) MultiSource/Applications/ClamAV/clamscan: 1.70% (20.2445 => 20.5885, std.dev.: 0.0439) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.33% (4.2203 => 4.2763, std.dev.: 0.0183) MultiSource/Applications/sqlite3/sqlite3: 1.05% (25.1895 => 25.4535, std.dev.: 0.0396) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.52% (1.2681 => 1.3761, std.dev.: 0.0115) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 2.05% (4.0923 => 4.1763, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (4.2443 => 4.3043, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.50% (6.2884 => 1.3521, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/nestedloop: -65.59% (2.9642 => 1.0201, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.24% (1.5881 => 0.5520, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: -32.93% (2.6481 => 1.7760, std.dev.: 0.0152) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.86% (7.4801 => 6.1440, std.dev.: 0.0640) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.69% (7.5041 => 6.2520, std.dev.: 0.0568) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0050) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -3.46% (13.5243 => 13.0563, std.dev.: 0.0476) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0052) SingleSource/Benchmarks/Linpack/linpack-pc: -15.03% (7.8005 => 6.6284, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0180) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0176) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0371) MultiSource/Benchmarks/sim/sim: -1.68% (4.9883 => 4.9043, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -1.13% (11.6527 => 11.5207, std.dev.: 0.0207) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 03:34:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 05:34:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140402103422.AEC872A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24260?compare_to=24252&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24260, Order: 205393, Start Time: 2014-04-02 05:44:23, End Time: 2014-04-02 10:40:36 To: 24252, Order: 205378, Start Time: 2014-04-02 00:43:48, End Time: 2014-04-02 05:40:53 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (154 on baseline) Performance Improvements: 4 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/FloatPrecision: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-14-AtExit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2003-07-08-BitOpsTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.24% (1.4281 => 1.3961, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.33% (2.9562 => 2.8282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.26% (4.4163 => 4.2723, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.93% (4.7723 => 4.6803, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0070) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 393.69% (0.2520 => 1.2441, std.dev.: 0.0197) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 282.80% (0.2320 => 0.8881, std.dev.: 0.0082) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0085) SingleSource/UnitTests/2003-07-08-BitOpsTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0055) SingleSource/Regression/C/sumarraymalloc: 77.78% (0.0360 => 0.0640, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0062) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0069) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.98% (0.7040 => 1.0840, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0096) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.35% (1.2321 => 1.5321, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.87% (1.2401 => 1.5361, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 21.15% (1.2481 => 1.5121, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.41% (1.1561 => 1.3921, std.dev.: 0.0128) MultiSource/Applications/obsequi/Obsequi: 20.40% (1.3920 => 1.6760, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.00% (1.1401 => 1.3681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.11% (1.1721 => 1.3961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.88% (1.1441 => 1.3601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.77% (1.1721 => 1.3921, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.75% (1.1521 => 1.3681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.71% (1.1761 => 1.3961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 18.37% (8.5802 => 10.1563, std.dev.: 0.0404) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.31% (1.1361 => 1.3441, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.27% (1.1601 => 1.3721, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 17.91% (1.2281 => 1.4481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.57% (1.1841 => 1.3921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.13% (1.2841 => 1.5041, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.00% (1.2001 => 1.4041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.93% (1.2521 => 1.4641, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 15.09% (19.5406 => 22.4887, std.dev.: 0.0485) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.62% (5.3360 => 6.1161, std.dev.: 0.0318) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.52% (0.3360 => 0.3680, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 8.75% (11.3843 => 12.3803, std.dev.: 0.0399) MultiSource/Applications/oggenc/oggenc: 8.27% (6.2844 => 6.8044, std.dev.: 0.0254) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.75% (5.7280 => 6.1720, std.dev.: 0.0464) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (11.4440 => 12.2920, std.dev.: 0.0599) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.85% (5.6680 => 6.0560, std.dev.: 0.0468) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.93% (9.5802 => 10.1482, std.dev.: 0.0589) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.9800 => 1.0280, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.89% (0.7360 => 0.7720, std.dev.: 0.0139) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0168) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.77% (4.7720 => 4.9520, std.dev.: 0.0295) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (6.8280 => 7.0680, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (1.0680 => 1.1000, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (5.3840 => 5.5440, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (2.0920 => 2.1520, std.dev.: 0.0174) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.84% (49.1529 => 50.5489, std.dev.: 0.1507) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 2.64% (19.2243 => 19.7324, std.dev.: 0.0257) MultiSource/Applications/sqlite3/sqlite3: 2.15% (24.7575 => 25.2895, std.dev.: 0.0323) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 1.79% (39.0726 => 39.7726, std.dev.: 0.0793) MultiSource/Applications/kimwitu++/kc: 1.15% (19.7491 => 19.9771, std.dev.: 0.0669) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.28% (0.1720 => 0.2000, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.97% (1.2401 => 1.3761, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.82% (0.3320 => 0.3480, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0310) MultiSource/Applications/sqlite3/sqlite3: 2.76% (4.0563 => 4.1683, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.60% (3.2362 => 3.3202, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 1.11% (2.8802 => 2.9122, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (25.4536 => 25.7176, std.dev.: 0.0182) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -8.29% (3.4722 => 3.1842, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0990) MultiSource/Applications/siod/siod: -6.17% (2.9842 => 2.8002, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3401 => 2.3081, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 03:48:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 03:48:46 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140402104850.4421E4EEF23E@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/722 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205333 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp5lrx7Fexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp5lrx7Fexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpVezLTPexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpVezLTPexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Wed Apr 2 03:44:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 05:44:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402104447.145B42A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24261?compare_to=24255&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24261, Order: 205396, Start Time: 2014-04-02 06:01:53, End Time: 2014-04-02 10:51:01 To: 24255, Order: 205393, Start Time: 2014-04-02 04:41:30, End Time: 2014-04-02 09:28:25 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (99 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/Vector/sumarray: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 21.74% (0.0920 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 14.29% (0.1120 => 0.1280, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 3.17% (1.1360 => 1.1720, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.06% (1.7440 => 1.7800, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (4.9760 => 5.0720, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.81% (1.3281 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.59% (1.2561 => 1.2761, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 1.29% (4.6400 => 4.7000, std.dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.83% (3.9682 => 4.1203, std.dev.: 0.0482) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.82% (0.1560 => 0.1760, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.77% (1.1841 => 1.2761, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.55% (1.2721 => 1.3681, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.30% (1.2601 => 1.3521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.4120 => 0.4400, std.dev.: 0.0061) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (10.6960 => 11.3840, std.dev.: 0.0544) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.39% (1.2521 => 1.3321, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0394) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.42% (0.6640 => 0.7000, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: 4.37% (10.8967 => 11.3727, std.dev.: 0.0975) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0520) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0154) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0172) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0468) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0106) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0389) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.75% (0.4360 => 0.4480, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0404) MultiSource/Applications/sqlite3/sqlite3: 1.89% (23.7574 => 24.2055, std.dev.: 0.0376) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0334) MultiSource/Benchmarks/Bullet/bullet: 1.75% (37.0925 => 37.7406, std.dev.: 0.0852) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.61% (48.1088 => 48.8849, std.dev.: 0.0773) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.31% (0.9161 => 0.9281, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 1.08% (18.8170 => 19.0210, std.dev.: 0.0355) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0383) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0315) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.25% (21.1533 => 21.4173, std.dev.: 0.0757) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (25.8896 => 26.1576, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -18.18% (0.0880 => 0.0720, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/health/health: -5.88% (0.4080 => 0.3840, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 04:05:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 06:05:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402110505.846F82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24262?compare_to=24261&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24262, Order: 205398, Start Time: 2014-04-02 06:19:53, End Time: 2014-04-02 11:11:19 To: 24261, Order: 205396, Start Time: 2014-04-02 06:01:53, End Time: 2014-04-02 10:51:01 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (99 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.76% (0.1360 => 0.1520, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.76% (0.9720 => 1.0280, std.dev.: 0.0191) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4360 => 0.4520, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.17% (1.3681 => 1.3841, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 19.05% (0.0840 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.68% (4.4843 => 4.6043, std.dev.: 0.0344) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0062) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0025) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.16% (1.1281 => 1.2201, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.95% (1.2081 => 1.3041, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.82% (1.2281 => 1.3241, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.27% (1.1561 => 1.2401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0491) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0479) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0172) SingleSource/UnitTests/Vector/constpool: 3.60% (10.8967 => 11.2887, std.dev.: 0.0920) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0604) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 3.01% (4.5200 => 4.6560, std.dev.: 0.0389) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0355) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0441) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0341) MultiSource/Benchmarks/Bullet/bullet: 1.77% (37.0925 => 37.7486, std.dev.: 0.0786) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.57% (48.1088 => 48.8649, std.dev.: 0.0802) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.39% (6.6564 => 6.9484, std.dev.: 0.0409) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.22% (4.5043 => 4.6043, std.dev.: 0.0344) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 1.53% (21.1533 => 21.4773, std.dev.: 0.0972) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 04:29:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 06:29:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402112918.81FD12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24263?compare_to=24262&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24263, Order: 205400, Start Time: 2014-04-02 06:45:54, End Time: 2014-04-02 11:35:32 To: 24262, Order: 205398, Start Time: 2014-04-02 06:19:53, End Time: 2014-04-02 11:11:19 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (100 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/FloatMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.67% (0.2400 => 0.2560, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 6.12% (0.1960 => 0.2080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0055) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.97% (1.2120 => 1.2480, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.29% (1.2201 => 1.2481, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 1.05% (3.4322 => 3.4682, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2280 => 0.2480, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.69% (1.1441 => 1.2321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.57% (1.2161 => 1.3081, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.92% (1.2721 => 1.3601, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0134) MultiSource/Applications/viterbi/viterbi: 6.12% (0.1960 => 0.2080, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (10.6960 => 11.3440, std.dev.: 0.0755) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0442) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0055) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0298) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0240) SingleSource/UnitTests/Vector/constpool: 4.15% (10.8967 => 11.3487, std.dev.: 0.0877) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0240) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0395) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0358) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4520 => 0.4640, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0385) MultiSource/Applications/JM/lencod/lencod: 2.47% (17.6165 => 18.0525, std.dev.: 0.0590) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0387) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0407) MultiSource/Benchmarks/Bullet/bullet: 1.80% (37.0925 => 37.7605, std.dev.: 0.0719) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.71% (48.1088 => 48.9329, std.dev.: 0.0718) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0810, std.dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0157) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0125) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0209) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.57% (6.6564 => 6.9604, std.dev.: 0.0466) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0229) MultiSource/Applications/lua/lua: 1.63% (21.1533 => 21.4973, std.dev.: 0.0902) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.03% (1.2601 => 1.1841, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/health/health: -5.88% (0.4080 => 0.3840, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 07:11:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 09:11:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402141123.07A5C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24264?compare_to=24263&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24264, Order: 205409, Start Time: 2014-04-02 09:30:28, End Time: 2014-04-02 14:17:37 To: 24263, Order: 205400, Start Time: 2014-04-02 06:45:54, End Time: 2014-04-02 11:35:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (102 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 36.36% (0.0440 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0049) MultiSource/Applications/obsequi/Obsequi: 4.22% (1.2320 => 1.2840, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3560 => 0.3680, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.13% (0.5120 => 0.5280, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 30.00% (0.1200 => 0.1560, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.54% (1.0481 => 1.1481, std.dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.04% (0.9801 => 1.0001, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/health/health: -19.15% (0.1880 => 0.1520, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.06% (1.3561 => 1.3281, std.dev.: 0.0101) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0038) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.42% (1.2401 => 1.3321, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0103) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.13% (10.6960 => 11.3520, std.dev.: 0.0663) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.07% (1.2521 => 1.3281, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.45% (0.4400 => 0.4640, std.dev.: 0.0082) SingleSource/UnitTests/Vector/constpool: 5.40% (10.8967 => 11.4847, std.dev.: 0.1074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (6.0160 => 6.3040, std.dev.: 0.0513) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0296) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.68% (0.5440 => 0.5640, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.39% (8.1441 => 8.4201, std.dev.: 0.0655) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0129) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0274) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0255) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0558) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0352) MultiSource/Benchmarks/Bullet/bullet: 1.81% (37.0925 => 37.7645, std.dev.: 0.0859) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.78% (48.1088 => 48.9649, std.dev.: 0.1114) MultiSource/Applications/sqlite3/sqlite3: 1.67% (23.7574 => 24.1535, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 1.06% (18.8170 => 19.0170, std.dev.: 0.0370) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 23.60% (0.9321 => 1.1521, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 18.18% (0.1320 => 0.1560, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0439) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0224) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.46% (21.1533 => 21.4613, std.dev.: 0.1071) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0307) MultiSource/Applications/SPASS/SPASS: 1.00% (9.1686 => 9.2606, std.dev.: 0.0191) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (1.4881 => 1.4681, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 08:04:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 10:04:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402150419.8496D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24265?compare_to=24257&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24265, Order: 205409, Start Time: 2014-04-02 10:21:35, End Time: 2014-04-02 15:10:35 To: 24257, Order: 205393, Start Time: 2014-04-02 05:17:46, End Time: 2014-04-02 10:07:09 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1101 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-BitfieldHandling: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/Threads/tls: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.43% (0.0560 => 0.0680, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 6.90% (0.3480 => 0.3720, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.2960 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 3.37% (0.8320 => 0.8600, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5840 => 0.5960, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 08:04:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 10:04:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402150430.9F93E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24266?compare_to=24256&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24266, Order: 205409, Start Time: 2014-04-02 10:20:46, End Time: 2014-04-02 15:10:43 To: 24256, Order: 205393, Start Time: 2014-04-02 05:16:04, End Time: 2014-04-02 10:06:19 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 6 (147 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/ccc: 100.00% (0.0160 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/SmallPT/smallpt: 12.12% (0.1320 => 0.1480, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.4880 => 0.5080, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 7.56% (0.6880 => 0.7400, std.dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.46% (11.3687 => 31.2020, std.dev.: 0.4206) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0121) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0101) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0035) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: 22.22% (0.1080 => 0.1320, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.02% (1.0240 => 1.1880, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0231) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.43% (0.4600 => 0.5080, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.74% (1.5601 => 1.7121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.34% (1.4561 => 1.5921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.17% (1.4401 => 1.5721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.04% (1.4601 => 1.5921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.03% (1.8161 => 1.9801, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.96% (1.6521 => 1.8001, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.64% (0.3240 => 0.3520, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.62% (1.4841 => 1.6121, std.dev.: 0.0118) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0088) MultiSource/Applications/spiff/spiff: 8.33% (1.0080 => 1.0920, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.01% (1.5481 => 1.6721, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.94% (1.6121 => 1.7401, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (1.1640 => 1.2560, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.66% (1.7761 => 1.9121, std.dev.: 0.0150) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.14% (1.7361 => 1.8601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: 6.70% (10.6247 => 11.3367, std.dev.: 0.1182) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.35% (1.4481 => 1.5401, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (6.4680 => 6.8480, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0098) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (11.6440 => 12.3200, std.dev.: 0.0557) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.67% (1.6921 => 1.7881, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.48% (9.4842 => 10.0042, std.dev.: 0.0364) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.38% (1.5600 => 1.6440, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.29% (1.7401 => 1.8321, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.7000 => 0.7360, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0217) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0179) MultiSource/Benchmarks/Olden/bh/bh: 4.96% (0.4840 => 0.5080, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.94% (1.4561 => 1.5281, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.9800 => 1.0280, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.82% (5.8121 => 6.0921, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.79% (1.4201 => 1.4881, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 4.76% (0.5040 => 0.5280, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0220) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.36% (1.4681 => 1.5321, std.dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: 3.97% (21.9606 => 22.8328, std.dev.: 0.0453) MultiSource/Applications/JM/ldecod/ldecod: 3.86% (10.0443 => 10.4323, std.dev.: 0.0540) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (5.3600 => 5.5640, std.dev.: 0.0230) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.45% (50.0290 => 51.7530, std.dev.: 0.1029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (6.5440 => 6.7680, std.dev.: 0.0586) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4720 => 0.4880, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0358) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (2.3281 => 2.4042, std.dev.: 0.0132) MultiSource/Applications/hbd/hbd: 3.23% (1.7360 => 1.7920, std.dev.: 0.0184) MultiSource/Applications/oggenc/oggenc: 3.15% (6.9844 => 7.2044, std.dev.: 0.0177) MultiSource/Benchmarks/Bullet/bullet: 3.01% (38.4046 => 39.5606, std.dev.: 0.0681) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.89% (6.5080 => 6.6960, std.dev.: 0.0550) MultiSource/Applications/treecc/treecc: 2.79% (2.5840 => 2.6560, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (3.0282 => 3.1122, std.dev.: 0.0110) MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (1.7921 => 1.8401, std.dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: 2.62% (18.4404 => 18.9244, std.dev.: 0.0475) MultiSource/Applications/ClamAV/clamscan: 2.44% (19.0444 => 19.5084, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (4.1843 => 4.2843, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (16.3483 => 16.6923, std.dev.: 0.0494) MultiSource/Applications/siod/siod: 2.06% (2.7162 => 2.7722, std.dev.: 0.0144) MultiSource/Applications/d/make_dparser: 2.02% (3.9681 => 4.0481, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (1.1000 => 1.1200, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: 1.77% (19.6891 => 20.0371, std.dev.: 0.0466) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.40% (2.1401 => 2.4482, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/salsa20: 2.86% (7.4205 => 7.6325, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.22% (2.9442 => 0.7000, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0043) MultiSource/Applications/obsequi/Obsequi: -6.00% (1.8680 => 1.7560, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.09% (91.8497 => 49.5191, std.dev.: 8.0891) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.37% (26.0616 => 17.1051, std.dev.: 0.0876) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.14% (50.3031 => 33.1301, std.dev.: 0.2124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.43% (42.1466 => 28.9018, std.dev.: 0.3720) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.0920) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0155) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 08:23:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 10:23:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140402152354.6F2762A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24267?compare_to=24259&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24267, Order: 205409, Start Time: 2014-04-02 10:38:25, End Time: 2014-04-02 15:30:11 To: 24259, Order: 205393, Start Time: 2014-04-02 05:34:41, End Time: 2014-04-02 10:26:14 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (127 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.08% (0.1040 => 0.1280, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 8.47% (0.2360 => 0.2560, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.8040 => 0.8440, std.dev.: 0.0109) SingleSource/Benchmarks/Linpack/linpack-pc: 3.61% (0.3320 => 0.3440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/nestedloop: 1.96% (1.0201 => 1.0401, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.76% (6.1440 => 6.2520, std.dev.: 0.0339) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.11% (0.7040 => 0.7400, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -19.05% (0.0840 => 0.0680, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0109) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.18% (1.7641 => 2.1201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.86% (1.7321 => 2.0761, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.81% (1.6761 => 2.0081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.68% (1.7681 => 2.1161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.67% (1.7081 => 2.0441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.67% (1.6881 => 2.0201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.66% (1.6681 => 1.9961, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.34% (1.6961 => 2.0241, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.33% (1.8001 => 2.1481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.30% (1.7201 => 2.0521, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.28% (1.6801 => 2.0041, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.97% (1.7921 => 2.1321, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.85% (1.8881 => 2.2441, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.6721 => 1.9841, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.18% (1.8041 => 2.1321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.08% (1.8361 => 2.1681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.02% (1.8201 => 2.1481, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.61% (1.9761 => 2.3241, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.56% (1.9801 => 2.3081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.14% (1.9081 => 2.2161, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.63% (0.1640 => 0.1880, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0261) SingleSource/Regression/C++/ofstream_ctor: 12.28% (0.2280 => 0.2560, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.87% (0.1840 => 0.2040, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.7400 => 0.7840, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.70% (11.7880 => 12.4600, std.dev.: 0.0624) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.88% (6.7200 => 7.0480, std.dev.: 0.0526) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (1.2400 => 1.3000, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (9.9842 => 10.4402, std.dev.: 0.0381) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0152) SingleSource/UnitTests/Vector/constpool: 4.51% (10.9087 => 11.4007, std.dev.: 0.1214) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.94% (0.8120 => 0.8440, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.6801 => 1.7441, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.67% (1.4160 => 1.4680, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0075) MultiSource/Applications/d/make_dparser: 3.63% (3.9641 => 4.1081, std.dev.: 0.0225) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0335) MultiSource/Applications/oggenc/oggenc: 3.24% (6.9124 => 7.1364, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (6.8321 => 7.0441, std.dev.: 0.0279) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.8201 => 1.8761, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (2.0440 => 2.1040, std.dev.: 0.0185) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (10.3203 => 10.6163, std.dev.: 0.0301) MultiSource/Applications/treecc/treecc: 2.75% (2.6200 => 2.6920, std.dev.: 0.0185) MultiSource/Applications/SPASS/SPASS: 2.68% (18.4924 => 18.9886, std.dev.: 0.0626) MultiSource/Applications/JM/lencod/lencod: 2.39% (22.6287 => 23.1687, std.dev.: 0.0634) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (51.1089 => 52.3049, std.dev.: 0.1394) MultiSource/Applications/kimwitu++/kc: 2.17% (19.7371 => 20.1651, std.dev.: 0.0329) MultiSource/Benchmarks/Bullet/bullet: 2.16% (38.9366 => 39.7766, std.dev.: 0.0675) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (3.0122 => 3.0722, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: 1.84% (20.2445 => 20.6165, std.dev.: 0.0547) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.37% (16.5963 => 16.8243, std.dev.: 0.0624) MultiSource/Applications/sqlite3/sqlite3: 1.32% (25.1895 => 25.5215, std.dev.: 0.0275) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7722 => 2.8002, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 25.86% (0.9281 => 1.1681, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.89% (1.2681 => 1.3681, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.76% (6.8204 => 7.0084, std.dev.: 0.0494) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 2.44% (4.0923 => 4.1923, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.50% (6.2884 => 1.3521, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.24% (1.5881 => 0.5520, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: -32.48% (2.6481 => 1.7880, std.dev.: 0.0179) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -17.17% (7.5041 => 6.2160, std.dev.: 0.0524) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (7.4801 => 6.2520, std.dev.: 0.0339) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0040) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -3.52% (13.5243 => 13.0483, std.dev.: 0.0398) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -15.03% (7.8005 => 6.6284, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.66% (3.4442 => 3.0082, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0239) MultiSource/Applications/lambda-0_1_3/lambda: -2.17% (5.1603 => 5.0483, std.dev.: 0.0133) MultiSource/Benchmarks/sim/sim: -1.68% (4.9883 => 4.9043, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: -1.27% (11.6527 => 11.5047, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 08:41:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 10:41:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140402154149.DB4422A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24268?compare_to=24260&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24268, Order: 205409, Start Time: 2014-04-02 10:52:46, End Time: 2014-04-02 15:48:07 To: 24260, Order: 205393, Start Time: 2014-04-02 05:44:23, End Time: 2014-04-02 10:40:36 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (151 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/almabench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.43% (0.3680 => 0.3880, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.26% (0.3680 => 0.3800, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 2.38% (0.8400 => 0.8600, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.85% (1.5121 => 1.5401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.75% (1.3681 => 1.3921, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.75% (0.2440 => 0.2800, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -1.00% (3.1842 => 3.1522, std.dev.: 0.0116) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0091) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0085) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 757.89% (0.0760 => 0.6520, std.dev.: 0.0067) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 393.69% (0.2520 => 1.2441, std.dev.: 0.0119) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 282.80% (0.2320 => 0.8881, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 228.57% (0.0280 => 0.0920, std.dev.: 0.0072) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0048) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0061) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 96.15% (0.1040 => 0.2040, std.dev.: 0.0095) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0040) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 65.00% (0.0800 => 0.1320, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 48.30% (0.7040 => 1.0440, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.64% (1.2160 => 1.5521, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.87% (1.2401 => 1.5361, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.66% (1.2001 => 1.4481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.41% (1.1561 => 1.3921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.07% (1.1761 => 1.4121, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0116) MultiSource/Applications/obsequi/Obsequi: 18.97% (1.3920 => 1.6560, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 18.28% (8.5802 => 10.1483, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.27% (1.1601 => 1.3721, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.24% (1.1841 => 1.4001, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.09% (1.1721 => 1.3841, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 17.75% (1.1721 => 1.3801, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.53% (1.2321 => 1.4481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.21% (1.2321 => 1.4441, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.77% (1.2881 => 1.5041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.00% (1.2001 => 1.3921, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 15.01% (19.5406 => 22.4727, std.dev.: 0.0568) MultiSource/Benchmarks/Olden/bh/bh: 14.89% (0.3760 => 0.4320, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0123) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/almabench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.87% (5.3360 => 6.0761, std.dev.: 0.0325) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0179) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.20% (0.3480 => 0.3800, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 8.92% (11.3843 => 12.4003, std.dev.: 0.0361) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.11% (0.4440 => 0.4800, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.05% (5.6680 => 6.1240, std.dev.: 0.0359) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.68% (5.7280 => 6.1680, std.dev.: 0.0395) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (11.4440 => 12.3160, std.dev.: 0.0574) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.07% (0.7360 => 0.7880, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.93% (9.5802 => 10.1482, std.dev.: 0.0681) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash2: 5.65% (0.4960 => 0.5240, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.49% (0.9800 => 1.0240, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/bigfib: 4.30% (0.7440 => 0.7760, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 3.70% (11.0207 => 11.4287, std.dev.: 0.1503) MultiSource/Applications/lua/lua: 3.52% (4.7720 => 4.9400, std.dev.: 0.0309) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (6.8280 => 7.0680, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (1.0680 => 1.1000, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (5.3840 => 5.5400, std.dev.: 0.0405) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.83% (49.1529 => 50.5449, std.dev.: 0.1171) MultiSource/Applications/ClamAV/clamscan: 2.71% (19.2243 => 19.7444, std.dev.: 0.0648) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 2.00% (24.7575 => 25.2535, std.dev.: 0.0497) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0124 => 6.1004, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 1.38% (19.7491 => 20.0211, std.dev.: 0.0824) MultiSource/Benchmarks/Bullet/bullet: 1.33% (39.0726 => 39.5926, std.dev.: 0.0958) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.7282 => 2.7642, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.00% (1.2401 => 1.3641, std.dev.: 0.0204) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0072) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0731) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.84% (3.2362 => 3.3282, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 2.17% (4.0563 => 4.1443, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 1.11% (2.8802 => 2.9122, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (25.4536 => 25.7216, std.dev.: 0.0334) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0052) SingleSource/Benchmarks/Linpack/linpack-pc: -15.62% (7.8605 => 6.6324, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0940) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -1.84% (4.9963 => 4.9043, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (5.0963 => 5.0163, std.dev.: 0.0210) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3401 => 2.3081, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 09:53:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 11:53:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402165356.8BAD72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24269?compare_to=24264&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24269, Order: 205414, Start Time: 2014-04-02 12:10:49, End Time: 2014-04-02 17:00:11 To: 24264, Order: 205409, Start Time: 2014-04-02 09:30:28, End Time: 2014-04-02 14:17:37 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (98 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: 10.34% (0.2320 => 0.2560, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 4.69% (0.7680 => 0.8040, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9121 => 0.9281, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (4.9680 => 5.0360, std.dev.: 0.0237) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 6.09% (0.4600 => 0.4880, std.dev.: 0.0072) SingleSource/Benchmarks/McGill/chomp: 2.08% (1.1521 => 1.1761, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.34% (4.4843 => 4.5443, std.dev.: 0.0231) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.61% (1.1241 => 1.2321, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0619) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0499) SingleSource/UnitTests/Vector/constpool: 4.88% (10.8967 => 11.4287, std.dev.: 0.1141) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0447) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0173) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.74% (0.8561 => 0.8881, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0380) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0237) MultiSource/Benchmarks/mafft/pairlocalalign: 2.73% (10.4082 => 10.6922, std.dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 2.38% (17.6165 => 18.0365, std.dev.: 0.0792) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.89% (2.1201 => 2.1601, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 1.80% (37.0925 => 37.7606, std.dev.: 0.0461) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.67% (48.1088 => 48.9130, std.dev.: 0.0885) MultiSource/Applications/sqlite3/sqlite3: 1.58% (23.7574 => 24.1335, std.dev.: 0.0533) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0156) MultiSource/Applications/kimwitu++/kc: 1.04% (18.8170 => 19.0130, std.dev.: 0.0549) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0537) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0116) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.89% (1.6601 => 1.7081, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.55% (21.1533 => 21.4813, std.dev.: 0.0605) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 10:20:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 12:20:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402172049.B14772A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24270?compare_to=24269&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24270, Order: 205416, Start Time: 2014-04-02 12:40:05, End Time: 2014-04-02 17:27:04 To: 24269, Order: 205414, Start Time: 2014-04-02 12:10:49, End Time: 2014-04-02 17:00:11 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (105 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/testtrace: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/Threads/tls: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/factor: 80.00% (0.0200 => 0.0360, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.05% (0.0840 => 0.1000, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 4.82% (0.3320 => 0.3480, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.15% (0.8881 => 0.9161, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.62% (1.2321 => 1.2521, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 2.65% (0.6040 => 0.6200, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0059) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sieve: 11.54% (0.3120 => 0.3480, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.20% (1.2201 => 1.3201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.42% (1.2401 => 1.3321, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.92% (1.2721 => 1.3601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.49% (1.2321 => 1.3121, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.07% (1.2521 => 1.3281, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0566) SingleSource/UnitTests/Vector/constpool: 4.66% (10.8967 => 11.4047, std.dev.: 0.1266) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0151) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0501) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0321) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.7360 => 1.7880, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0550) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0391) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0340) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0331) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.87% (48.1088 => 49.0089, std.dev.: 0.0661) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: 1.68% (23.7574 => 24.1575, std.dev.: 0.0704) MultiSource/Benchmarks/Bullet/bullet: 1.67% (37.0925 => 37.7126, std.dev.: 0.0876) MultiSource/Applications/kimwitu++/kc: 1.38% (18.8170 => 19.0770, std.dev.: 0.0449) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0444) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0240) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: 3.29% (2.0681 => 2.1361, std.dev.: 0.0175) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 11:16:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 13:16:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402181625.4FCD72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24271?compare_to=24270&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24271, Order: 205420, Start Time: 2014-04-02 13:36:08, End Time: 2014-04-02 18:22:39 To: 24270, Order: 205416, Start Time: 2014-04-02 12:40:05, End Time: 2014-04-02 17:27:04 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (96 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: 23.33% (0.1200 => 0.1480, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_isamax: 19.05% (0.0840 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.84% (0.2440 => 0.2680, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 5.77% (0.2080 => 0.2200, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.00% (1.4000 => 1.4560, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.37% (0.3560 => 0.3680, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.25% (1.2841 => 1.3001, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.09% (0.1760 => 0.1920, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Regression/C/sumarray2d: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.53% (1.1681 => 1.2561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.39% (1.1361 => 1.2201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.81% (1.3760 => 1.4560, std.dev.: 0.0168) SingleSource/UnitTests/Vector/constpool: 5.80% (10.8967 => 11.5287, std.dev.: 0.0925) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.66% (1.2721 => 1.3441, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.42% (0.6640 => 0.7000, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.32% (6.0160 => 6.3360, std.dev.: 0.0496) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0382) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.4120 => 0.4280, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0304) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0378) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.83% (5.8000 => 5.9640, std.dev.: 0.0525) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0422) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0514) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0278) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0324) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.87% (48.1088 => 49.0090, std.dev.: 0.1093) MultiSource/Benchmarks/Bullet/bullet: 1.85% (37.0925 => 37.7805, std.dev.: 0.0998) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.79% (23.7574 => 24.1815, std.dev.: 0.0423) MultiSource/Applications/kimwitu++/kc: 1.15% (18.8170 => 19.0330, std.dev.: 0.0505) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0447) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 1.42% (21.1533 => 21.4533, std.dev.: 0.1142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (4.0643 => 4.1203, std.dev.: 0.0205) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/pi: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -9.09% (0.1760 => 0.1600, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0198) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0196) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 11:20:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 13:20:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402182049.0CB7F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24272?compare_to=24271&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24272, Order: 205421, Start Time: 2014-04-02 13:35:28, End Time: 2014-04-02 18:27:03 To: 24271, Order: 205420, Start Time: 2014-04-02 13:36:08, End Time: 2014-04-02 18:22:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (102 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.41% (0.0680 => 0.0880, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 28.57% (0.0560 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.00% (0.1600 => 0.1760, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.46% (0.2960 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 4.82% (0.3320 => 0.3480, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.91% (1.2561 => 1.2801, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 5.26% (0.3800 => 0.4000, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: 2.11% (2.0881 => 2.1321, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.2561 => 1.2761, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0125) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.32% (1.1481 => 1.2321, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.98% (1.2601 => 1.3481, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.92% (1.1561 => 1.2361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.60% (1.2721 => 1.3561, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.7080 => 1.7920, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0304) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0200) SingleSource/UnitTests/Vector/constpool: 3.85% (10.8967 => 11.3167, std.dev.: 0.1522) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0419) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0080) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0268) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0352) MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (10.4082 => 10.7082, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0199) MultiSource/Applications/JM/lencod/lencod: 2.72% (17.6165 => 18.0965, std.dev.: 0.0468) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0351) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0304) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0277) MultiSource/Benchmarks/Bullet/bullet: 1.98% (37.0925 => 37.8286, std.dev.: 0.0584) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: 1.63% (23.7574 => 24.1455, std.dev.: 0.0487) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.60% (48.1088 => 48.8770, std.dev.: 0.0959) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0448) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0293) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0348) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0088) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.2601 => 1.2761, std.dev.: 0.0057) SingleSource/Benchmarks/SmallPT/smallpt: 1.20% (14.0009 => 14.1689, std.dev.: 0.0403) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -1.16% (1.3841 => 1.3681, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: -1.02% (3.5362 => 3.5002, std.dev.: 0.0116) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 12:43:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 14:43:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402194302.062E72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24273?compare_to=24272&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24273, Order: 205426, Start Time: 2014-04-02 15:01:54, End Time: 2014-04-02 19:49:14 To: 24272, Order: 205421, Start Time: 2014-04-02 13:35:28, End Time: 2014-04-02 18:27:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (101 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: 31.25% (0.0640 => 0.0840, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.2920 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.70% (0.3240 => 0.3360, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3280 => 0.3400, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.92% (1.2321 => 1.2681, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.68% (0.8961 => 0.9201, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.46% (1.3001 => 1.3321, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.82% (1.3161 => 1.3401, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.83% (0.0960 => 0.1160, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9682 => 4.0083, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.77% (1.1841 => 1.2761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (10.6960 => 11.3680, std.dev.: 0.0530) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: 4.63% (10.8967 => 11.4007, std.dev.: 0.1150) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0564) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0230) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0215) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0442) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0431) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0506) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0403) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0094) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.65% (48.1088 => 48.9009, std.dev.: 0.1174) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (7.8562 => 7.9802, std.dev.: 0.0405) MultiSource/Benchmarks/Bullet/bullet: 1.55% (37.0925 => 37.6685, std.dev.: 0.0866) MultiSource/Applications/sqlite3/sqlite3: 1.50% (23.7574 => 24.1135, std.dev.: 0.0541) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0144) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 1.19% (18.8170 => 19.0410, std.dev.: 0.0450) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0408) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 2.68% (5.8164 => 5.9724, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0382) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: -16.67% (0.1200 => 0.1000, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.05% (3.3482 => 3.1122, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.08% (1.4881 => 1.4721, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 13:01:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 15:01:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402200133.111D92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24274?compare_to=24265&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24274, Order: 205426, Start Time: 2014-04-02 15:18:40, End Time: 2014-04-02 20:07:48 To: 24265, Order: 205409, Start Time: 2014-04-02 10:21:35, End Time: 2014-04-02 15:10:35 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1094 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.05% (0.0760 => 0.0920, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.94% (0.2520 => 0.2720, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.63% (0.7600 => 0.7800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.81% (1.7641 => 1.7961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.78% (1.8001 => 1.8321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.72% (1.8601 => 1.8921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.56% (1.8001 => 1.8281, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.38% (2.0361 => 2.0641, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.14% (1.7521 => 1.7721, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.51% (0.1640 => 0.1960, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.12% (0.9441 => 0.9641, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: -60.00% (0.0200 => 0.0080, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -21.98% (0.7280 => 0.5680, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 5.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 13:02:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 15:02:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140402200224.3DF5F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24275?compare_to=24266&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24275, Order: 205426, Start Time: 2014-04-02 15:18:41, End Time: 2014-04-02 20:08:42 To: 24266, Order: 205409, Start Time: 2014-04-02 10:20:46, End Time: 2014-04-02 15:10:43 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (138 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 18.75% (0.0640 => 0.0760, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.30% (0.1720 => 0.1880, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 6.15% (0.2600 => 0.2760, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.59% (0.4640 => 0.4760, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.21% (1.6481 => 1.6681, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 35.00% (0.0800 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.56% (0.2360 => 0.2680, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash: 7.32% (0.4920 => 0.5280, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 173.57% (11.3687 => 31.1019, std.dev.: 0.0952) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0098) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0091) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0066) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.69% (0.1160 => 0.1400, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/wc: 9.52% (0.2520 => 0.2760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.03% (1.8161 => 1.9801, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.4961 => 1.6241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.53% (1.5481 => 1.6801, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.43% (0.3320 => 0.3600, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.19% (1.6121 => 1.7441, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.14% (1.5241 => 1.6481, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/ary3: 8.11% (0.2960 => 0.3200, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.99% (1.5521 => 1.6761, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.71% (1.6081 => 1.7321, std.dev.: 0.0167) SingleSource/UnitTests/Vector/constpool: 7.57% (10.6247 => 11.4287, std.dev.: 0.1049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.20% (1.6121 => 1.7281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0253) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (6.4680 => 6.9160, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.22% (1.4801 => 1.5721, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0121) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60% (11.6440 => 12.2960, std.dev.: 0.0756) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.57% (1.5801 => 1.6681, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0174) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.31% (9.4842 => 9.9882, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0070) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (5.8121 => 6.0841, std.dev.: 0.0425) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (10.0443 => 10.5083, std.dev.: 0.0363) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.39% (0.4560 => 0.4760, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0255) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0170) MultiSource/Applications/JM/lencod/lencod: 4.14% (21.9606 => 22.8688, std.dev.: 0.0416) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0247) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (6.5440 => 6.7840, std.dev.: 0.0517) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (6.5080 => 6.7440, std.dev.: 0.0365) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.56% (50.0290 => 51.8090, std.dev.: 0.0904) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0182) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0254) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (5.3600 => 5.5240, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.92% (2.3281 => 2.3961, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.89% (1.6601 => 1.7081, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.83% (38.4046 => 39.4926, std.dev.: 0.0625) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (4.1843 => 4.3003, std.dev.: 0.0088) MultiSource/Applications/treecc/treecc: 2.63% (2.5840 => 2.6520, std.dev.: 0.0199) MultiSource/Applications/SPASS/SPASS: 2.36% (18.4404 => 18.8765, std.dev.: 0.0542) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (16.3483 => 16.7283, std.dev.: 0.0541) MultiSource/Applications/ClamAV/clamscan: 2.23% (19.0444 => 19.4684, std.dev.: 0.0570) MultiSource/Applications/siod/siod: 1.91% (2.7162 => 2.7682, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 1.85% (19.6891 => 20.0531, std.dev.: 0.0678) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.97% (0.9241 => 1.1641, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.70% (2.1401 => 2.4762, std.dev.: 0.0314) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0075) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0225) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1245 => 8.2125, std.dev.: 0.0192) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.77% (2.9442 => 0.6840, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0065) MultiSource/Applications/obsequi/Obsequi: -6.64% (1.8680 => 1.7440, std.dev.: 0.0233) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.32% (91.8497 => 49.3071, std.dev.: 8.5684) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.34% (26.0616 => 17.1131, std.dev.: 0.1128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.26% (50.3031 => 33.0701, std.dev.: 0.1777) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.44% (42.1466 => 28.8978, std.dev.: 0.5224) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.0905) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.18% (2.7002 => 2.4522, std.dev.: 0.0871) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: -1.36% (2.3561 => 2.3241, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 13:23:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 15:23:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140402202338.F1C6D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24276?compare_to=24267&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24276, Order: 205426, Start Time: 2014-04-02 15:38:08, End Time: 2014-04-02 20:29:56 To: 24267, Order: 205409, Start Time: 2014-04-02 10:38:25, End Time: 2014-04-02 15:30:11 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 24 (133 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1088 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/misr: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.00% (0.1000 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.56% (0.2440 => 0.2600, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.49% (1.0480 => 1.1160, std.dev.: 0.0221) MultiSource/Applications/spiff/spiff: 5.86% (1.0240 => 1.0840, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3080 => 0.3240, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.41% (0.2720 => 0.2840, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.35% (2.2161 => 2.2681, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.7441 => 1.7801, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.61% (6.2160 => 6.3160, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.58% (2.0201 => 2.0521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.40% (1.9961 => 2.0241, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.36% (7.0480 => 7.1440, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.31% (2.1321 => 2.1601, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.30% (0.9241 => 0.9361, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.25% (2.2441 => 2.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.17% (2.0521 => 2.0761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.11% (2.1681 => 2.1921, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0112) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/simple: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/dt: 21.43% (0.0560 => 0.0680, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.11% (1.7241 => 2.0881, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.08% (1.7081 => 2.0681, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.95% (1.6801 => 2.0321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.84% (1.8041 => 2.1801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.70% (1.7201 => 2.0761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.34% (1.8881 => 2.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.86% (1.6921 => 2.0281, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.46% (1.7681 => 2.1121, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.03% (1.8081 => 2.1521, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.76% (1.7481 => 2.0761, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 12.28% (0.2280 => 0.2560, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0084) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.7200 => 7.1440, std.dev.: 0.0322) MultiSource/Applications/spiff/spiff: 6.27% (1.0200 => 1.0840, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0125) MultiSource/Applications/SIBsim4/SIBsim4: 5.95% (1.6801 => 1.7801, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (11.7880 => 12.4880, std.dev.: 0.0566) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 5.59% (1.1440 => 1.2080, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (9.9842 => 10.4682, std.dev.: 0.0279) SingleSource/UnitTests/Vector/constpool: 4.84% (10.9087 => 11.4367, std.dev.: 0.1448) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.84% (0.2480 => 0.2600, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.41% (0.2720 => 0.2840, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.11% (2.0440 => 2.1280, std.dev.: 0.0130) MultiSource/Applications/d/make_dparser: 4.04% (3.9641 => 4.1241, std.dev.: 0.0184) MultiSource/Applications/lua/lua: 4.01% (4.7920 => 4.9840, std.dev.: 0.0346) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.8201 => 1.8921, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (1.6481 => 1.7121, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 3.65% (6.9124 => 7.1644, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.22% (6.8321 => 7.0521, std.dev.: 0.0314) MultiSource/Applications/SPASS/SPASS: 2.86% (18.4924 => 19.0206, std.dev.: 0.0414) MultiSource/Applications/JM/lencod/lencod: 2.78% (22.6287 => 23.2567, std.dev.: 0.0581) MultiSource/Applications/JM/ldecod/ldecod: 2.67% (10.3203 => 10.5963, std.dev.: 0.0295) MultiSource/Applications/treecc/treecc: 2.60% (2.6200 => 2.6880, std.dev.: 0.0254) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.36% (51.1089 => 52.3169, std.dev.: 0.0881) MultiSource/Applications/minisat/minisat: 2.34% (0.8560 => 0.8760, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 2.29% (19.7371 => 20.1891, std.dev.: 0.0652) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2203 => 4.3123, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 2.03% (38.9366 => 39.7286, std.dev.: 0.0551) MultiSource/Applications/ClamAV/clamscan: 1.92% (20.2445 => 20.6325, std.dev.: 0.0512) MultiSource/Benchmarks/MallocBench/gs/gs: 1.87% (5.5480 => 5.6520, std.dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (3.0122 => 3.0682, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (16.5963 => 16.8963, std.dev.: 0.0377) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0244 => 6.0964, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.06% (2.2721 => 2.2961, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.03% (25.1895 => 25.4495, std.dev.: 0.0459) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.2681 => 1.3721, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0270) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0358) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.54% (4.0923 => 4.1963, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0226) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.7563 => 4.8203, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4041 => 1.4201, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/nestedloop: -65.05% (2.9642 => 1.0361, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.70% (3.1762 => 1.2481, std.dev.: 0.0121) MultiSource/Applications/obsequi/Obsequi: -32.93% (2.6481 => 1.7760, std.dev.: 0.0230) MultiSource/Applications/sgefa/sgefa: -26.84% (0.7600 => 0.5560, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.95% (7.4801 => 6.2120, std.dev.: 0.0313) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.83% (7.5041 => 6.3160, std.dev.: 0.0295) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -3.37% (13.5243 => 13.0683, std.dev.: 0.0509) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.31% (3.4442 => 3.0202, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0193) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3401 => 2.3081, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.04% (8.8486 => 8.7565, std.dev.: 0.0117) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 13:24:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 15:24:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140402202425.6BF162A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24277?compare_to=24258&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24277, Order: 205426, Start Time: 2014-04-02 15:38:11, End Time: 2014-04-02 20:30:39 To: 24258, Order: 205393, Start Time: 2014-04-02 05:31:17, End Time: 2014-04-02 10:24:32 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 22 (135 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038) SingleSource/UnitTests/AtomicOps: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.50% (0.1280 => 0.1440, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 9.80% (0.2040 => 0.2240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.55% (0.2120 => 0.2280, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.82% (0.3520 => 0.3760, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.10% (0.7840 => 0.8240, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.75% (2.2921 => 2.3321, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.74% (2.0681 => 2.1041, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.63% (1.9601 => 1.9921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.60% (1.9961 => 2.0281, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (1.0041 => 1.0201, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.57% (2.0321 => 2.0641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.41% (1.9841 => 2.0121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.36% (2.3601 => 2.3921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.32% (2.1161 => 2.1441, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/aha/aha: -14.71% (0.1360 => 0.1160, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.48% (17.6723 => 19.5243, std.dev.: 0.0821) MultiSource/Applications/sqlite3/sqlite3: 1409.42% (1.7001 => 25.6616, std.dev.: 0.0578) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.12% (50.1010 => 51.6650, std.dev.: 0.0800) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (1.0520 => 1.0640, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.25% (11.3920 => 12.3320, std.dev.: 0.0580) SingleSource/Benchmarks/Misc/oourafft: 175.63% (11.3407 => 31.2580, std.dev.: 0.0696) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0203, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0082) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0061) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.14% (0.1160 => 0.1440, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.1280 => 0.1560, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.18% (0.0880 => 0.1040, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.99% (2.0281 => 2.3321, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.58% (0.1920 => 0.2200, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.28% (1.8201 => 2.0801, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.79% (0.1160 => 0.1320, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.91% (1.9521 => 2.2041, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.90% (0.3360 => 0.3760, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.41% (1.8441 => 2.0361, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.32% (1.9761 => 2.1801, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.88% (0.3240 => 0.3560, std.dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: 9.80% (0.2040 => 0.2240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0103) SingleSource/UnitTests/Vector/constpool: 8.92% (10.4007 => 11.3287, std.dev.: 0.1230) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.55% (0.6360 => 0.6840, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.4400 => 0.4720, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.2240 => 0.2400, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.67% (0.2400 => 0.2560, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0479) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3600 => 0.3800, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0176) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.57% (0.7880 => 0.8240, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0238) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0117) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (6.5320 => 6.7840, std.dev.: 0.0358) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (5.8281 => 6.0081, std.dev.: 0.0471) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (16.3003 => 16.7523, std.dev.: 0.0429) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.75% (6.5360 => 6.7160, std.dev.: 0.0476) MultiSource/Applications/JM/lencod/lencod: 2.61% (22.2206 => 22.8008, std.dev.: 0.0512) MultiSource/Applications/oggenc/oggenc: 2.44% (7.0524 => 7.2245, std.dev.: 0.0313) MultiSource/Benchmarks/Bullet/bullet: 2.16% (38.6366 => 39.4726, std.dev.: 0.0630) MultiSource/Applications/lua/lua: 2.00% (4.7920 => 4.8880, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 1.88% (18.5284 => 18.8764, std.dev.: 0.0505) MultiSource/Applications/JM/ldecod/ldecod: 1.64% (10.2283 => 10.3963, std.dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2243 => 4.2883, std.dev.: 0.0190) MultiSource/Applications/lemon/lemon: 1.08% (1.4881 => 1.5041, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.42% (2.1201 => 2.4682, std.dev.: 0.0389) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0282) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.24% (6.5964 => 6.7444, std.dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0126) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (26.3056 => 26.6617, std.dev.: 0.0332) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.73% (2.9562 => 0.6880, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: -7.25% (1.8760 => 1.7400, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.11% (94.8339 => 49.2111, std.dev.: 9.6822) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.95% (49.9431 => 32.9861, std.dev.: 0.3548) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.60% (25.7136 => 17.0731, std.dev.: 0.1423) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.0889) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.76% (37.0863 => 28.6458, std.dev.: 0.3465) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0221) MultiSource/Applications/lua/lua: -1.14% (21.8014 => 21.5533, std.dev.: 0.0552) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 13:45:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 15:45:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140402204529.CA3FB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24278?compare_to=24268&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24278, Order: 205426, Start Time: 2014-04-02 15:56:00, End Time: 2014-04-02 20:51:43 To: 24268, Order: 205409, Start Time: 2014-04-02 10:52:46, End Time: 2014-04-02 15:48:07 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 21 (149 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Regression/C/sumarray: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 14.29% (0.0840 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 9.68% (0.1240 => 0.1360, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.33% (0.1440 => 0.1560, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 5.19% (0.3080 => 0.3240, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 4.63% (0.4320 => 0.4520, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.83% (1.0440 => 1.0840, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: 3.60% (0.4440 => 0.4600, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.45% (1.5080 => 1.5600, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.31% (1.3841 => 1.4161, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (1.5521 => 1.5721, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.10% (1.4601 => 1.4761, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 6.33% (0.9481 => 1.0081, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/health/health: 6.19% (0.3880 => 0.4120, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.40% (0.8601 => 0.8721, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 1.02% (3.1522 => 3.1842, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.59% (1.3921 => 1.3561, std.dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0076) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 393.69% (0.2520 => 1.2441, std.dev.: 0.0177) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 275.91% (0.2320 => 0.8721, std.dev.: 0.0097) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0054) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0043) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0059) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0069) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0059) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.98% (0.7040 => 1.0840, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.00% (0.1600 => 0.2000, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0099) MultiSource/Applications/obsequi/Obsequi: 22.13% (1.3920 => 1.7000, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 18.95% (1.1401 => 1.3561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.77% (1.3001 => 1.5441, std.dev.: 0.0139) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.71% (1.1761 => 1.3961, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 18.32% (8.5802 => 10.1523, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.24% (1.1841 => 1.4001, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 17.93% (1.1601 => 1.3681, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 17.59% (1.2281 => 1.4441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.53% (1.2321 => 1.4481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.67% (1.2001 => 1.4001, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 15.27% (19.5406 => 22.5247, std.dev.: 0.0447) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.17% (5.3360 => 6.0921, std.dev.: 0.0404) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 12.72% (1.3521 => 1.5241, std.dev.: 0.0154) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.49% (1.7400 => 1.9400, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.36% (0.1760 => 0.1960, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/methcall: 10.53% (0.2280 => 0.2520, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 8.99% (11.3843 => 12.4083, std.dev.: 0.0315) MultiSource/Applications/oggenc/oggenc: 8.78% (6.2844 => 6.8364, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.12% (5.6680 => 6.1280, std.dev.: 0.0601) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.96% (5.7280 => 6.1840, std.dev.: 0.0575) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (11.4440 => 12.3200, std.dev.: 0.0448) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 6.58% (0.3040 => 0.3240, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.14% (9.5802 => 10.1682, std.dev.: 0.0561) SingleSource/Benchmarks/Shootout-C++/hash2: 5.65% (0.4960 => 0.5240, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.82% (0.3320 => 0.3480, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.4760 => 1.5400, std.dev.: 0.0175) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0282) SingleSource/UnitTests/Vector/constpool: 3.67% (11.0207 => 11.4247, std.dev.: 0.0777) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (6.8280 => 7.0760, std.dev.: 0.0369) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (1.0680 => 1.1040, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0462) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0065) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.01% (49.1529 => 50.6329, std.dev.: 0.0979) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: 2.56% (19.2243 => 19.7164, std.dev.: 0.0465) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.51% (1.4320 => 1.4680, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 1.99% (24.7575 => 25.2495, std.dev.: 0.0407) MultiSource/Applications/kimwitu++/kc: 1.50% (19.7491 => 20.0451, std.dev.: 0.0517) MultiSource/Benchmarks/Bullet/bullet: 1.19% (39.0726 => 39.5366, std.dev.: 0.0803) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.82% (0.3320 => 0.3480, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 2.87% (6.8204 => 7.0164, std.dev.: 0.0408) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9724 => 6.0804, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0186) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -8.29% (3.4722 => 3.1842, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0960) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -1.92% (4.9963 => 4.9003, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 14:52:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 16:52:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402215231.3063E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24279?compare_to=24273&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24279, Order: 205435, Start Time: 2014-04-02 17:09:30, End Time: 2014-04-02 21:58:47 To: 24273, Order: 205426, Start Time: 2014-04-02 15:01:54, End Time: 2014-04-02 19:49:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (91 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/div: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 20.51% (0.1560 => 0.1880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9121 => 0.9281, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.49% (1.3401 => 1.3601, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 4.64% (5.1683 => 5.4083, std.dev.: 0.0877) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0058) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.50% (1.1761 => 1.2761, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0387) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0217) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 4.98% (1.1240 => 1.1800, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0345) SingleSource/UnitTests/Vector/constpool: 4.85% (10.8967 => 11.4247, std.dev.: 0.0885) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0239) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0373) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0431) MultiSource/Applications/lua/lua: 3.10% (4.5200 => 4.6600, std.dev.: 0.0396) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0275) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (5.8400 => 5.9560, std.dev.: 0.0376) MultiSource/Applications/sqlite3/sqlite3: 1.95% (23.7574 => 24.2215, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.89% (2.1201 => 2.1601, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 1.73% (37.0925 => 37.7326, std.dev.: 0.0939) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0112) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.62% (48.1088 => 48.8890, std.dev.: 0.0846) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 1.23% (18.8170 => 19.0490, std.dev.: 0.0313) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0146) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 5.23% (6.6564 => 7.0044, std.dev.: 0.0362) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0087) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0069) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3361 => 2.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.13% (4.2403 => 4.1923, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 15:25:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 17:25:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402222554.35E362A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24280?compare_to=24279&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24280, Order: 205436, Start Time: 2014-04-02 17:46:38, End Time: 2014-04-02 22:32:08 To: 24279, Order: 205435, Start Time: 2014-04-02 17:09:30, End Time: 2014-04-02 21:58:47 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (89 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (1009 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/distray/distray: 14.29% (0.1120 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.59% (0.4640 => 0.4760, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (2.1601 => 2.1841, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.52% (0.3680 => 0.3920, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.20% (1.2201 => 1.3201, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.06% (0.2480 => 0.2680, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.05% (1.1921 => 1.2761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0677) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0436) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.85% (1.3681 => 1.4481, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: 4.37% (10.8967 => 11.3727, std.dev.: 0.0978) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0467) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0230) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0403) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0512) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0417) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0424) MultiSource/Applications/JM/lencod/lencod: 2.43% (17.6165 => 18.0445, std.dev.: 0.0618) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0280) MultiSource/Benchmarks/Bullet/bullet: 1.93% (37.0925 => 37.8085, std.dev.: 0.0430) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0148) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.66% (48.1088 => 48.9090, std.dev.: 0.0930) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 24.89% (0.9321 => 1.1641, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0073) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.08% (4.0643 => 4.1083, std.dev.: 0.0167) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (25.8896 => 26.1536, std.dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 16:08:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 18:08:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402230856.DD0072A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24281?compare_to=24280&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24281, Order: 205446, Start Time: 2014-04-02 18:28:09, End Time: 2014-04-02 23:15:10 To: 24280, Order: 205436, Start Time: 2014-04-02 17:46:38, End Time: 2014-04-02 22:32:08 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (103 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray-dbl: 200.00% (0.0080 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 27.27% (0.0440 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 10.34% (0.3480 => 0.3840, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0054) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.19% (0.7640 => 0.7960, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.43% (1.2841 => 1.3281, std.dev.: 0.0092) MultiSource/Applications/obsequi/Obsequi: 2.56% (1.2520 => 1.2840, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (0.9001 => 0.9201, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.9481 => 0.9681, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.88% (1.2761 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.38% (1.4481 => 1.4681, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.64% (0.0880 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7121 => 1.7321, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.86% (1.1281 => 1.2281, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.62% (1.1601 => 1.2601, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0775) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0369) SingleSource/UnitTests/Vector/constpool: 5.80% (10.8967 => 11.5287, std.dev.: 0.1230) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0505) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.29% (0.6520 => 0.6800, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.19% (0.7640 => 0.7960, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0471) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (10.4082 => 10.7002, std.dev.: 0.0448) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0421) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0262) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0319) MultiSource/Benchmarks/Bullet/bullet: 2.00% (37.0925 => 37.8325, std.dev.: 0.0657) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0080) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.69% (48.1088 => 48.9210, std.dev.: 0.0908) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0182) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0208) MultiSource/Applications/kimwitu++/kc: 1.04% (18.8170 => 19.0130, std.dev.: 0.0412) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 31.58% (0.0760 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0293) MultiSource/Applications/lua/lua: 1.34% (21.1533 => 21.4373, std.dev.: 0.0476) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 16:24:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 18:24:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140402232409.39B552A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24282?compare_to=24281&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24282, Order: 205447, Start Time: 2014-04-02 18:38:40, End Time: 2014-04-02 23:30:23 To: 24281, Order: 205446, Start Time: 2014-04-02 18:28:09, End Time: 2014-04-02 23:15:10 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (101 on baseline) Performance Improvements: 2 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 200.00% (0.0080 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.91% (0.4040 => 0.4400, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.05% (0.3960 => 0.4160, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.61% (1.2401 => 1.2601, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 6.06% (3.9602 => 4.2003, std.dev.: 0.0751) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -16.00% (0.1000 => 0.0840, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (2.3241 => 2.3001, std.dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0059) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.57% (0.3680 => 0.4400, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.42% (1.2401 => 1.3321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0684) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0203) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.03% (8.1441 => 8.4721, std.dev.: 0.0511) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: 3.41% (10.8967 => 11.2687, std.dev.: 0.1280) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (4.9200 => 5.0400, std.dev.: 0.0340) MultiSource/Applications/JM/lencod/lencod: 2.36% (17.6165 => 18.0325, std.dev.: 0.0652) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0358) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0428) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.05% (48.1088 => 49.0929, std.dev.: 0.0571) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 1.78% (37.0925 => 37.7525, std.dev.: 0.0719) MultiSource/Applications/sqlite3/sqlite3: 1.77% (23.7574 => 24.1775, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: 1.11% (18.8170 => 19.0250, std.dev.: 0.0532) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0216) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 5.11% (3.9962 => 4.2003, std.dev.: 0.0751) MultiSource/Applications/minisat/minisat: 4.45% (6.6564 => 6.9524, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.46% (21.1533 => 21.4613, std.dev.: 0.0810) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0030) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0583) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3361 => 2.3001, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 17:10:21 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 17:10:21 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140403001025.0A7E54EF71F0@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/723 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205393 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpOKjFJoexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpOKjFJoexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpoP2WmPexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpoP2WmPexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Wed Apr 2 17:37:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 19:37:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403003747.E74122A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24283?compare_to=24282&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24283, Order: 205453, Start Time: 2014-04-02 19:56:34, End Time: 2014-04-03 00:44:00 To: 24282, Order: 205447, Start Time: 2014-04-02 18:38:40, End Time: 2014-04-02 23:30:23 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (97 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 23.53% (0.0680 => 0.0840, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.00% (0.1600 => 0.1760, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.33% (0.3000 => 0.3280, std.dev.: 0.0088) SingleSource/Regression/C++/ofstream_ctor: 5.17% (0.2320 => 0.2440, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.58% (1.2641 => 1.2841, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.04% (2.3001 => 2.3241, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0039) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0115) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.26% (0.1560 => 0.1720, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0107) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.11% (1.1841 => 1.2801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/em3d/em3d: 8.00% (0.2000 => 0.2160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.3040 => 0.3280, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.87% (1.2201 => 1.3161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.24% (1.2161 => 1.3041, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.60% (1.2721 => 1.3561, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0557) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.39% (1.2521 => 1.3321, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.37% (1.1921 => 1.2561, std.dev.: 0.0194) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.68% (8.1441 => 8.4441, std.dev.: 0.0450) MultiSource/Applications/lua/lua: 3.10% (4.5200 => 4.6600, std.dev.: 0.0340) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (10.4082 => 10.7122, std.dev.: 0.0418) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.8000 => 5.9600, std.dev.: 0.0519) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0109) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0530) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (4.9200 => 5.0280, std.dev.: 0.0376) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.99% (23.7574 => 24.2295, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (4.9000 => 4.9920, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (7.8562 => 7.9802, std.dev.: 0.0278) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.55% (48.1088 => 48.8530, std.dev.: 0.0948) MultiSource/Benchmarks/Bullet/bullet: 1.15% (37.0925 => 37.5205, std.dev.: 0.1230) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0397) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.50% (3.3802 => 3.5322, std.dev.: 0.0569) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0224) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0614) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -21.05% (0.0760 => 0.0600, std.dev.: 0.0058) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.03% (1.2601 => 1.1841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.02% (2.3881 => 2.2681, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0067) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 17:58:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 19:58:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403005817.170662A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24284?compare_to=24274&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24284, Order: 205455, Start Time: 2014-04-02 20:15:16, End Time: 2014-04-03 01:04:31 To: 24274, Order: 205426, Start Time: 2014-04-02 15:18:40, End Time: 2014-04-02 20:07:48 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 166.67% (0.0120 => 0.0320, std.dev.: 0.0020) SingleSource/UnitTests/2008-04-18-LoopBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 54.55% (0.0440 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/IntMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.67% (0.0600 => 0.0760, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.11% (0.1440 => 0.1600, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.84% (0.2480 => 0.2600, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.52% (0.7960 => 0.8320, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 5.04% (0.9521 => 1.0001, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.81% (1.7721 => 1.7401, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.4962 => 2.4642, std.dev.: 0.0115) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0145) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 17:59:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 19:59:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403005921.E3BEF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24285?compare_to=24275&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24285, Order: 205455, Start Time: 2014-04-02 20:16:01, End Time: 2014-04-03 01:05:40 To: 24275, Order: 205426, Start Time: 2014-04-02 15:18:41, End Time: 2014-04-02 20:08:42 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 8 (120 on baseline) Performance Improvements: 3 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (969 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.21% (1.6481 => 1.6681, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -12.50% (0.1280 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.52% (0.4760 => 0.4640, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.84% (11.3687 => 31.2460, std.dev.: 0.0640) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0119) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0067) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: 11.90% (0.3360 => 0.3760, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.71% (0.1120 => 0.1240, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.32% (0.6200 => 0.6840, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.74% (1.5601 => 1.7121, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/em3d/em3d: 9.62% (0.2080 => 0.2280, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.17% (1.4401 => 1.5721, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/05-eks/eks: 9.09% (0.6600 => 0.7200, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.78% (1.5481 => 1.6841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.72% (1.6521 => 1.7961, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.49% (1.4601 => 1.5841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.36% (1.4841 => 1.6081, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.20% (1.0240 => 1.1080, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.11% (0.1480 => 0.1600, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.88% (1.7761 => 1.9161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.73% (1.5521 => 1.6721, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.69% (1.6121 => 1.7361, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0066) SingleSource/UnitTests/Vector/constpool: 7.60% (10.6247 => 11.4327, std.dev.: 0.1043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.33% (1.5281 => 1.6401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0082) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.50% (1.7841 => 1.9001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.22% (1.4801 => 1.5721, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (6.4680 => 6.8480, std.dev.: 0.0392) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.77% (1.4561 => 1.5401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.67% (1.6921 => 1.7881, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.57% (11.6440 => 12.2920, std.dev.: 0.0599) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.19% (9.4842 => 9.9762, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (5.8121 => 6.1081, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0133) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.5600 => 1.6360, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.63% (1.4681 => 1.5361, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.60% (1.7401 => 1.8201, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.0443 => 10.4963, std.dev.: 0.0469) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.7400 => 1.8120, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (5.3600 => 5.5640, std.dev.: 0.0341) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.72% (2.0440 => 2.1200, std.dev.: 0.0198) MultiSource/Applications/JM/lencod/lencod: 3.66% (21.9606 => 22.7648, std.dev.: 0.0471) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0143) MultiSource/Applications/lua/lua: 3.51% (4.7880 => 4.9560, std.dev.: 0.0265) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (1.6601 => 1.7161, std.dev.: 0.0086) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.32% (50.0290 => 51.6890, std.dev.: 0.1061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (2.3281 => 2.4042, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.26% (6.5080 => 6.7200, std.dev.: 0.0457) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.18% (6.5440 => 6.7520, std.dev.: 0.0537) MultiSource/Applications/oggenc/oggenc: 3.15% (6.9844 => 7.2044, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (3.0282 => 3.1122, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (4.1843 => 4.2923, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 2.54% (18.4404 => 18.9086, std.dev.: 0.0370) MultiSource/Benchmarks/Bullet/bullet: 2.46% (38.4046 => 39.3486, std.dev.: 0.0745) MultiSource/Applications/ClamAV/clamscan: 2.12% (19.0444 => 19.4484, std.dev.: 0.0562) MultiSource/Applications/d/make_dparser: 2.12% (3.9681 => 4.0521, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (16.3483 => 16.6883, std.dev.: 0.0381) MultiSource/Applications/siod/siod: 1.77% (2.7162 => 2.7642, std.dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 1.46% (19.6891 => 19.9771, std.dev.: 0.0490) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.97% (0.9241 => 1.1641, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0460) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0244) MultiSource/Applications/siod/siod: 5.59% (2.8602 => 3.0202, std.dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1245 => 8.2125, std.dev.: 0.0272) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.90% (2.9442 => 0.6800, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.00% (0.0640 => 0.0480, std.dev.: 0.0062) MultiSource/Applications/obsequi/Obsequi: -7.07% (1.8680 => 1.7360, std.dev.: 0.0267) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -45.96% (91.8497 => 49.6311, std.dev.: 8.2354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.61% (50.3031 => 32.8941, std.dev.: 0.2098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.50% (26.0616 => 17.0691, std.dev.: 0.1342) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.36% (42.1466 => 28.5098, std.dev.: 0.3768) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.0892) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 18:22:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 20:22:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140403012226.C70B82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24286?compare_to=24276&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24286, Order: 205457, Start Time: 2014-04-02 20:37:16, End Time: 2014-04-03 01:28:44 To: 24276, Order: 205426, Start Time: 2014-04-02 15:38:08, End Time: 2014-04-02 20:29:56 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (114 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (966 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/printargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.33% (0.0840 => 0.1120, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.56% (0.1800 => 0.2080, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.12% (0.1960 => 0.2080, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 3.60% (0.5560 => 0.5760, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.34% (0.2320 => 0.2560, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -3.15% (1.7801 => 1.7241, std.dev.: 0.0172) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.90% (1.6881 => 2.0241, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.73% (1.7641 => 2.1121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.72% (1.7241 => 2.0641, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.62% (1.6721 => 2.0001, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.46% (1.7681 => 2.1121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.20% (1.7921 => 2.1361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.07% (1.7201 => 2.0481, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.99% (1.9801 => 2.3561, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.56% (1.7241 => 2.0441, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.46% (1.8201 => 2.1561, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.55% (1.9601 => 2.3041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.97% (1.9801 => 2.3161, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.64% (0.1880 => 0.2080, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (11.7880 => 12.5040, std.dev.: 0.0633) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.7280 => 1.8200, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.00% (6.7200 => 7.0560, std.dev.: 0.0626) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0103) SingleSource/UnitTests/Vector/constpool: 4.69% (10.9087 => 11.4207, std.dev.: 0.1042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.67% (1.5240 => 1.5800, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.64% (1.6481 => 1.7081, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (2.0680 => 2.1400, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.4680 => 0.4840, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (6.8321 => 7.0641, std.dev.: 0.0288) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0087) MultiSource/Applications/d/make_dparser: 3.23% (3.9641 => 4.0921, std.dev.: 0.0239) MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.1440 => 1.1800, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.08% (9.9842 => 10.2922, std.dev.: 0.0747) MultiSource/Applications/oggenc/oggenc: 2.95% (6.9124 => 7.1164, std.dev.: 0.0295) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.92% (1.3720 => 1.4120, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.6120 => 0.6280, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 2.49% (18.4924 => 18.9526, std.dev.: 0.0232) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (10.3203 => 10.5763, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (2.0440 => 2.0920, std.dev.: 0.0182) MultiSource/Applications/JM/lencod/lencod: 2.23% (22.6287 => 23.1327, std.dev.: 0.0618) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.07% (51.1089 => 52.1689, std.dev.: 0.0806) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 1.74% (19.7371 => 20.0811, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.73% (3.0122 => 3.0642, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (16.5963 => 16.8443, std.dev.: 0.0387) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (6.0244 => 6.1084, std.dev.: 0.0172) MultiSource/Benchmarks/Bullet/bullet: 1.36% (38.9366 => 39.4646, std.dev.: 0.1308) MultiSource/Applications/sqlite3/sqlite3: 1.08% (25.1895 => 25.4615, std.dev.: 0.0390) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.92% (1.2121 => 1.3081, std.dev.: 0.0356) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0153) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0359) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.25% (4.0923 => 4.1843, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (1.2921 => 1.3121, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.43% (4.7563 => 4.8243, std.dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.69% (6.2884 => 1.3401, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/nestedloop: -65.32% (2.9642 => 1.0281, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0089) SingleSource/UnitTests/SignlessTypes/factor: -44.44% (0.0360 => 0.0200, std.dev.: 0.0058) MultiSource/Applications/obsequi/Obsequi: -33.69% (2.6481 => 1.7560, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.38% (7.4801 => 6.1800, std.dev.: 0.0535) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -17.11% (7.5041 => 6.2200, std.dev.: 0.0505) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: -3.76% (13.5243 => 13.0163, std.dev.: 0.0588) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.39% (5.8884 => 5.5123, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0096) MultiSource/Applications/lambda-0_1_3/lambda: -2.25% (5.1603 => 5.0443, std.dev.: 0.0243) MultiSource/Benchmarks/sim/sim: -1.68% (4.9883 => 4.9043, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 18:24:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 20:24:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140403012423.BCA3D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24287?compare_to=24277&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24287, Order: 205457, Start Time: 2014-04-02 20:37:53, End Time: 2014-04-03 01:30:40 To: 24277, Order: 205426, Start Time: 2014-04-02 15:38:11, End Time: 2014-04-02 20:30:39 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (115 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (966 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) MultiSource/Applications/aha/aha: 13.79% (0.1160 => 0.1320, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/distray/distray: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.57% (0.1400 => 0.1520, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 5.33% (0.3000 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.27% (2.2041 => 2.2321, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/strcat: 20.00% (0.1200 => 0.1440, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.00% (0.1000 => 0.1120, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.50% (17.6723 => 19.5284, std.dev.: 0.0499) MultiSource/Applications/sqlite3/sqlite3: 1414.59% (1.7001 => 25.7496, std.dev.: 0.0387) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.16% (50.1010 => 51.6850, std.dev.: 0.0931) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (1.0520 => 1.0680, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (11.3920 => 12.2640, std.dev.: 0.0650) SingleSource/Benchmarks/Misc/oourafft: 175.66% (11.3407 => 31.2620, std.dev.: 0.0926) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0003, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0126) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0112) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0061) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.88% (1.8281 => 2.1001, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.39% (1.9721 => 2.2361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.36% (1.9161 => 2.1721, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.90% (1.8921 => 2.1361, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.76% (1.9121 => 2.1561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.94% (2.1441 => 2.4001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (1.9761 => 2.2041, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.06% (1.8081 => 2.0081, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.69% (0.6360 => 0.7040, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.11% (1.8201 => 2.0041, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.80% (1.7961 => 1.9721, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.79% (1.8801 => 2.0641, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.68% (0.3720 => 0.4080, std.dev.: 0.0119) SingleSource/UnitTests/Vector/constpool: 9.46% (10.4007 => 11.3847, std.dev.: 0.1026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.67% (0.2400 => 0.2560, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.95% (0.3360 => 0.3560, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (6.4800 => 6.8440, std.dev.: 0.0333) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0153) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.19% (0.6160 => 0.6480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.6960 => 1.7760, std.dev.: 0.0184) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.96% (9.6042 => 9.9842, std.dev.: 0.0269) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (6.5320 => 6.7840, std.dev.: 0.0406) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.16% (5.8281 => 6.0121, std.dev.: 0.0400) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0324) MultiSource/Applications/treecc/treecc: 2.63% (2.5880 => 2.6560, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (1.0840 => 1.1120, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 2.55% (7.0524 => 7.2325, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.54% (1.5760 => 1.6160, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (2.3401 => 2.3921, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 2.20% (22.2206 => 22.7087, std.dev.: 0.0518) MultiSource/Applications/lua/lua: 2.17% (4.7920 => 4.8960, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.84% (16.3003 => 16.6003, std.dev.: 0.0618) MultiSource/Applications/SPASS/SPASS: 1.79% (18.5284 => 18.8604, std.dev.: 0.0539) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0135) MultiSource/Benchmarks/Bullet/bullet: 1.59% (38.6366 => 39.2526, std.dev.: 0.0817) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.55% (2.1201 => 2.4922, std.dev.: 0.0582) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 2.24% (6.5964 => 6.7444, std.dev.: 0.0376) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (3.9442 => 4.0042, std.dev.: 0.0175) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (26.3056 => 26.6457, std.dev.: 0.0433) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.19% (2.9562 => 0.7040, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0062) MultiSource/Applications/obsequi/Obsequi: -7.04% (1.8760 => 1.7440, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.21% (94.8339 => 49.1191, std.dev.: 8.9934) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.92% (49.9431 => 33.0021, std.dev.: 0.2671) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.77% (25.7136 => 17.0291, std.dev.: 0.1530) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.92% (3.0722 => 2.3681, std.dev.: 0.0865) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.58% (37.0863 => 29.0818, std.dev.: 0.3369) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.33% (4.8043 => 4.6923, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0192) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 18:49:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 20:49:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140403014925.A8E2E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24288?compare_to=24278&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24288, Order: 205459, Start Time: 2014-04-02 20:59:56, End Time: 2014-04-03 01:55:34 To: 24278, Order: 205426, Start Time: 2014-04-02 15:56:00, End Time: 2014-04-02 20:51:43 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 21 (155 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-3: 140.00% (0.0200 => 0.0480, std.dev.: 0.0037) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0560 => 0.0680, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 14.29% (0.0840 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.38% (0.1880 => 0.2000, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 6.15% (0.2600 => 0.2760, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 6.00% (0.2000 => 0.2120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.36% (1.3561 => 1.3881, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.01% (1.3961 => 1.4241, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: 1.90% (1.4761 => 1.5041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.81% (1.5441 => 1.5721, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.78% (1.8000 => 1.8320, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.38% (1.4441 => 1.4641, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 1.31% (2.7482 => 2.7842, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 7.94% (0.2520 => 0.2720, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.41% (0.3120 => 0.3320, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: 3.32% (2.1681 => 2.2401, std.dev.: 0.0233) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.06% (4.4603 => 4.5523, std.dev.: 0.0314) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1987.50% (0.0320 => 0.6680, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0107) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 396.87% (0.2520 => 1.2521, std.dev.: 0.0137) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0074) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-3: 71.43% (0.0280 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0072) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0024) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 48.86% (0.7040 => 1.0480, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 47.37% (0.0760 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.80% (1.2321 => 1.4761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: 19.25% (1.3920 => 1.6600, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.11% (1.1721 => 1.3961, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.84% (1.1881 => 1.4001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0169) MultiSource/Applications/JM/ldecod/ldecod: 17.76% (8.5802 => 10.1043, std.dev.: 0.0698) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0105) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 15.09% (19.5406 => 22.4887, std.dev.: 0.0672) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.77% (5.3360 => 6.1241, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.64% (0.1760 => 0.2000, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0305) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 9.59% (11.3843 => 12.4763, std.dev.: 0.0392) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0191) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.11% (0.4440 => 0.4800, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 7.81% (0.2560 => 0.2760, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (5.6680 => 6.1000, std.dev.: 0.0485) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.12% (5.7280 => 6.1360, std.dev.: 0.0567) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (11.4440 => 12.2480, std.dev.: 0.0721) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (9.5802 => 10.2482, std.dev.: 0.0319) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.79% (0.6480 => 0.6920, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.42% (0.8721 => 0.9281, std.dev.: 0.0080) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (1.1240 => 1.1920, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.77% (1.7320 => 1.8320, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0240) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.1480 => 1.2000, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.7360 => 0.7680, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (6.8280 => 7.0840, std.dev.: 0.0451) MultiSource/Applications/lua/lua: 3.69% (4.7720 => 4.9480, std.dev.: 0.0311) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (1.3400 => 1.3840, std.dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.03% (49.1529 => 50.6409, std.dev.: 0.1191) MultiSource/Applications/ClamAV/clamscan: 2.46% (19.2243 => 19.6964, std.dev.: 0.0588) MultiSource/Applications/sqlite3/sqlite3: 2.41% (24.7575 => 25.3535, std.dev.: 0.0354) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 1.56% (19.7491 => 20.0571, std.dev.: 0.0551) MultiSource/Benchmarks/Bullet/bullet: 1.54% (39.0726 => 39.6726, std.dev.: 0.0693) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0124 => 6.0924, std.dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0224) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.84% (3.2362 => 3.3282, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.3085 => 7.4845, std.dev.: 0.0378) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (25.4536 => 25.7136, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0012) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0888) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.19% (2.9162 => 2.8522, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -2.00% (4.9963 => 4.8963, std.dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/fldry: -2.00% (0.6000 => 0.5880, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.0963 => 5.0323, std.dev.: 0.0206) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 19:48:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 21:48:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403024836.7887A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24289?compare_to=24283&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24289, Order: 205468, Start Time: 2014-04-02 22:07:11, End Time: 2014-04-03 02:54:49 To: 24283, Order: 205453, Start Time: 2014-04-02 19:56:34, End Time: 2014-04-03 00:44:00 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 21 (97 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2005-11-29-LongSwitch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 25.00% (0.0640 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: 16.13% (0.1240 => 0.1440, std.dev.: 0.0070) SingleSource/Benchmarks/Stanford/Puzzle: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.47% (0.2360 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.65% (0.3440 => 0.3600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.82% (1.2561 => 1.3041, std.dev.: 0.0103) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.76% (1.3041 => 1.3401, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.29% (1.2241 => 1.2521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.77% (1.3561 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.62% (1.2361 => 1.2561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.61% (1.2401 => 1.2601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.55% (1.2881 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (10.7122 => 10.8202, std.dev.: 0.0214) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 1.97% (0.6080 => 0.6200, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.4562 => 2.4282, std.dev.: 0.0101) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0032) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (10.6960 => 11.3560, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.7080 => 1.7920, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: 4.77% (10.8967 => 11.4167, std.dev.: 0.0867) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0150) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0314) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0141) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0329) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.90% (5.8000 => 5.9680, std.dev.: 0.0468) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0615) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0468) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0532) MultiSource/Benchmarks/Bullet/bullet: 2.12% (37.0925 => 37.8805, std.dev.: 0.0541) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.85% (48.1088 => 49.0009, std.dev.: 0.0605) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0133) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (7.8562 => 7.9842, std.dev.: 0.0387) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0396) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 1.68% (21.1533 => 21.5093, std.dev.: 0.1133) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.26% (0.5320 => 0.5040, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.03% (1.2601 => 1.1841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.4562 => 2.4282, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 20:19:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 22:19:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403031943.39F3B2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24290?compare_to=24289&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24290, Order: 205473, Start Time: 2014-04-02 22:40:51, End Time: 2014-04-03 03:25:51 To: 24289, Order: 205468, Start Time: 2014-04-02 22:07:11, End Time: 2014-04-03 02:54:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (87 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (1009 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.00% (0.1000 => 0.1240, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.50% (0.1280 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 6.33% (0.3160 => 0.3360, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.25% (0.1920 => 0.2040, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.00% (0.0800 => 0.0920, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.68% (0.2480 => 0.2720, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4282 => 2.4562, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -15.00% (0.0800 => 0.0680, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 29.17% (0.0960 => 0.1240, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (10.6960 => 11.3960, std.dev.: 0.0882) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (6.0160 => 6.3640, std.dev.: 0.0485) SingleSource/UnitTests/Vector/constpool: 4.66% (10.8967 => 11.4047, std.dev.: 0.0832) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0292) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0228) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (5.8000 => 5.9720, std.dev.: 0.0473) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0215) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0376) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0247) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (4.9200 => 5.0400, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0299) MultiSource/Benchmarks/Bullet/bullet: 1.90% (37.0925 => 37.7965, std.dev.: 0.0685) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0605) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0314) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0141) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.60% (48.1088 => 48.8770, std.dev.: 0.0823) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.8322 => 2.8682, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0278) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.68% (0.2480 => 0.2720, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 5.23% (6.6564 => 7.0044, std.dev.: 0.0189) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 20:38:16 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 20:38:16 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140403033832.7EAFF4EF9401@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14378 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205508 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': LLVM :: ExecutionEngine/MCJIT/remote/cross-module-a.ll LLVM :: ExecutionEngine/MCJIT/remote/cross-module-sm-pic-a.ll LLVM :: ExecutionEngine/MCJIT/remote/multi-module-a.ll LLVM :: ExecutionEngine/MCJIT/remote/multi-module-sm-pic-a.ll LLVM :: ExecutionEngine/MCJIT/stubs-sm-pic.ll LLVM :: ExecutionEngine/MCJIT/stubs.ll LLVM :: ExecutionEngine/MCJIT/test-call.ll LLVM :: ExecutionEngine/MCJIT/test-fp.ll Expected Passes : 17445 Expected Failures : 101 Unsupported Tests : 43 Unexpected Failures: 21 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::2003-08-21-EnvironmentTest.ll': 7 lli 0x000000010220eb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010220b5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010220e380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000102203c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000102203ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000101c1fd5e main + 6942 13 lli 0x0000000101c18d34 start + 52 14 lli 0x0000000000000003 start + 4265505539 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2003-08-21-EnvironmentTest.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/2003-08-21-EnvironmentTest.ll.script: line 1: 218 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2003-08-21-EnvironmentTest.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::2002-12-16-ArgTest.ll': 6 lli 0x000000010ab5a8ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x000000010aad2b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010aacf5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010aad2380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010aac7c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010aac7ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010a4e3d5e main + 6942 13 lli 0x000000010a4dcd34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2002-12-16-ArgTest.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/2002-12-16-ArgTest.ll.script: line 1: 192 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2002-12-16-ArgTest.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::2003-05-07-ArgumentTest.ll': 6 lli 0x00000001084668ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x00000001083deb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001083db5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x00000001083de380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x00000001083d3c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x00000001083d3ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000107defd5e main + 6942 13 lli 0x0000000107de8d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2003-05-07-ArgumentTest.ll test /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/2003-05-07-ArgumentTest.ll.script: line 1: 207 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2003-05-07-ArgumentTest.ll test -- ******************** Last 15 lines of 'LLVM::cross-module-a.ll': 7 lli 0x000000010c8d6b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010c8d35ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010c8d6380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010c8cbc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010c8cbee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010c2e7d5e main + 6942 13 lli 0x000000010c2e0d34 start + 52 14 lli 0x0000000000000004 start + 4090622724 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/cross-module-b.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/cross-module-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/cross-module-a.ll.script: line 1: 235 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/cross-module-b.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/cross-module-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::cross-module-sm-pic-a.ll': 7 lli 0x000000010e813b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010e8105ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010e813380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010e808c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010e808ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010e224d5e main + 6942 13 lli 0x000000010e21dd34 start + 52 14 lli 0x0000000000000006 start + 4057867014 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/cross-module-b.ll -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/cross-module-sm-pic-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/cross-module-sm-pic-a.ll.script: line 1: 237 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/cross-module-b.ll -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/cross-module-sm-pic-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::eh-lg-pic.ll': 6 lli 0x000000010f87e8ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x000000010f7f6b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010f7f35ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010f7f6380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010f7ebc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010f7ebee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010f207d5e main + 6942 13 lli 0x000000010f200d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -relocation-model=pic -code-model=large /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/eh-lg-pic.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/eh-lg-pic.ll.script: line 1: 239 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -relocation-model=pic -code-model=large /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/eh-lg-pic.ll -- ******************** Last 15 lines of 'LLVM::eh.ll': 6 lli 0x000000010f1478ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x000000010f0bfb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010f0bc5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010f0bf380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010f0b4c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010f0b4ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010ead0d5e main + 6942 13 lli 0x000000010eac9d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/eh.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/eh.ll.script: line 1: 243 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/eh.ll -- ******************** Last 15 lines of 'LLVM::hello.ll': 7 lli 0x000000010604ab04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001060475ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010604a380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010603fc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010603fee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000105a5bd5e main + 6942 13 lli 0x0000000105a54d34 start + 52 14 lli 0x0000000000000003 start + 4200248067 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/hello.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/hello.ll.script: line 1: 250 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/hello.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::hello2.ll': 7 lli 0x0000000109b5eb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x0000000109b5b5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000109b5e380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000109b53c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000109b53ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010956fd5e main + 6942 13 lli 0x0000000109568d34 start + 52 14 lli 0x0000000000000003 start + 4138300163 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/hello2.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/hello2.ll.script: line 1: 252 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/hello2.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::load-object-a.ll': 6 lli 0x00000001023328ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x00000001022aab04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001022a75ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x00000001022aa380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010229fc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010229fee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000101cbbd5e main + 6942 13 lli 0x0000000101cb4d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll -enable-cache-manager -object-cache-dir=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/load-object-a.ll.tmp.cachedir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/load-object-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/load-object-a.ll.script: line 8: 256 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll -enable-cache-manager -object-cache-dir=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/load-object-a.ll.tmp.cachedir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/load-object-a.ll -- ******************** Last 15 lines of 'LLVM::multi-module-a.ll': 6 lli 0x0000000102fc38ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x0000000102f3bb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x0000000102f385ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000102f3b380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000102f30c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000102f30ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010294cd5e main + 6942 13 lli 0x0000000102945d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/multi-module-a.ll.script: line 1: 258 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::multi-module-eh-a.ll': 6 lli 0x00000001022bf8ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x0000000102237b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001022345ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000102237380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010222cc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010222cee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000101c48d5e main + 6942 13 lli 0x0000000101c41d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-eh-b.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-eh-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/multi-module-eh-a.ll.script: line 1: 260 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-eh-b.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-eh-a.ll -- ******************** Last 15 lines of 'LLVM::multi-module-sm-pic-a.ll': 6 lli 0x00000001050b88ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x0000000105030b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010502d5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000105030380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000105025c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000105025ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000104a41d5e main + 6942 13 lli 0x0000000104a3ad34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-sm-pic-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/multi-module-sm-pic-a.ll.script: line 1: 262 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-sm-pic-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::cross-module-a.ll': 8 lli 0x000000010c37e5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010c381380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010c376c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010c377693 llvm::MCJIT::getSymbolAddress(std::__1::basic_string, std::__1::allocator > const&, bool) + 419 12 lli 0x000000010c3777b0 llvm::MCJIT::getFunctionAddress(std::__1::basic_string, std::__1::allocator > const&) + 48 13 lli 0x000000010bd93333 main + 8435 14 lli 0x000000010bd8bd34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/cross-module-b.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/cross-module-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/remote/Output/cross-module-a.ll.script: line 1: 270 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/cross-module-b.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/cross-module-a.ll > /dev/null RPC Error: ReadBytes: Expecting 4 bytes, Got 0 -- ******************** Last 15 lines of 'LLVM::cross-module-sm-pic-a.ll': 8 lli 0x0000000104f1c5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000104f1f380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000104f14c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000104f15693 llvm::MCJIT::getSymbolAddress(std::__1::basic_string, std::__1::allocator > const&, bool) + 419 12 lli 0x0000000104f157b0 llvm::MCJIT::getFunctionAddress(std::__1::basic_string, std::__1::allocator > const&) + 48 13 lli 0x0000000104931333 main + 8435 14 lli 0x0000000104929d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/cross-module-b.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/cross-module-sm-pic-a.ll RPC Error: ReadBytes: Expecting 4 bytes, Got 0 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/remote/Output/cross-module-sm-pic-a.ll.script: line 1: 273 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/cross-module-b.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/cross-module-sm-pic-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::multi-module-a.ll': 8 lli 0x000000010900e5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000109011380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000109006c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000109007693 llvm::MCJIT::getSymbolAddress(std::__1::basic_string, std::__1::allocator > const&, bool) + 419 12 lli 0x00000001090077b0 llvm::MCJIT::getFunctionAddress(std::__1::basic_string, std::__1::allocator > const&) + 48 13 lli 0x0000000108a23333 main + 8435 14 lli 0x0000000108a1bd34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-c.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/multi-module-a.ll RPC Error: ReadBytes: Expecting 4 bytes, Got 0 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/remote/Output/multi-module-a.ll.script: line 1: 276 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-c.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/multi-module-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::multi-module-sm-pic-a.ll': 8 lli 0x000000010e17d5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010e180380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010e175c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010e176693 llvm::MCJIT::getSymbolAddress(std::__1::basic_string, std::__1::allocator > const&, bool) + 419 12 lli 0x000000010e1767b0 llvm::MCJIT::getFunctionAddress(std::__1::basic_string, std::__1::allocator > const&) + 48 13 lli 0x000000010db92333 main + 8435 14 lli 0x000000010db8ad34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-c.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/multi-module-sm-pic-a.ll RPC Error: ReadBytes: Expecting 4 bytes, Got 0 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/remote/Output/multi-module-sm-pic-a.ll.script: line 1: 279 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-c.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/multi-module-sm-pic-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::stubs.ll': 6 lli 0x000000010f8378ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x000000010f7afb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010f7ac5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010f7af380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010f7a4c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010f7a4ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010f1c0d5e main + 6942 13 lli 0x000000010f1b9d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -disable-lazy-compilation=false /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/stubs.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/stubs.ll.script: line 1: 315 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -disable-lazy-compilation=false /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/stubs.ll -- ******************** Last 15 lines of 'LLVM::stubs-sm-pic.ll': 7 lli 0x0000000101526b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001015235ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000101526380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010151bc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010151bee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000100f37d5e main + 6942 13 lli 0x0000000100f30d34 start + 52 14 lli 0x0000000000000006 start + 4279038726 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -disable-lazy-compilation=false -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/stubs-sm-pic.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/stubs-sm-pic.ll.script: line 1: 314 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -disable-lazy-compilation=false -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/stubs-sm-pic.ll -- ******************** Last 15 lines of 'LLVM::test-call.ll': 7 lli 0x00000001099f7b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001099f45ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x00000001099f7380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x00000001099ecc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x00000001099ecee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000109408d5e main + 6942 13 lli 0x0000000109401d34 start + 52 14 lli 0x0000000000000003 start + 4139770627 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/test-call.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/test-call.ll.script: line 1: 323 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/test-call.ll > /dev/null -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 20:38:16 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 20:38:16 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140403033832.7D7F34EF9400@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14378 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 205508 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': LLVM :: ExecutionEngine/MCJIT/remote/cross-module-a.ll LLVM :: ExecutionEngine/MCJIT/remote/cross-module-sm-pic-a.ll LLVM :: ExecutionEngine/MCJIT/remote/multi-module-a.ll LLVM :: ExecutionEngine/MCJIT/remote/multi-module-sm-pic-a.ll LLVM :: ExecutionEngine/MCJIT/stubs-sm-pic.ll LLVM :: ExecutionEngine/MCJIT/stubs.ll LLVM :: ExecutionEngine/MCJIT/test-call.ll LLVM :: ExecutionEngine/MCJIT/test-fp.ll Expected Passes : 17445 Expected Failures : 101 Unsupported Tests : 43 Unexpected Failures: 21 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::2003-08-21-EnvironmentTest.ll': 7 lli 0x000000010220eb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010220b5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010220e380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000102203c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000102203ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000101c1fd5e main + 6942 13 lli 0x0000000101c18d34 start + 52 14 lli 0x0000000000000003 start + 4265505539 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2003-08-21-EnvironmentTest.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/2003-08-21-EnvironmentTest.ll.script: line 1: 218 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2003-08-21-EnvironmentTest.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::2002-12-16-ArgTest.ll': 6 lli 0x000000010ab5a8ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x000000010aad2b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010aacf5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010aad2380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010aac7c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010aac7ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010a4e3d5e main + 6942 13 lli 0x000000010a4dcd34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2002-12-16-ArgTest.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/2002-12-16-ArgTest.ll.script: line 1: 192 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2002-12-16-ArgTest.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::2003-05-07-ArgumentTest.ll': 6 lli 0x00000001084668ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x00000001083deb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001083db5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x00000001083de380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x00000001083d3c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x00000001083d3ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000107defd5e main + 6942 13 lli 0x0000000107de8d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2003-05-07-ArgumentTest.ll test /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/2003-05-07-ArgumentTest.ll.script: line 1: 207 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/2003-05-07-ArgumentTest.ll test -- ******************** Last 15 lines of 'LLVM::cross-module-a.ll': 7 lli 0x000000010c8d6b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010c8d35ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010c8d6380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010c8cbc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010c8cbee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010c2e7d5e main + 6942 13 lli 0x000000010c2e0d34 start + 52 14 lli 0x0000000000000004 start + 4090622724 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/cross-module-b.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/cross-module-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/cross-module-a.ll.script: line 1: 235 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/cross-module-b.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/cross-module-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::cross-module-sm-pic-a.ll': 7 lli 0x000000010e813b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010e8105ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010e813380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010e808c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010e808ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010e224d5e main + 6942 13 lli 0x000000010e21dd34 start + 52 14 lli 0x0000000000000006 start + 4057867014 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/cross-module-b.ll -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/cross-module-sm-pic-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/cross-module-sm-pic-a.ll.script: line 1: 237 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/cross-module-b.ll -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/cross-module-sm-pic-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::eh-lg-pic.ll': 6 lli 0x000000010f87e8ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x000000010f7f6b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010f7f35ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010f7f6380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010f7ebc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010f7ebee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010f207d5e main + 6942 13 lli 0x000000010f200d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -relocation-model=pic -code-model=large /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/eh-lg-pic.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/eh-lg-pic.ll.script: line 1: 239 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -relocation-model=pic -code-model=large /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/eh-lg-pic.ll -- ******************** Last 15 lines of 'LLVM::eh.ll': 6 lli 0x000000010f1478ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x000000010f0bfb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010f0bc5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010f0bf380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010f0b4c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010f0b4ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010ead0d5e main + 6942 13 lli 0x000000010eac9d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/eh.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/eh.ll.script: line 1: 243 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/eh.ll -- ******************** Last 15 lines of 'LLVM::hello.ll': 7 lli 0x000000010604ab04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001060475ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010604a380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010603fc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010603fee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000105a5bd5e main + 6942 13 lli 0x0000000105a54d34 start + 52 14 lli 0x0000000000000003 start + 4200248067 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/hello.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/hello.ll.script: line 1: 250 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/hello.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::hello2.ll': 7 lli 0x0000000109b5eb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x0000000109b5b5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000109b5e380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000109b53c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000109b53ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010956fd5e main + 6942 13 lli 0x0000000109568d34 start + 52 14 lli 0x0000000000000003 start + 4138300163 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/hello2.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/hello2.ll.script: line 1: 252 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/hello2.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::load-object-a.ll': 6 lli 0x00000001023328ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x00000001022aab04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001022a75ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x00000001022aa380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010229fc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010229fee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000101cbbd5e main + 6942 13 lli 0x0000000101cb4d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll -enable-cache-manager -object-cache-dir=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/load-object-a.ll.tmp.cachedir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/load-object-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/load-object-a.ll.script: line 8: 256 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll -enable-cache-manager -object-cache-dir=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/load-object-a.ll.tmp.cachedir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/load-object-a.ll -- ******************** Last 15 lines of 'LLVM::multi-module-a.ll': 6 lli 0x0000000102fc38ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x0000000102f3bb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x0000000102f385ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000102f3b380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000102f30c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000102f30ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010294cd5e main + 6942 13 lli 0x0000000102945d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/multi-module-a.ll.script: line 1: 258 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::multi-module-eh-a.ll': 6 lli 0x00000001022bf8ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x0000000102237b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001022345ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000102237380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010222cc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010222cee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000101c48d5e main + 6942 13 lli 0x0000000101c41d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-eh-b.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-eh-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/multi-module-eh-a.ll.script: line 1: 260 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-eh-b.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-eh-a.ll -- ******************** Last 15 lines of 'LLVM::multi-module-sm-pic-a.ll': 6 lli 0x00000001050b88ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x0000000105030b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010502d5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000105030380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000105025c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000105025ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000104a41d5e main + 6942 13 lli 0x0000000104a3ad34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-sm-pic-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/multi-module-sm-pic-a.ll.script: line 1: 262 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/Inputs/multi-module-c.ll -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/multi-module-sm-pic-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::cross-module-a.ll': 8 lli 0x000000010c37e5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010c381380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010c376c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010c377693 llvm::MCJIT::getSymbolAddress(std::__1::basic_string, std::__1::allocator > const&, bool) + 419 12 lli 0x000000010c3777b0 llvm::MCJIT::getFunctionAddress(std::__1::basic_string, std::__1::allocator > const&) + 48 13 lli 0x000000010bd93333 main + 8435 14 lli 0x000000010bd8bd34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/cross-module-b.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/cross-module-a.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/remote/Output/cross-module-a.ll.script: line 1: 270 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/cross-module-b.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/cross-module-a.ll > /dev/null RPC Error: ReadBytes: Expecting 4 bytes, Got 0 -- ******************** Last 15 lines of 'LLVM::cross-module-sm-pic-a.ll': 8 lli 0x0000000104f1c5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000104f1f380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000104f14c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000104f15693 llvm::MCJIT::getSymbolAddress(std::__1::basic_string, std::__1::allocator > const&, bool) + 419 12 lli 0x0000000104f157b0 llvm::MCJIT::getFunctionAddress(std::__1::basic_string, std::__1::allocator > const&) + 48 13 lli 0x0000000104931333 main + 8435 14 lli 0x0000000104929d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/cross-module-b.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/cross-module-sm-pic-a.ll RPC Error: ReadBytes: Expecting 4 bytes, Got 0 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/remote/Output/cross-module-sm-pic-a.ll.script: line 1: 273 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/cross-module-b.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/cross-module-sm-pic-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::multi-module-a.ll': 8 lli 0x000000010900e5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000109011380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x0000000109006c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x0000000109007693 llvm::MCJIT::getSymbolAddress(std::__1::basic_string, std::__1::allocator > const&, bool) + 419 12 lli 0x00000001090077b0 llvm::MCJIT::getFunctionAddress(std::__1::basic_string, std::__1::allocator > const&) + 48 13 lli 0x0000000108a23333 main + 8435 14 lli 0x0000000108a1bd34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-c.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/multi-module-a.ll RPC Error: ReadBytes: Expecting 4 bytes, Got 0 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/remote/Output/multi-module-a.ll.script: line 1: 276 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-c.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/multi-module-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::multi-module-sm-pic-a.ll': 8 lli 0x000000010e17d5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010e180380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010e175c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010e176693 llvm::MCJIT::getSymbolAddress(std::__1::basic_string, std::__1::allocator > const&, bool) + 419 12 lli 0x000000010e1767b0 llvm::MCJIT::getFunctionAddress(std::__1::basic_string, std::__1::allocator > const&) + 48 13 lli 0x000000010db92333 main + 8435 14 lli 0x000000010db8ad34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-c.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/multi-module-sm-pic-a.ll RPC Error: ReadBytes: Expecting 4 bytes, Got 0 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/remote/Output/multi-module-sm-pic-a.ll.script: line 1: 279 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-b.ll -extra-module=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/Inputs/multi-module-c.ll -disable-lazy-compilation=true -remote-mcjit -mcjit-remote-process=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli-child-target -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/remote/multi-module-sm-pic-a.ll > /dev/null -- ******************** Last 15 lines of 'LLVM::stubs.ll': 6 lli 0x000000010f8378ad llvm::object::MachOObjectFile::getSectionAddress(llvm::object::DataRefImpl, unsigned long long&) const + 157 7 lli 0x000000010f7afb04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x000000010f7ac5ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x000000010f7af380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010f7a4c50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010f7a4ee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x000000010f1c0d5e main + 6942 13 lli 0x000000010f1b9d34 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -disable-lazy-compilation=false /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/stubs.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/stubs.ll.script: line 1: 315 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -disable-lazy-compilation=false /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/stubs.ll -- ******************** Last 15 lines of 'LLVM::stubs-sm-pic.ll': 7 lli 0x0000000101526b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001015235ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x0000000101526380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x000000010151bc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x000000010151bee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000100f37d5e main + 6942 13 lli 0x0000000100f30d34 start + 52 14 lli 0x0000000000000006 start + 4279038726 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -disable-lazy-compilation=false -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/stubs-sm-pic.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/stubs-sm-pic.ll.script: line 1: 314 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit -disable-lazy-compilation=false -relocation-model=pic -code-model=small /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/stubs-sm-pic.ll -- ******************** Last 15 lines of 'LLVM::test-call.ll': 7 lli 0x00000001099f7b04 llvm::object::SymbolRef::getFileOffset(unsigned long long&) const + 196 8 lli 0x00000001099f45ac llvm::RuntimeDyldImpl::loadObject(llvm::ObjectImage*) + 1484 9 lli 0x00000001099f7380 llvm::RuntimeDyld::loadObject(llvm::ObjectBuffer*) + 96 10 lli 0x00000001099ecc50 llvm::MCJIT::generateCodeForModule(llvm::Module*) + 352 11 lli 0x00000001099ecee1 llvm::MCJIT::finalizeObject() + 129 12 lli 0x0000000109408d5e main + 6942 13 lli 0x0000000109401d34 start + 52 14 lli 0x0000000000000003 start + 4139770627 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/test-call.ll /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/test/ExecutionEngine/MCJIT/Output/test-call.ll.script: line 1: 323 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/lli -use-mcjit /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/ExecutionEngine/MCJIT/test-call.ll > /dev/null -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 20:38:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 20:38:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140403033843.362104EF9407@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18816 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205508 Blamelist: rafael BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: include/llvm/Object/COFF.h include/llvm/Object/ELFObjectFile.h include/llvm/Object/MachO.h include/llvm/Object/ObjectFile.h lib/Object/COFFObjectFile.cpp lib/Object/MachOObjectFile.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Wed 02 Apr 2014 20:26:06 Changed By: rafael Comments: Implement get getSymbolFileOffset with getSymbolAddress. This has the following advantages: * Less code. * The old ELF implementation was wrong for non-relocatable objects. * The old ELF implementation (and I think MachO) was wrong for thumb. No current testcase since this is only used from MCJIT and it only uses relocatable objects and I don't think it supports thumb yet.Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 20:38:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 20:38:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140403033843.361004EF9406@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18816 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205508 Blamelist: rafael BUILD FAILED: failed sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 2 21:04:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 23:04:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403040418.5366E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24291?compare_to=24290&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24291, Order: 205483, Start Time: 2014-04-02 23:23:42, End Time: 2014-04-03 04:10:35 To: 24290, Order: 205473, Start Time: 2014-04-02 22:40:51, End Time: 2014-04-03 03:25:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (91 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (0.1720 => 0.1920, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.92% (0.2440 => 0.2560, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.46% (1.3721 => 1.3921, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.77% (1.1841 => 1.2761, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0109) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.2560 => 0.2720, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (6.0160 => 6.3640, std.dev.: 0.0461) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (10.6960 => 11.3000, std.dev.: 0.0711) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0156) SingleSource/UnitTests/Vector/constpool: 4.81% (10.8967 => 11.4207, std.dev.: 0.1069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0460) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0351) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0397) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0454) MultiSource/Benchmarks/MallocBench/gs/gs: 2.28% (4.9200 => 5.0320, std.dev.: 0.0352) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0286) MultiSource/Benchmarks/Bullet/bullet: 1.76% (37.0925 => 37.7445, std.dev.: 0.0404) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.63% (48.1088 => 48.8929, std.dev.: 0.0903) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0198) MultiSource/Applications/kimwitu++/kc: 1.06% (18.8170 => 19.0170, std.dev.: 0.0257) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 5.17% (6.6564 => 7.0004, std.dev.: 0.0325) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0189) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: -1.73% (1.3841 => 1.3601, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 21:31:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Apr 2014 23:31:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403043140.037542A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24292?compare_to=24291&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24292, Order: 205485, Start Time: 2014-04-02 23:46:59, End Time: 2014-04-03 04:37:48 To: 24291, Order: 205483, Start Time: 2014-04-02 23:23:42, End Time: 2014-04-03 04:10:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (97 on baseline) Performance Improvements: 1 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (1000 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.83% (0.0960 => 0.1160, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: 18.92% (0.1480 => 0.1760, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.42% (0.3840 => 0.4240, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2440 => 0.2560, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 3.51% (0.4560 => 0.4720, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 2.44% (1.1480 => 1.1760, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.88% (1.2761 => 1.3001, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 21.43% (0.1120 => 0.1360, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.62% (0.2320 => 0.2520, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5482 => 3.5122, std.dev.: 0.0139) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.00% (0.1600 => 0.1840, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (10.6960 => 11.3560, std.dev.: 0.0763) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0434) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0235) SingleSource/UnitTests/Vector/constpool: 4.74% (10.8967 => 11.4127, std.dev.: 0.0868) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0076) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0155) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 3.10% (4.5200 => 4.6600, std.dev.: 0.0342) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0369) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0443) MultiSource/Applications/JM/lencod/lencod: 2.36% (17.6165 => 18.0325, std.dev.: 0.0737) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0317) MultiSource/Benchmarks/Bullet/bullet: 2.01% (37.0925 => 37.8366, std.dev.: 0.0576) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.96% (48.1088 => 49.0529, std.dev.: 0.0869) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0332) MultiSource/Applications/kimwitu++/kc: 1.72% (18.8170 => 19.1411, std.dev.: 0.0462) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0169) MultiSource/Applications/sqlite3/sqlite3: 1.55% (23.7574 => 24.1255, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.8322 => 2.8682, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0202) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0220) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 4.39% (6.6564 => 6.9484, std.dev.: 0.0404) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.08% (21.1533 => 21.3813, std.dev.: 0.0796) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.5522 => 3.5122, std.dev.: 0.0139) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 2 21:40:01 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 02 Apr 2014 21:40:01 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140403044012.299774EF9BE3@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18817 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205509 Blamelist: rafael Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 2 22:39:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 00:39:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403053935.200DD2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24293?compare_to=24292&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24293, Order: 205493, Start Time: 2014-04-03 00:58:23, End Time: 2014-04-03 05:45:51 To: 24292, Order: 205485, Start Time: 2014-04-02 23:46:59, End Time: 2014-04-03 04:37:48 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (95 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.56% (1.2801 => 1.3001, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.56% (1.2841 => 1.3041, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 3.63% (0.9921 => 1.0281, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (8.0765 => 8.1605, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0107) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0110) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (6.0160 => 6.3680, std.dev.: 0.0431) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.72% (10.6960 => 11.3080, std.dev.: 0.0797) SingleSource/UnitTests/Vector/constpool: 5.47% (10.8967 => 11.4927, std.dev.: 0.0896) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0294) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0337) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0347) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0271) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.9200 => 0.9520, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0365) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0319) MultiSource/Applications/JM/lencod/lencod: 2.20% (17.6165 => 18.0045, std.dev.: 0.0619) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (4.9200 => 5.0280, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0097) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.97% (48.1088 => 49.0569, std.dev.: 0.0305) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8206, std.dev.: 0.0697) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0651, std.dev.: 0.0343) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0148) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.45% (6.6564 => 6.9524, std.dev.: 0.0559) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 4.05% (0.9881 => 1.0281, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.18% (0.1760 => 0.1440, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3361 => 2.3081, std.dev.: 0.0098) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 23:01:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 01:01:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403060149.7E5302A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24294?compare_to=24284&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24294, Order: 205493, Start Time: 2014-04-03 01:18:57, End Time: 2014-04-03 06:08:04 To: 24284, Order: 205455, Start Time: 2014-04-02 20:15:16, End Time: 2014-04-03 01:04:31 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3520 => 0.3760, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 4.76% (0.5040 => 0.5280, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 3.75% (0.6400 => 0.6640, std.dev.: 0.0092) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 1.85% (1.7281 => 1.7601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.81% (1.9841 => 2.0201, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.14% (2.0961 => 2.1201, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.16% (1.3641 => 1.4481, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.45% (4.1363 => 4.1963, std.dev.: 0.0150) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.30% (2.4642 => 2.4962, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 23:03:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 01:03:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403060347.EA5622A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24295?compare_to=24285&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24295, Order: 205493, Start Time: 2014-04-03 01:20:04, End Time: 2014-04-03 06:10:02 To: 24285, Order: 205455, Start Time: 2014-04-02 20:16:01, End Time: 2014-04-03 01:05:40 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 12 (139 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 4.11% (0.2920 => 0.3040, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.4680 => 0.4840, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.4800 => 0.4960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.91% (1.6721 => 1.7041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.78% (1.5721 => 1.6001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.56% (1.5361 => 1.5601, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 5.56% (5.1083 => 5.3923, std.dev.: 0.0906) MultiSource/Benchmarks/Olden/bisort/bisort: 2.19% (0.7320 => 0.7480, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -1.01% (9.5166 => 9.4206, std.dev.: 0.0221) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.10% (11.3687 => 31.1619, std.dev.: 0.1814) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0127) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0076) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/tsp/tsp: 16.13% (0.1240 => 0.1440, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.21% (0.4240 => 0.4800, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.83% (1.4241 => 1.5641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (1.5521 => 1.7041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.61% (1.4561 => 1.5961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.20% (1.6521 => 1.8041, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0052) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.82% (0.7040 => 0.7520, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.53% (1.1640 => 1.2400, std.dev.: 0.0253) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0125) MultiSource/Applications/spiff/spiff: 6.35% (1.0080 => 1.0720, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: 6.06% (10.6247 => 11.2687, std.dev.: 0.1340) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (6.4680 => 6.8240, std.dev.: 0.0370) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (2.0440 => 2.1560, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.21% (0.7680 => 0.8080, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (5.8121 => 6.1041, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.98% (11.6440 => 12.2240, std.dev.: 0.0611) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (9.4842 => 9.9442, std.dev.: 0.0534) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.0443 => 10.5163, std.dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0248) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.22% (6.5440 => 6.8200, std.dev.: 0.0471) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0104) MultiSource/Applications/JM/lencod/lencod: 3.94% (21.9606 => 22.8248, std.dev.: 0.0364) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.1280 => 1.1720, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0205) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.59% (50.0290 => 51.8250, std.dev.: 0.0924) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (6.5080 => 6.7280, std.dev.: 0.0553) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (5.3600 => 5.5400, std.dev.: 0.0500) MultiSource/Applications/lua/lua: 3.26% (4.7880 => 4.9440, std.dev.: 0.0214) MultiSource/Applications/oggenc/oggenc: 3.21% (6.9844 => 7.2085, std.dev.: 0.0158) MultiSource/Benchmarks/Bullet/bullet: 2.99% (38.4046 => 39.5526, std.dev.: 0.0607) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0100) MultiSource/Applications/SPASS/SPASS: 2.30% (18.4404 => 18.8646, std.dev.: 0.0564) MultiSource/Applications/ClamAV/clamscan: 2.02% (19.0444 => 19.4284, std.dev.: 0.0576) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (16.3483 => 16.6683, std.dev.: 0.0444) MultiSource/Applications/kimwitu++/kc: 1.95% (19.6891 => 20.0731, std.dev.: 0.0374) MultiSource/Applications/d/make_dparser: 1.51% (3.9681 => 4.0281, std.dev.: 0.0203) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.71% (2.1401 => 2.4122, std.dev.: 0.0582) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 5.48% (5.1123 => 5.3923, std.dev.: 0.0906) MultiSource/Applications/siod/siod: 5.17% (2.8602 => 3.0082, std.dev.: 0.0236) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.12% (1.6521 => 1.7201, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.79% (1.0041 => 1.0321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.54% (4.5603 => 4.6763, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.84% (1.0881 => 1.1081, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.31% (3.9842 => 4.0363, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.10% (1.5641 => 0.6240, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: -5.57% (1.8680 => 1.7640, std.dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.36% (91.8497 => 49.2711, std.dev.: 8.6194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.49% (26.0616 => 17.0731, std.dev.: 0.1082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.21% (50.3031 => 33.0941, std.dev.: 0.1580) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.18% (42.1466 => 28.5818, std.dev.: 0.4217) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.0888) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0118) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 23:28:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 01:28:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140403062829.41EFF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24296?compare_to=24286&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24296, Order: 205495, Start Time: 2014-04-03 01:43:07, End Time: 2014-04-03 06:34:46 To: 24286, Order: 205457, Start Time: 2014-04-02 20:37:16, End Time: 2014-04-03 01:28:44 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (116 on baseline) Performance Improvements: 2 (28 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (965 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/factor: 80.00% (0.0200 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.28% (0.4280 => 0.4720, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0050) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 1.88% (4.9040 => 4.9960, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.52% (2.1121 => 2.1441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.19% (2.0241 => 2.0481, std.dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 1.12% (20.4285 => 20.6565, std.dev.: 0.0439) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.45% (1.3641 => 1.4521, std.dev.: 0.0133) MultiSource/Applications/lua/lua: 1.08% (21.7894 => 22.0254, std.dev.: 0.0709) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -2.29% (4.1843 => 4.0883, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.38% (0.8721 => 0.8601, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0104) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.54% (1.7641 => 2.1441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.28% (1.6921 => 2.0521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.59% (1.7681 => 2.1321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 18.58% (1.8081 => 2.1441, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.53% (1.9641 => 2.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0113) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0042) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0084) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2080 => 0.2240, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0187) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (11.7880 => 12.4800, std.dev.: 0.0599) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.60% (6.7200 => 7.0960, std.dev.: 0.0392) SingleSource/UnitTests/Vector/constpool: 5.43% (10.9087 => 11.5007, std.dev.: 0.0927) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.84% (0.9920 => 1.0400, std.dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 4.26% (4.7920 => 4.9960, std.dev.: 0.0316) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (9.9842 => 10.4082, std.dev.: 0.0673) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.6801 => 1.7441, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.67% (1.5240 => 1.5800, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.64% (1.6481 => 1.7081, std.dev.: 0.0091) MultiSource/Applications/d/make_dparser: 3.63% (3.9641 => 4.1081, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.4680 => 0.4840, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.39% (1.4160 => 1.4640, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (2.0680 => 2.1360, std.dev.: 0.0205) MultiSource/Applications/oggenc/oggenc: 3.24% (6.9124 => 7.1364, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (6.8321 => 7.0441, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (10.3203 => 10.6083, std.dev.: 0.0265) MultiSource/Applications/JM/lencod/lencod: 2.72% (22.6287 => 23.2448, std.dev.: 0.0541) MultiSource/Applications/treecc/treecc: 2.60% (2.6200 => 2.6880, std.dev.: 0.0220) MultiSource/Applications/SPASS/SPASS: 2.57% (18.4924 => 18.9684, std.dev.: 0.0687) MultiSource/Applications/kimwitu++/kc: 2.21% (19.7371 => 20.1731, std.dev.: 0.0329) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.18% (51.1089 => 52.2249, std.dev.: 0.1071) MultiSource/Benchmarks/Bullet/bullet: 2.13% (38.9366 => 39.7646, std.dev.: 0.0567) MultiSource/Applications/ClamAV/clamscan: 2.04% (20.2445 => 20.6565, std.dev.: 0.0439) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (16.5963 => 16.8563, std.dev.: 0.0601) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0244 => 6.1164, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 1.29% (25.1895 => 25.5135, std.dev.: 0.0573) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.51% (1.2681 => 1.4521, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 1.72% (21.6534 => 22.0254, std.dev.: 0.0709) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (4.7563 => 4.8163, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (1.0881 => 1.1001, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.69% (6.2884 => 1.3401, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.24% (1.5881 => 0.5520, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.33% (3.1762 => 1.2601, std.dev.: 0.0065) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.90% (7.4801 => 6.2160, std.dev.: 0.0507) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.31% (7.5041 => 6.2800, std.dev.: 0.0530) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: -2.87% (13.5243 => 13.1363, std.dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0212) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0186) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 23:31:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 01:31:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140403063144.E21602A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24297?compare_to=24287&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24297, Order: 205495, Start Time: 2014-04-03 01:45:12, End Time: 2014-04-03 06:37:59 To: 24287, Order: 205457, Start Time: 2014-04-02 20:37:53, End Time: 2014-04-03 01:30:40 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 20 (115 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (967 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: 53.85% (0.0520 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 25.00% (0.0640 => 0.0800, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.00% (0.1200 => 0.1440, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 10.42% (0.1920 => 0.2120, std.dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 8.16% (0.1960 => 0.2120, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.67% (0.2400 => 0.2560, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 5.65% (0.7080 => 0.7480, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.13% (0.3120 => 0.3280, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 4.17% (0.4800 => 0.5000, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5480 => 0.5600, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.21% (2.3081 => 2.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.18% (2.0281 => 2.0521, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (10.3083 => 10.4243, std.dev.: 0.0288) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.61% (3.5242 => 3.6162, std.dev.: 0.0325) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.0003 => 4.0523, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/hash: 1.04% (4.2243 => 4.2683, std.dev.: 0.0157) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.05% (17.6723 => 19.6243, std.dev.: 0.0433) MultiSource/Applications/sqlite3/sqlite3: 1414.12% (1.7001 => 25.7416, std.dev.: 0.0462) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.50% (50.1010 => 51.8530, std.dev.: 0.0823) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.80% (1.0520 => 1.0920, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.22% (11.3920 => 12.3280, std.dev.: 0.0506) SingleSource/Benchmarks/Misc/oourafft: 175.56% (11.3407 => 31.2500, std.dev.: 0.0628) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0092) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0134) SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0160 => 0.0320, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.14% (0.1160 => 0.1440, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.47% (1.8361 => 2.1201, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.19% (2.0281 => 2.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.17% (2.1361 => 2.4602, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.88% (1.8281 => 2.1001, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.61% (1.9161 => 2.1961, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.53% (1.8921 => 2.1481, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.55% (1.9761 => 2.2241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.93% (1.8441 => 2.0641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (1.8361 => 2.0521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.61% (1.7721 => 1.9601, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0130) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0130) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: 8.88% (10.4007 => 11.3247, std.dev.: 0.1501) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.64% (0.3240 => 0.3520, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.4800 => 6.8720, std.dev.: 0.0389) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (0.4760 => 0.5000, std.dev.: 0.0073) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (9.6042 => 10.0122, std.dev.: 0.0458) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (6.5320 => 6.8080, std.dev.: 0.0425) MultiSource/Applications/SIBsim4/SIBsim4: 4.04% (1.7841 => 1.8561, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.7480 => 1.8160, std.dev.: 0.0183) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (5.8281 => 6.0441, std.dev.: 0.0402) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 3.26% (4.7920 => 4.9480, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.88% (1.6641 => 1.7121, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (16.3003 => 16.7443, std.dev.: 0.0323) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (6.5360 => 6.7120, std.dev.: 0.0364) MultiSource/Applications/oggenc/oggenc: 2.55% (7.0524 => 7.2325, std.dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 2.48% (22.2206 => 22.7727, std.dev.: 0.0467) MultiSource/Benchmarks/MallocBench/gs/gs: 2.30% (5.3960 => 5.5200, std.dev.: 0.0426) MultiSource/Applications/SPASS/SPASS: 2.27% (18.5284 => 18.9484, std.dev.: 0.0467) MultiSource/Benchmarks/Bullet/bullet: 2.24% (38.6366 => 39.5006, std.dev.: 0.0909) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0140) MultiSource/Applications/JM/ldecod/ldecod: 1.92% (10.2283 => 10.4243, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0162) MultiSource/Applications/d/make_dparser: 1.71% (3.9761 => 4.0441, std.dev.: 0.0197) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 1.31% (19.8291 => 20.0891, std.dev.: 0.0779) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.74% (2.1201 => 2.4962, std.dev.: 0.0267) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.38% (1.6561 => 1.7121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 2.48% (1.2881 => 1.3201, std.dev.: 0.0124) MultiSource/Applications/minisat/minisat: 1.94% (6.5964 => 6.7244, std.dev.: 0.0461) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (3.7442 => 3.7962, std.dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.59% (2.9562 => 0.6920, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: -6.18% (1.8760 => 1.7600, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.21% (94.8339 => 49.1191, std.dev.: 8.7569) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.88% (49.9431 => 33.0221, std.dev.: 0.1600) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.54% (25.7136 => 17.0891, std.dev.: 0.1162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.52% (37.0863 => 28.3618, std.dev.: 0.6170) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.0939) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.86% (0.1120 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 2 23:59:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 01:59:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140403065924.A65C72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24298?compare_to=24288&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24298, Order: 205498, Start Time: 2014-04-03 02:10:07, End Time: 2014-04-03 07:05:39 To: 24288, Order: 205459, Start Time: 2014-04-02 20:59:56, End Time: 2014-04-03 01:55:34 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (140 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.81% (0.1080 => 0.1240, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.03% (1.5561 => 1.5721, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 19.67% (0.2440 => 0.2920, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.38% (0.3720 => 0.3920, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.94% (1.3761 => 1.4441, std.dev.: 0.0168) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1987.50% (0.0320 => 0.6680, std.dev.: 0.0063) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0103) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 390.52% (0.2520 => 1.2361, std.dev.: 0.0130) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 277.63% (0.2320 => 0.8761, std.dev.: 0.0100) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0065) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0054) SingleSource/Regression/C/sumarraymalloc: 77.78% (0.0360 => 0.0640, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-3: 71.43% (0.0280 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: 30.77% (0.1040 => 0.1360, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 27.27% (0.0880 => 0.1120, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.75% (1.2481 => 1.5321, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0074) MultiSource/Applications/obsequi/Obsequi: 20.98% (1.3920 => 1.6840, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.12% (1.2921 => 1.5521, std.dev.: 0.0127) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.41% (1.2161 => 1.4521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 18.46% (8.5802 => 10.1643, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.21% (1.2521 => 1.4801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.82% (1.2841 => 1.5001, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.33% (1.2001 => 1.3961, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 15.09% (19.5406 => 22.4887, std.dev.: 0.0629) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.50% (5.3360 => 6.0561, std.dev.: 0.0537) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0106) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 9.28% (11.3843 => 12.4403, std.dev.: 0.0354) MultiSource/Applications/aha/aha: 9.09% (0.1320 => 0.1440, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 8.40% (6.2844 => 6.8124, std.dev.: 0.0199) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.33% (5.7280 => 6.1480, std.dev.: 0.0496) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.20% (11.4440 => 12.2680, std.dev.: 0.0605) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.99% (5.6680 => 6.0640, std.dev.: 0.0633) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.22% (9.5802 => 10.1762, std.dev.: 0.0445) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.1480 => 1.2000, std.dev.: 0.0151) MultiSource/Applications/lua/lua: 4.53% (4.7720 => 4.9880, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (1.6240 => 1.6920, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0119) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.17% (49.1529 => 50.7129, std.dev.: 0.0896) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (5.3840 => 5.5520, std.dev.: 0.0447) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.10% (6.8280 => 7.0400, std.dev.: 0.0453) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (1.0680 => 1.1000, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0128) MultiSource/Applications/ClamAV/clamscan: 2.10% (19.2243 => 19.6284, std.dev.: 0.0774) MultiSource/Applications/sqlite3/sqlite3: 1.99% (24.7575 => 25.2495, std.dev.: 0.0388) MultiSource/Benchmarks/Bullet/bullet: 1.66% (39.0726 => 39.7206, std.dev.: 0.0760) MultiSource/Applications/kimwitu++/kc: 1.40% (19.7491 => 20.0251, std.dev.: 0.0584) MultiSource/Applications/siod/siod: 1.31% (2.7562 => 2.7922, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 17.31% (0.9241 => 1.0841, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0168) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.38% (0.3720 => 0.3920, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0098) MultiSource/Applications/minisat/minisat: 2.76% (6.8204 => 7.0084, std.dev.: 0.0392) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.3085 => 7.4845, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -15.78% (7.8605 => 6.6204, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.90% (5.2763 => 4.9123, std.dev.: 0.0798) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.0963 => 5.0123, std.dev.: 0.0256) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (2.3401 => 2.3161, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5602 => 3.5242, std.dev.: 0.0119) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 00:49:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 02:49:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403074947.A44F72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24299?compare_to=24293&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24299, Order: 205503, Start Time: 2014-04-03 03:09:08, End Time: 2014-04-03 07:56:00 To: 24293, Order: 205493, Start Time: 2014-04-03 00:58:23, End Time: 2014-04-03 05:45:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (97 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/sieve: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.00% (0.0800 => 0.0960, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.4560 => 0.4680, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.08% (1.1520 => 1.1760, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.50% (1.3361 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.47% (1.3601 => 1.3801, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0062) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.37% (0.1960 => 0.2320, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0115) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.10% (10.6960 => 11.3480, std.dev.: 0.0739) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: 5.29% (10.8967 => 11.4727, std.dev.: 0.0981) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0547) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0365) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0415) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0482) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (4.9200 => 5.0400, std.dev.: 0.0441) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0161) MultiSource/Benchmarks/Bullet/bullet: 1.91% (37.0925 => 37.8006, std.dev.: 0.0350) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.79% (48.1088 => 48.9689, std.dev.: 0.0716) MultiSource/Applications/sqlite3/sqlite3: 1.79% (23.7574 => 24.1815, std.dev.: 0.0582) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0352) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0183) MultiSource/Applications/kimwitu++/kc: 1.06% (18.8170 => 19.0170, std.dev.: 0.0343) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0198) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0300) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0024) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (3.9762 => 4.0203, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -28.57% (0.0560 => 0.0400, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/mason/mason: -15.79% (0.0760 => 0.0640, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0200) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 01:18:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 03:18:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403081841.AAFAB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24300?compare_to=24299&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24300, Order: 205506, Start Time: 2014-04-03 03:39:48, End Time: 2014-04-03 08:24:58 To: 24299, Order: 205503, Start Time: 2014-04-03 03:09:08, End Time: 2014-04-03 07:56:00 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (97 on baseline) Performance Improvements: 2 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1000 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2008-01-07-LongDouble: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-09-SignedArgs: 66.67% (0.0240 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: 36.36% (0.0440 => 0.0600, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.00% (0.0800 => 0.1040, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 17.39% (0.0920 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.25% (0.1920 => 0.2040, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -15.00% (0.0800 => 0.0680, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -50.00% (0.0240 => 0.0120, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0144) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.23% (1.2721 => 1.3641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (10.6960 => 11.3640, std.dev.: 0.0630) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: 4.52% (10.8967 => 11.3887, std.dev.: 0.1367) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0458) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0213) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0405) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0483) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0109) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0432) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0557) MultiSource/Benchmarks/Bullet/bullet: 1.83% (37.0925 => 37.7725, std.dev.: 0.0421) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0387) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.55% (48.1088 => 48.8568, std.dev.: 0.0889) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 4.69% (6.6564 => 6.9684, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.53% (0.6320 => 0.6480, std.dev.: 0.0000) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (1.3481 => 1.3321, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 02:05:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 04:05:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403090534.182912A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24301?compare_to=24300&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24301, Order: 205509, Start Time: 2014-04-03 04:24:35, End Time: 2014-04-03 09:11:45 To: 24300, Order: 205506, Start Time: 2014-04-03 03:39:48, End Time: 2014-04-03 08:24:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (88 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (1007 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 14.58% (0.1920 => 0.2200, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.19% (0.9040 => 0.9600, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.21% (1.3201 => 1.3361, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.1680 => 0.1960, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.04% (4.7003 => 4.7963, std.dev.: 0.0328) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-07-09-SignedArgs: -40.00% (0.0400 => 0.0240, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0117) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.47% (10.6960 => 11.3880, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.07% (1.2521 => 1.3281, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (8.1441 => 8.4761, std.dev.: 0.0506) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0112) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0350) SingleSource/UnitTests/Vector/constpool: 3.60% (10.8967 => 11.2887, std.dev.: 0.1122) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0335) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0440) MultiSource/Applications/hexxagon/hexxagon: 2.49% (1.1240 => 1.1520, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (1.7080 => 1.7440, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0262) MultiSource/Benchmarks/Bullet/bullet: 1.97% (37.0925 => 37.8246, std.dev.: 0.0454) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0421) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.66% (48.1088 => 48.9089, std.dev.: 0.1020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: 1.08% (18.8170 => 19.0210, std.dev.: 0.0505) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 4.57% (6.6564 => 6.9604, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0100) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0082) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/AtomicOps: -80.00% (0.0200 => 0.0040, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -22.58% (0.1240 => 0.0960, std.dev.: 0.0106) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.18% (0.1760 => 0.1440, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/bmm/bmm: -14.29% (0.0840 => 0.0720, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 03:07:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 05:07:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403100706.F3CE62A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24302?compare_to=24301&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24302, Order: 205511, Start Time: 2014-04-03 05:23:47, End Time: 2014-04-03 10:13:21 To: 24301, Order: 205509, Start Time: 2014-04-03 04:24:35, End Time: 2014-04-03 09:11:45 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (100 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-12-Int64ToFP: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.22% (0.0720 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1440 => 0.1680, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 16.67% (0.0960 => 0.1120, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.33% (0.3000 => 0.3280, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: 7.69% (0.1560 => 0.1680, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2240 => 0.2400, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.76% (0.5320 => 0.5520, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.73% (0.4400 => 0.4520, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.66% (1.4480 => 1.4720, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.36% (3.5362 => 3.4882, std.dev.: 0.0167) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.89% (1.2161 => 1.3121, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.34% (1.1441 => 1.2281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0445) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (10.6960 => 11.3640, std.dev.: 0.0640) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0045) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0127) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0232) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0304) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0237) SingleSource/UnitTests/Vector/constpool: 4.04% (10.8967 => 11.3367, std.dev.: 0.1242) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0274) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (5.8000 => 5.9720, std.dev.: 0.0355) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0399) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0463) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0188) MultiSource/Benchmarks/Bullet/bullet: 2.30% (37.0925 => 37.9446, std.dev.: 0.0841) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.4400 => 1.4720, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0251) MultiSource/Applications/sqlite3/sqlite3: 1.89% (23.7574 => 24.2055, std.dev.: 0.0179) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.72% (48.1088 => 48.9369, std.dev.: 0.0760) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 1.11% (18.8170 => 19.0250, std.dev.: 0.0669) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0241) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0497) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0091) MultiSource/Applications/obsequi/Obsequi: 3.29% (2.0681 => 2.1361, std.dev.: 0.0196) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.29% (4.9443 => 5.0083, std.dev.: 0.0181) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: -1.80% (3.5522 => 3.4882, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 03:54:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 05:54:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403105441.0CF2D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24303?compare_to=24294&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24303, Order: 205511, Start Time: 2014-04-03 06:12:07, End Time: 2014-04-03 11:00:58 To: 24294, Order: 205493, Start Time: 2014-04-03 01:18:57, End Time: 2014-04-03 06:08:04 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1102 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 9.62% (0.2080 => 0.2280, std.dev.: 0.0069) MultiSource/Applications/obsequi/Obsequi: 2.53% (1.7400 => 1.7840, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.05% (0.6080 => 0.7360, std.dev.: 0.0212) MultiSource/Benchmarks/McCat/18-imp/imp: 18.75% (0.0640 => 0.0760, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.46% (0.2680 => 0.2880, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 5.68% (3.8042 => 4.0203, std.dev.: 0.0780) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0110) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 03:57:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 05:57:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403105729.1A47E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24304?compare_to=24295&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24304, Order: 205511, Start Time: 2014-04-03 06:13:55, End Time: 2014-04-03 11:03:47 To: 24295, Order: 205493, Start Time: 2014-04-03 01:20:04, End Time: 2014-04-03 06:10:02 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (144 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/five11/five11: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 14.29% (0.0840 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/SmallPT/smallpt: 12.12% (0.1320 => 0.1480, std.dev.: 0.0055) MultiSource/Applications/aha/aha: 9.38% (0.1280 => 0.1400, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.35% (0.2520 => 0.2680, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 5.08% (0.2360 => 0.2480, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.47% (0.7160 => 0.7480, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.36% (1.0161 => 1.0401, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 1.60% (2.7482 => 2.7922, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 5.76% (17.3691 => 18.3691, std.dev.: 0.3550) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.46% (3.4642 => 3.5842, std.dev.: 0.0447) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.38% (11.3687 => 31.1939, std.dev.: 0.0544) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0085) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0131) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0036) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0055) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0720 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.23% (0.1040 => 0.1240, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.23% (1.0240 => 1.1800, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0042) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 12.73% (0.6600 => 0.7440, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.32% (0.6200 => 0.6840, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.11% (1.4241 => 1.5681, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.44% (1.6521 => 1.8081, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.64% (0.3240 => 0.3520, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0252) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.44% (1.6121 => 1.7481, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.83% (1.7361 => 1.8721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0110) SingleSource/UnitTests/Vector/constpool: 7.57% (10.6247 => 11.4287, std.dev.: 0.1370) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.04% (1.4561 => 1.5441, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.74% (11.6440 => 12.3120, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.65% (1.4161 => 1.4961, std.dev.: 0.0148) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.57% (1.5801 => 1.6681, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0262) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.29% (1.7401 => 1.8321, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (2.0440 => 2.1520, std.dev.: 0.0176) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (9.4842 => 9.9842, std.dev.: 0.0336) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.26% (6.4680 => 6.8080, std.dev.: 0.0521) MultiSource/Benchmarks/McCat/09-vor/vor: 5.05% (0.3960 => 0.4160, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.5480 => 1.6240, std.dev.: 0.0237) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (10.0443 => 10.5243, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.74% (1.5201 => 1.5921, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.4640 => 1.5280, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.34% (5.8121 => 6.0641, std.dev.: 0.0430) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (6.5440 => 6.8120, std.dev.: 0.0405) MultiSource/Applications/JM/lencod/lencod: 3.83% (21.9606 => 22.8008, std.dev.: 0.0632) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6601 => 1.7201, std.dev.: 0.0147) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0123) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.45% (50.0290 => 51.7530, std.dev.: 0.0911) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.4720 => 0.4880, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 3.31% (38.4046 => 39.6766, std.dev.: 0.0628) MultiSource/Applications/oggenc/oggenc: 3.26% (6.9844 => 7.2124, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.20% (6.5080 => 6.7160, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0105) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0387) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (5.3600 => 5.5200, std.dev.: 0.0609) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0142) MultiSource/Applications/SPASS/SPASS: 2.34% (18.4404 => 18.8726, std.dev.: 0.0679) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (16.3483 => 16.7043, std.dev.: 0.0464) MultiSource/Applications/ClamAV/clamscan: 2.04% (19.0444 => 19.4323, std.dev.: 0.0853) MultiSource/Applications/d/make_dparser: 2.02% (3.9681 => 4.0481, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: 1.97% (19.6891 => 20.0771, std.dev.: 0.0503) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0425) MultiSource/Applications/siod/siod: 5.59% (2.8602 => 3.0202, std.dev.: 0.0215) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.20% (6.6684 => 6.7484, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.36% (2.9442 => 0.6960, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0056) MultiSource/Applications/obsequi/Obsequi: -6.21% (1.8680 => 1.7520, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.36% (91.8497 => 49.2711, std.dev.: 10.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.93% (26.0616 => 16.9571, std.dev.: 0.1934) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.48% (50.3031 => 32.9581, std.dev.: 0.2287) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -30.67% (42.1466 => 29.2218, std.dev.: 0.5027) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.0907) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 04:22:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 06:22:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403112204.AD7362A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24305?compare_to=24302&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24305, Order: 205512, Start Time: 2014-04-03 06:41:39, End Time: 2014-04-03 11:28:18 To: 24302, Order: 205511, Start Time: 2014-04-03 05:23:47, End Time: 2014-04-03 10:13:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (94 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.50% (0.1280 => 0.1440, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 11.76% (0.1360 => 0.1520, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.26% (0.2160 => 0.2360, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.2280 => 1.2600, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.34% (5.9520 => 6.0320, std.dev.: 0.0289) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 63.64% (0.0440 => 0.0720, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 1.61% (3.4882 => 3.5442, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.94% (0.2520 => 0.2320, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.02% (10.6960 => 11.3400, std.dev.: 0.0532) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: 4.52% (10.8967 => 11.3887, std.dev.: 0.1301) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0214) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.88% (8.1441 => 8.4601, std.dev.: 0.0414) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0302) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0289) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0526) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.94% (0.4080 => 0.4200, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0417) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0613) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0258) MultiSource/Benchmarks/Bullet/bullet: 2.33% (37.0925 => 37.9566, std.dev.: 0.0770) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.09% (48.1088 => 49.1129, std.dev.: 0.0417) MultiSource/Applications/sqlite3/sqlite3: 1.89% (23.7574 => 24.2055, std.dev.: 0.0684) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 1.30% (18.8170 => 19.0610, std.dev.: 0.0443) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.51% (6.6564 => 6.9564, std.dev.: 0.0460) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.51% (3.9962 => 4.1363, std.dev.: 0.0523) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.68% (5.8164 => 5.9724, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0319) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.94% (0.2520 => 0.2320, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.13% (4.2403 => 4.1923, std.dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 04:24:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 06:24:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140403112423.EB5532A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24306?compare_to=24296&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24306, Order: 205511, Start Time: 2014-04-03 06:38:49, End Time: 2014-04-03 11:30:41 To: 24296, Order: 205495, Start Time: 2014-04-03 01:43:07, End Time: 2014-04-03 06:34:46 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (127 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 100.00% (0.0160 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 35.71% (0.0560 => 0.0760, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 15.79% (0.0760 => 0.0880, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.25% (0.3200 => 0.3560, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 9.62% (0.2080 => 0.2280, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.57% (0.7520 => 0.8240, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.83% (1.7441 => 1.7761, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.12% (2.1441 => 2.1681, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.69% (0.1160 => 0.1400, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0082) SingleSource/UnitTests/member-function-pointers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0053) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/ary3: 29.41% (0.0680 => 0.0880, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.04% (1.6921 => 2.0481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.86% (1.7321 => 2.0761, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.62% (1.8041 => 2.1401, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0112) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.54% (0.3280 => 0.3560, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.11% (0.1480 => 0.1600, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.5560 => 0.6000, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.77% (3.5002 => 3.7722, std.dev.: 0.0154) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.98% (0.1720 => 0.1840, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.00% (0.2000 => 0.2120, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 5.49% (1.0200 => 1.0760, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.99% (11.7880 => 12.3760, std.dev.: 0.0994) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.88% (6.7200 => 7.0480, std.dev.: 0.0561) SingleSource/UnitTests/Vector/constpool: 4.62% (10.9087 => 11.4127, std.dev.: 0.1026) MultiSource/Applications/lua/lua: 4.42% (4.7920 => 5.0040, std.dev.: 0.0344) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (9.9842 => 10.4042, std.dev.: 0.0421) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0090) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.64% (1.6481 => 1.7081, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (6.8321 => 7.0801, std.dev.: 0.0434) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 3.53% (6.9124 => 7.1564, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (2.0680 => 2.1400, std.dev.: 0.0252) MultiSource/Applications/d/make_dparser: 3.43% (3.9641 => 4.1001, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 2.92% (18.4924 => 19.0325, std.dev.: 0.0563) MultiSource/Applications/treecc/treecc: 2.75% (2.6200 => 2.6920, std.dev.: 0.0199) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (10.3203 => 10.6003, std.dev.: 0.0558) MultiSource/Applications/JM/lencod/lencod: 2.53% (22.6287 => 23.2007, std.dev.: 0.0642) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2203 => 4.3203, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: 2.29% (38.9366 => 39.8286, std.dev.: 0.0690) MultiSource/Applications/kimwitu++/kc: 2.29% (19.7371 => 20.1891, std.dev.: 0.0226) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.23% (51.1089 => 52.2489, std.dev.: 0.1023) MultiSource/Applications/ClamAV/clamscan: 2.04% (20.2445 => 20.6565, std.dev.: 0.0723) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (3.0122 => 3.0722, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.59% (6.0244 => 6.1204, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (16.5963 => 16.8403, std.dev.: 0.0490) MultiSource/Applications/sqlite3/sqlite3: 1.21% (25.1895 => 25.4935, std.dev.: 0.0459) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: 24.36% (7.3405 => 9.1286, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.03% (4.1323 => 4.2163, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0155) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (4.2443 => 4.3043, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.56% (6.2884 => 1.3481, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/nestedloop: -65.45% (2.9642 => 1.0241, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0079) MultiSource/Applications/obsequi/Obsequi: -33.39% (2.6481 => 1.7640, std.dev.: 0.0278) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.95% (7.4801 => 6.2120, std.dev.: 0.0453) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.31% (7.5041 => 6.2800, std.dev.: 0.0344) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0056) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -4.05% (0.2960 => 0.2840, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -3.19% (13.5243 => 13.0923, std.dev.: 0.0494) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -15.03% (7.8005 => 6.6284, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0187) MultiSource/Applications/JM/lencod/lencod: -1.88% (8.3085 => 8.1525, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.60% (4.9883 => 4.9083, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0105) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 04:28:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 06:28:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140403112845.1AE092A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24307?compare_to=24297&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24307, Order: 205512, Start Time: 2014-04-03 06:41:54, End Time: 2014-04-03 11:35:04 To: 24297, Order: 205495, Start Time: 2014-04-03 01:45:12, End Time: 2014-04-03 06:37:59 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (134 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/distray/distray: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 5.00% (0.2400 => 0.2520, std.dev.: 0.0038) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.2960 => 1.3440, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.66% (1.7480 => 1.8120, std.dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 25.00% (0.1120 => 0.1400, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.26% (0.4560 => 0.4800, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7121 => 1.7321, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.52% (17.6723 => 19.5323, std.dev.: 0.0611) MultiSource/Applications/sqlite3/sqlite3: 1415.53% (1.7001 => 25.7656, std.dev.: 0.0436) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.35% (50.1010 => 51.7810, std.dev.: 0.0907) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (1.0520 => 1.1240, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (11.3920 => 12.2320, std.dev.: 0.0566) SingleSource/Benchmarks/Misc/oourafft: 175.77% (11.3407 => 31.2740, std.dev.: 0.0882) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0092) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0097) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Quicksort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.90% (1.9601 => 2.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.98% (1.8601 => 2.1201, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.93% (1.9521 => 2.2241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.74% (1.8921 => 2.1521, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.72% (1.9241 => 2.1881, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/ffbench: 11.54% (0.1040 => 0.1160, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.18% (1.8601 => 2.0681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0137) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.64% (2.0681 => 2.2881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.8441 => 2.0401, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2280 => 0.2520, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.47% (1.9481 => 2.1521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: 9.69% (10.4007 => 11.4087, std.dev.: 0.0881) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.62% (0.4160 => 0.4560, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.14% (0.7280 => 0.7800, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (6.4800 => 6.8760, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (2.9721 => 3.1322, std.dev.: 0.0150) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.00% (0.2400 => 0.2520, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (9.6042 => 10.0322, std.dev.: 0.0322) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.7480 => 1.8120, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (5.8281 => 6.0361, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.4680 => 0.4840, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (5.3960 => 5.5560, std.dev.: 0.0453) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.94% (6.5320 => 6.7240, std.dev.: 0.0632) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (6.5360 => 6.7240, std.dev.: 0.0418) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 2.67% (4.7920 => 4.9200, std.dev.: 0.0321) MultiSource/Applications/oggenc/oggenc: 2.55% (7.0524 => 7.2325, std.dev.: 0.0211) MultiSource/Benchmarks/Bullet/bullet: 2.48% (38.6366 => 39.5966, std.dev.: 0.0801) MultiSource/Applications/SPASS/SPASS: 2.42% (18.5284 => 18.9766, std.dev.: 0.0353) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (16.3003 => 16.6883, std.dev.: 0.0528) MultiSource/Applications/JM/lencod/lencod: 2.23% (22.2206 => 22.7168, std.dev.: 0.0655) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (10.2283 => 10.3923, std.dev.: 0.0475) MultiSource/Applications/kimwitu++/kc: 1.29% (19.8291 => 20.0851, std.dev.: 0.0334) MultiSource/Applications/siod/siod: 1.16% (2.7522 => 2.7842, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.34% (2.1201 => 2.4242, std.dev.: 0.0414) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 2.17% (1.2881 => 1.3161, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: 2.00% (6.5964 => 6.7284, std.dev.: 0.0352) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.46% (2.9562 => 0.6960, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0058) MultiSource/Applications/obsequi/Obsequi: -7.04% (1.8760 => 1.7440, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.96% (94.8339 => 49.3511, std.dev.: 8.7869) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.81% (25.7136 => 17.0211, std.dev.: 0.1315) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.79% (49.9431 => 33.0661, std.dev.: 0.1365) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.0960) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.63% (37.0863 => 28.6938, std.dev.: 0.3035) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0182) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 04:58:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 06:58:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140403115844.A70792A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24308?compare_to=24298&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24308, Order: 205512, Start Time: 2014-04-03 07:09:33, End Time: 2014-04-03 12:05:01 To: 24298, Order: 205498, Start Time: 2014-04-03 02:10:07, End Time: 2014-04-03 07:05:39 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 7 (157 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 27.78% (0.0720 => 0.0920, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: 20.83% (0.0960 => 0.1160, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2360 => 0.2520, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 1.98% (2.6240 => 2.6760, std.dev.: 0.0179) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0081) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 395.28% (0.2520 => 1.2481, std.dev.: 0.0109) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 275.91% (0.2320 => 0.8721, std.dev.: 0.0099) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0060) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0059) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0039) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0057) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0141) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: 21.26% (1.3920 => 1.6880, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.66% (1.2001 => 1.4481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.07% (1.1761 => 1.4121, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.45% (1.1721 => 1.4001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.37% (1.1761 => 1.3921, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 18.32% (8.5802 => 10.1523, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.21% (1.2521 => 1.4801, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.54% (1.3681 => 1.6081, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.39% (1.2881 => 1.5121, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0134) MultiSource/Applications/sgefa/sgefa: 16.07% (0.4480 => 0.5200, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 15.11% (19.5406 => 22.4927, std.dev.: 0.0555) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0118) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.57% (5.3360 => 6.0601, std.dev.: 0.0404) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.34% (1.7400 => 1.9200, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (11.3843 => 12.4363, std.dev.: 0.0434) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.01% (0.4440 => 0.4840, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 8.78% (6.2844 => 6.8364, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.10% (5.7280 => 6.1920, std.dev.: 0.0391) SingleSource/UnitTests/Vectorizer/gcc-loops: 7.91% (0.5560 => 0.6000, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.48% (5.6680 => 6.0920, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.13% (11.4440 => 12.2600, std.dev.: 0.0545) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.89% (9.5802 => 10.2402, std.dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0054) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.7640 => 0.8120, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.10% (6.8280 => 7.1080, std.dev.: 0.0423) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0235) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0112) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.50% (0.8000 => 0.8280, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/football/football: 3.00% (1.0680 => 1.1000, std.dev.: 0.0113) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.93% (49.1529 => 50.5929, std.dev.: 0.0796) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0088) MultiSource/Applications/ClamAV/clamscan: 2.66% (19.2243 => 19.7364, std.dev.: 0.0315) MultiSource/Applications/sqlite3/sqlite3: 2.52% (24.7575 => 25.3815, std.dev.: 0.0290) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (5.3840 => 5.5000, std.dev.: 0.0427) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 1.84% (39.0726 => 39.7926, std.dev.: 0.0652) MultiSource/Applications/kimwitu++/kc: 1.50% (19.7491 => 20.0451, std.dev.: 0.0319) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0491) SingleSource/Benchmarks/Misc-C++/bigfib: 10.14% (0.2760 => 0.3040, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.59% (3.3122 => 3.4642, std.dev.: 0.0569) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0460) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.0563 => 4.1643, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.3085 => 7.4845, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4041 => 1.4241, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0534) SingleSource/Benchmarks/BenchmarkGame/n-body: -6.07% (1.7121 => 1.6081, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0278) MultiSource/Benchmarks/sim/sim: -1.76% (4.9963 => 4.9083, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3401 => 2.3121, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.0963 => 5.0363, std.dev.: 0.0228) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 05:41:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 07:41:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403124126.57DBA2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24309?compare_to=24305&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24309, Order: 205515, Start Time: 2014-04-03 08:00:10, End Time: 2014-04-03 12:47:40 To: 24305, Order: 205512, Start Time: 2014-04-03 06:41:39, End Time: 2014-04-03 11:28:18 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (101 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_member: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.82% (0.1360 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3200 => 0.3360, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 1.49% (3.7641 => 3.8200, std.dev.: 0.0110) MultiSource/Applications/treecc/treecc: 1.46% (2.4680 => 2.5040, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/strcat: 20.00% (0.1200 => 0.1440, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.62% (0.2320 => 0.2520, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 3.50% (2.0561 => 2.1281, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/power/power: 1.22% (1.3161 => 1.3321, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (3.9682 => 4.0122, std.dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (2.6362 => 2.6042, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0060) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.69% (1.1441 => 1.2321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.49% (1.2321 => 1.3121, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (10.6960 => 11.3840, std.dev.: 0.0691) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (6.0160 => 6.3520, std.dev.: 0.0628) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: 4.74% (10.8967 => 11.4127, std.dev.: 0.1176) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0213) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0351) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0453) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0350) MultiSource/Benchmarks/Bullet/bullet: 2.54% (37.0925 => 38.0365, std.dev.: 0.0450) MultiSource/Applications/treecc/treecc: 2.29% (2.4480 => 2.5040, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0280) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.05% (48.1088 => 49.0970, std.dev.: 0.0971) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0463) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0141) MultiSource/Applications/kimwitu++/kc: 1.47% (18.8170 => 19.0930, std.dev.: 0.0472) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.33% (0.1800 => 0.2040, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0312) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 3.10% (2.0641 => 2.1281, std.dev.: 0.0151) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (4.0643 => 4.1123, std.dev.: 0.0131) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 06:39:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 08:39:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403133938.E24002A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24310?compare_to=24309&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24310, Order: 205516, Start Time: 2014-04-03 09:01:19, End Time: 2014-04-03 13:45:53 To: 24309, Order: 205515, Start Time: 2014-04-03 08:00:10, End Time: 2014-04-03 12:47:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (97 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (1001 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 25.00% (0.0640 => 0.0800, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 15.38% (0.1040 => 0.1200, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Puzzle: 11.11% (0.1080 => 0.1200, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.67% (0.1800 => 0.1920, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.46% (1.1360 => 1.1640, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.83% (1.3121 => 1.3361, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.29% (1.2441 => 1.2601, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.12% (1.0281 => 1.1321, std.dev.: 0.0343) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.55% (1.1001 => 1.1281, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Threads/tls: -57.14% (0.0280 => 0.0120, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.34% (1.1441 => 1.2281, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.97% (1.1481 => 1.2281, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.41% (1.2481 => 1.3281, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (10.6960 => 11.3040, std.dev.: 0.0968) SingleSource/UnitTests/Vector/constpool: 5.43% (10.8967 => 11.4887, std.dev.: 0.0651) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0258) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0327) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0492) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0353) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 2.74% (4.5200 => 4.6440, std.dev.: 0.0403) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.9640 => 2.0160, std.dev.: 0.0198) MultiSource/Benchmarks/Bullet/bullet: 2.60% (37.0925 => 38.0565, std.dev.: 0.0499) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 2.43% (17.6165 => 18.0445, std.dev.: 0.0689) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0304) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0412) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.5480 => 1.5800, std.dev.: 0.0115) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.00% (48.1088 => 49.0690, std.dev.: 0.0679) MultiSource/Applications/sqlite3/sqlite3: 1.62% (23.7574 => 24.1415, std.dev.: 0.0509) MultiSource/Applications/kimwitu++/kc: 1.21% (18.8170 => 19.0451, std.dev.: 0.0441) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 400.00% (0.0040 => 0.0200, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0212) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.53% (0.3040 => 0.3360, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0382) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0085) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0643 => 4.1123, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -5.26% (0.6080 => 0.5760, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 3 06:48:41 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 03 Apr 2014 06:48:41 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140403134845.373CC4EFEC94@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/724 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205446 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpVwGZ4Rexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpVwGZ4Rexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpKWJ3M9exe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpKWJ3M9exe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Thu Apr 3 06:57:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 08:57:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403135740.122AD2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24311?compare_to=24310&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24311, Order: 205517, Start Time: 2014-04-03 09:17:00, End Time: 2014-04-03 14:03:54 To: 24310, Order: 205516, Start Time: 2014-04-03 09:01:19, End Time: 2014-04-03 13:45:53 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 19 (103 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-03-02-VaCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/Threads/tls: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1560 => 0.1720, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.4080 => 0.4360, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.71% (0.2800 => 0.2960, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 3.83% (1.4640 => 1.5200, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.7400 => 1.8000, std.dev.: 0.0214) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.97% (0.4040 => 0.4160, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.11% (1.3281 => 1.3561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.25% (1.2801 => 1.2961, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 5.69% (0.4920 => 0.5200, std.dev.: 0.0096) MultiSource/Applications/obsequi/Obsequi: 2.10% (2.1001 => 2.1441, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.53% (1.1681 => 1.2561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0470) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.3160 => 0.3360, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0533) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.42% (0.6640 => 0.7000, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0086) SingleSource/UnitTests/Vector/constpool: 4.77% (10.8967 => 11.4167, std.dev.: 0.1474) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 4.11% (1.4600 => 1.5200, std.dev.: 0.0203) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.88% (8.1441 => 8.4601, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0214) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (1.5200 => 1.5760, std.dev.: 0.0194) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0258) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 2.68% (17.6165 => 18.0885, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0456) MultiSource/Benchmarks/Bullet/bullet: 2.50% (37.0925 => 38.0206, std.dev.: 0.0556) MultiSource/Applications/hexxagon/hexxagon: 2.49% (1.1240 => 1.1520, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/gs/gs: 2.28% (4.9200 => 5.0320, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0273) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0120) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.95% (48.1088 => 49.0489, std.dev.: 0.0822) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0467) MultiSource/Applications/sqlite3/sqlite3: 1.73% (23.7574 => 24.1695, std.dev.: 0.0549) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0810, std.dev.: 0.0556) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0373) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0174) MultiSource/Applications/obsequi/Obsequi: 3.67% (2.0681 => 2.1441, std.dev.: 0.0157) MultiSource/Applications/lemon/lemon: 3.24% (0.9881 => 1.0201, std.dev.: 0.0067) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.08% (1.4881 => 1.4721, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2403 => 4.1963, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 07:59:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 09:59:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403145954.806642A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24312?compare_to=24311&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24312, Order: 205520, Start Time: 2014-04-03 10:17:16, End Time: 2014-04-03 15:06:09 To: 24311, Order: 205517, Start Time: 2014-04-03 09:17:00, End Time: 2014-04-03 14:03:54 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (97 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 62.50% (0.0320 => 0.0520, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/FloatMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: 18.75% (0.1280 => 0.1520, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.14% (0.6720 => 0.7200, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.08% (0.5200 => 0.5360, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (5.9280 => 6.0280, std.dev.: 0.0264) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.35% (0.2520 => 0.2360, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0138) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/mst/mst: 11.76% (0.1360 => 0.1520, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.69% (1.1441 => 1.2321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.05% (1.1921 => 1.2761, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0523) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: 4.99% (10.8967 => 11.4407, std.dev.: 0.0863) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.99% (6.0160 => 6.3160, std.dev.: 0.0600) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0276) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0264) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (8.1441 => 8.4641, std.dev.: 0.0385) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0416) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0433) MultiSource/Applications/JM/lencod/lencod: 2.63% (17.6165 => 18.0805, std.dev.: 0.0606) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8966, std.dev.: 0.0663) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (5.8400 => 5.9560, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0178) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.69% (48.1088 => 48.9209, std.dev.: 0.0875) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (7.8562 => 7.9802, std.dev.: 0.0308) MultiSource/Applications/sqlite3/sqlite3: 1.50% (23.7574 => 24.1135, std.dev.: 0.0715) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 1.21% (18.8170 => 19.0450, std.dev.: 0.0535) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.89% (0.9321 => 1.1921, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0368) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0244) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0443) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.35% (0.2520 => 0.2360, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 08:48:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 10:48:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403154806.1AB4A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24313?compare_to=24303&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24313, Order: 205523, Start Time: 2014-04-03 11:05:20, End Time: 2014-04-03 15:54:20 To: 24303, Order: 205511, Start Time: 2014-04-03 06:12:07, End Time: 2014-04-03 11:00:58 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Perm: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 40.00% (0.0400 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.00% (0.0800 => 0.0920, std.dev.: 0.0027) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.76% (0.2520 => 0.2640, std.dev.: 0.0041) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.52% (1.3640 => 1.4120, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.91% (1.0481 => 1.0681, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.61% (1.7401 => 1.7681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.42% (1.6921 => 1.7161, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.15% (1.7441 => 1.7641, std.dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 08:52:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 10:52:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403155218.3F6082A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24314?compare_to=24304&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24314, Order: 205523, Start Time: 2014-04-03 11:08:13, End Time: 2014-04-03 15:58:37 To: 24304, Order: 205511, Start Time: 2014-04-03 06:13:55, End Time: 2014-04-03 11:03:47 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 8 (132 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (954 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.33% (0.7200 => 0.7440, std.dev.: 0.0084) MultiSource/Applications/treecc/treecc: 2.12% (2.6360 => 2.6920, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (1.0081 => 1.0241, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 8.00% (1.2001 => 1.2961, std.dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.69% (0.2560 => 0.2440, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.28% (11.3687 => 31.1819, std.dev.: 0.1108) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0097) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 295.67% (0.4600 => 1.8201, std.dev.: 0.0071) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0062) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.35% (0.3240 => 0.3640, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.55% (1.4241 => 1.5601, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.47% (1.8161 => 1.9881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.44% (1.6521 => 1.8081, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.66% (1.5241 => 1.6561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.4961 => 1.6241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.53% (1.5481 => 1.6801, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.39% (0.6200 => 0.6720, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0112) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0100) SingleSource/UnitTests/Vector/constpool: 7.15% (10.6247 => 11.3847, std.dev.: 0.1144) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.70% (1.6121 => 1.7201, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.20% (1.4841 => 1.5761, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0342) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.95% (1.4801 => 1.5681, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.93% (1.4161 => 1.5001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.80% (1.4481 => 1.5321, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: 5.56% (1.0080 => 1.0640, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.53% (11.6440 => 12.2880, std.dev.: 0.0925) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (9.4842 => 10.0082, std.dev.: 0.0540) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (5.8121 => 6.1201, std.dev.: 0.0363) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.18% (1.4681 => 1.5441, std.dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: 5.10% (10.0443 => 10.5563, std.dev.: 0.0309) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (2.0440 => 2.1480, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.06% (1.7401 => 1.8281, std.dev.: 0.0165) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.81% (1.5801 => 1.6561, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.40% (6.5440 => 6.8320, std.dev.: 0.0384) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.5480 => 1.6160, std.dev.: 0.0214) MultiSource/Applications/treecc/treecc: 4.18% (2.5840 => 2.6920, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0176) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.86% (50.0290 => 51.9610, std.dev.: 0.0751) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: 3.84% (21.9606 => 22.8048, std.dev.: 0.0721) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (5.3600 => 5.5520, std.dev.: 0.0410) MultiSource/Benchmarks/Bullet/bullet: 3.56% (38.4046 => 39.7726, std.dev.: 0.0631) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4720 => 0.4880, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0173) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 3.09% (6.9844 => 7.2005, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0168) MultiSource/Applications/SPASS/SPASS: 2.97% (18.4404 => 18.9885, std.dev.: 0.0403) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (6.5080 => 6.7000, std.dev.: 0.0492) MultiSource/Applications/lua/lua: 2.84% (4.7880 => 4.9240, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (4.1843 => 4.3003, std.dev.: 0.0195) MultiSource/Applications/kimwitu++/kc: 2.66% (19.6891 => 20.2131, std.dev.: 0.0382) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/flops: 2.50% (0.4800 => 0.4920, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (16.3483 => 16.7323, std.dev.: 0.0643) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: 2.04% (19.0444 => 19.4323, std.dev.: 0.0603) MultiSource/Applications/d/make_dparser: 1.92% (3.9681 => 4.0441, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.31% (6.1044 => 6.1844, std.dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.97% (0.9241 => 1.1641, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0423) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 1.44% (6.6684 => 6.7644, std.dev.: 0.0317) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.41% (3.9842 => 4.0403, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (3.9562 => 4.0042, std.dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.36% (2.9442 => 0.6960, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0069) MultiSource/Applications/obsequi/Obsequi: -5.14% (1.8680 => 1.7720, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.04% (91.8497 => 49.5591, std.dev.: 8.3523) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.44% (26.0616 => 17.0851, std.dev.: 0.1476) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.31% (50.3031 => 33.0421, std.dev.: 0.1801) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.53% (42.1466 => 28.4378, std.dev.: 0.5861) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.0884) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0101) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.17% (2.7442 => 2.7122, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 09:13:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 11:13:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403161350.76BAA2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24315?compare_to=24312&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24315, Order: 205523, Start Time: 2014-04-03 11:32:41, End Time: 2014-04-03 16:20:05 To: 24312, Order: 205520, Start Time: 2014-04-03 10:17:16, End Time: 2014-04-03 15:06:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 5 (93 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (1005 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray-dbl: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1360 => 0.1480, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.00% (0.7000 => 0.7280, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 14.29% (0.0840 => 0.0960, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: -17.86% (0.1120 => 0.0920, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0511) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.71% (1.2601 => 1.3321, std.dev.: 0.0188) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0138) SingleSource/UnitTests/Vector/constpool: 4.77% (10.8967 => 11.4167, std.dev.: 0.1420) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0420) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0154) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0368) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0138) MultiSource/Applications/JM/lencod/lencod: 2.63% (17.6165 => 18.0805, std.dev.: 0.0447) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0284) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0337) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 1.97% (37.0925 => 37.8245, std.dev.: 0.0587) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0070) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.85% (48.1088 => 48.9970, std.dev.: 0.0927) MultiSource/Applications/sqlite3/sqlite3: 1.70% (23.7574 => 24.1615, std.dev.: 0.0434) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0144) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1130, std.dev.: 0.0465) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0431) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0044) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.59% (4.5203 => 4.5923, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.94% (7.7485 => 6.6684, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 09:20:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 11:20:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140403162000.CEEFB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24316?compare_to=24306&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24316, Order: 205523, Start Time: 2014-04-03 11:35:04, End Time: 2014-04-03 16:26:18 To: 24306, Order: 205511, Start Time: 2014-04-03 06:38:49, End Time: 2014-04-03 11:30:41 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (120 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (963 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/function_try_block: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.71% (0.3400 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.21% (1.5200 => 1.5840, std.dev.: 0.0212) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 301.78% (0.4560 => 1.8321, std.dev.: 0.0061) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/Regression/C++/EH/function_try_block: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.46% (1.6961 => 2.0601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.04% (1.6921 => 2.0481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.52% (1.6961 => 2.0441, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.13% (1.8881 => 2.2681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.00% (1.7401 => 2.0881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.73% (1.7641 => 2.1121, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.46% (1.8201 => 2.1561, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0032) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0066) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.33% (11.7880 => 12.4160, std.dev.: 0.0690) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.12% (6.7200 => 7.0640, std.dev.: 0.0626) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: 4.29% (10.9087 => 11.3767, std.dev.: 0.1463) MultiSource/Applications/lua/lua: 4.26% (4.7920 => 4.9960, std.dev.: 0.0303) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (9.9842 => 10.4082, std.dev.: 0.0427) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (1.6481 => 1.7161, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (2.0680 => 2.1520, std.dev.: 0.0229) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.8201 => 1.8921, std.dev.: 0.0158) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0107) MultiSource/Applications/oggenc/oggenc: 3.24% (6.9124 => 7.1364, std.dev.: 0.0250) MultiSource/Applications/d/make_dparser: 3.03% (3.9641 => 4.0841, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.99% (6.8321 => 7.0361, std.dev.: 0.0341) MultiSource/Applications/JM/lencod/lencod: 2.88% (22.6287 => 23.2807, std.dev.: 0.0420) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (10.3203 => 10.6163, std.dev.: 0.0412) MultiSource/Applications/SPASS/SPASS: 2.81% (18.4924 => 19.0125, std.dev.: 0.0581) MultiSource/Applications/treecc/treecc: 2.60% (2.6200 => 2.6880, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (2.0440 => 2.0920, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0078) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.23% (51.1089 => 52.2489, std.dev.: 0.0714) MultiSource/Benchmarks/Bullet/bullet: 2.11% (38.9366 => 39.7566, std.dev.: 0.0915) MultiSource/Applications/kimwitu++/kc: 2.07% (19.7371 => 20.1451, std.dev.: 0.0448) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (16.5963 => 16.9323, std.dev.: 0.0270) MultiSource/Applications/ClamAV/clamscan: 1.82% (20.2445 => 20.6125, std.dev.: 0.0842) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0104) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.59% (6.0244 => 6.1204, std.dev.: 0.0185) MultiSource/Applications/sqlite3/sqlite3: 1.11% (25.1895 => 25.4695, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.06% (2.2721 => 2.2961, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7722 => 2.8002, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.43% (0.9281 => 1.1641, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.44% (3.4842 => 3.6042, std.dev.: 0.0404) MultiSource/Applications/minisat/minisat: 2.93% (6.8204 => 7.0204, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (3.4402 => 3.5322, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.43% (5.0963 => 5.2203, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.04% (4.7003 => 4.7963, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.68% (4.7563 => 4.8363, std.dev.: 0.0159) MultiSource/Applications/lua/lua: 1.68% (21.6534 => 22.0174, std.dev.: 0.0869) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.75% (6.2884 => 1.3361, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/nestedloop: -65.05% (2.9642 => 1.0361, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: -33.84% (2.6481 => 1.7520, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.90% (7.4801 => 6.2160, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.05% (7.5041 => 6.3000, std.dev.: 0.0260) SingleSource/UnitTests/Vector/multiplies: -14.63% (0.1640 => 0.1400, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: -3.22% (13.5243 => 13.0883, std.dev.: 0.0375) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -2.40% (5.1603 => 5.0363, std.dev.: 0.0249) MultiSource/Applications/JM/lencod/lencod: -1.73% (8.3085 => 8.1645, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -1.17% (11.6527 => 11.5167, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 09:26:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 11:26:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140403162607.717962A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24317?compare_to=24307&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24317, Order: 205523, Start Time: 2014-04-03 11:39:25, End Time: 2014-04-03 16:32:21 To: 24307, Order: 205512, Start Time: 2014-04-03 06:41:54, End Time: 2014-04-03 11:35:04 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 10 (128 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (953 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-04-22-Switch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 6.90% (0.2320 => 0.2480, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.96% (0.5400 => 0.5560, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.88% (0.4160 => 0.4280, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.16% (0.5560 => 0.5680, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.9401 => 0.9561, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 4.12% (0.3880 => 0.4040, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/Quicksort: -25.00% (0.0480 => 0.0360, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.75% (17.6723 => 19.5724, std.dev.: 0.0410) MultiSource/Applications/sqlite3/sqlite3: 1414.12% (1.7001 => 25.7416, std.dev.: 0.0263) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.24% (50.1010 => 51.7250, std.dev.: 0.1164) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (11.3920 => 12.2680, std.dev.: 0.0757) SingleSource/Benchmarks/Misc/oourafft: 175.42% (11.3407 => 31.2340, std.dev.: 0.0748) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0363, std.dev.: 0.0275) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3521, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7124, std.dev.: 0.0105) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0097) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0160 => 0.0320, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/UnitTests/vla: 50.00% (0.0320 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.1280 => 0.1560, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.50% (0.4160 => 0.4680, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.93% (1.8441 => 2.0641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.80% (1.7961 => 1.9721, std.dev.: 0.0137) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0071) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: 8.81% (10.4007 => 11.3167, std.dev.: 0.1498) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 7.09% (1.0160 => 1.0880, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (6.4800 => 6.8680, std.dev.: 0.0291) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.17% (0.2320 => 0.2440, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.6960 => 1.7760, std.dev.: 0.0190) MultiSource/Applications/sgefa/sgefa: 4.55% (0.6160 => 0.6440, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.29% (1.2120 => 1.2640, std.dev.: 0.0195) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (6.5320 => 6.8000, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.09% (1.5640 => 1.6280, std.dev.: 0.0223) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (9.6042 => 9.9802, std.dev.: 0.0476) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0166) MultiSource/Applications/lua/lua: 3.42% (4.7920 => 4.9560, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.23% (5.8281 => 6.0161, std.dev.: 0.0528) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.88% (0.4160 => 0.4280, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 2.78% (2.5880 => 2.6600, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (16.3003 => 16.7443, std.dev.: 0.0436) MultiSource/Benchmarks/Bullet/bullet: 2.52% (38.6366 => 39.6086, std.dev.: 0.0706) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0208) MultiSource/Applications/JM/lencod/lencod: 2.40% (22.2206 => 22.7528, std.dev.: 0.0426) MultiSource/Applications/SPASS/SPASS: 2.38% (18.5284 => 18.9685, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (6.5360 => 6.6840, std.dev.: 0.0529) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (3.0562 => 3.1122, std.dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (10.2283 => 10.3923, std.dev.: 0.0344) MultiSource/Applications/siod/siod: 1.31% (2.7522 => 2.7882, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 1.11% (19.8291 => 20.0491, std.dev.: 0.0374) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.36% (2.1201 => 2.4882, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.33% (0.7200 => 0.7440, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: 2.36% (6.5964 => 6.7524, std.dev.: 0.0433) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (3.9442 => 3.9962, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.18% (3.7442 => 3.7882, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.19% (2.9562 => 0.7040, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.23% (1.5881 => 0.5680, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -6.82% (1.8760 => 1.7480, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.82% (94.8339 => 49.4871, std.dev.: 9.7388) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.94% (49.9431 => 32.9941, std.dev.: 0.1635) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.49% (25.7136 => 17.1011, std.dev.: 0.1090) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.66% (3.0722 => 2.3761, std.dev.: 0.0954) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.34% (37.0863 => 28.8018, std.dev.: 0.3896) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.41% (2.8442 => 2.8042, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0162) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 09:58:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 11:58:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140403165846.5EEF72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24318?compare_to=24308&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24318, Order: 205525, Start Time: 2014-04-03 12:09:46, End Time: 2014-04-03 17:05:00 To: 24308, Order: 205512, Start Time: 2014-04-03 07:09:33, End Time: 2014-04-03 12:05:01 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (149 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/fixups: 250.00% (0.0080 => 0.0280, std.dev.: 0.0028) SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.81% (0.0840 => 0.1040, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2200 => 0.2360, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.87% (1.3921 => 1.4321, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.9200 => 1.9640, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.92% (0.6240 => 0.6360, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.24% (1.6081 => 1.6281, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.79% (0.3080 => 0.3320, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.72% (0.9321 => 1.0041, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.49% (3.5402 => 3.6282, std.dev.: 0.0323) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0075) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0095) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0080) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 395.28% (0.2520 => 1.2481, std.dev.: 0.0087) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0078) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0078) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 65.00% (0.0800 => 0.1320, std.dev.: 0.0069) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.57% (0.7040 => 1.0600, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C/matrixTranspose: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0094) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.67% (1.2321 => 1.5361, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.11% (1.2481 => 1.5241, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.77% (1.1761 => 1.4321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0087) MultiSource/Applications/obsequi/Obsequi: 21.55% (1.3920 => 1.6920, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.33% (1.2001 => 1.4441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.00% (1.1401 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.79% (1.1321 => 1.3561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.11% (1.1721 => 1.3961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.75% (1.1521 => 1.3681, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.53% (1.1441 => 1.3561, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.21% (1.2521 => 1.4801, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.18% (0.0880 => 0.1040, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: 18.00% (8.5802 => 10.1243, std.dev.: 0.0475) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.60% (1.1361 => 1.3361, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.13% (1.2841 => 1.5041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.67% (1.2001 => 1.4001, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.18% (1.3841 => 1.6081, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 15.21% (19.5406 => 22.5127, std.dev.: 0.0572) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.65% (5.3360 => 6.0641, std.dev.: 0.0349) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 12.43% (1.3521 => 1.5201, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 8.92% (11.3843 => 12.4003, std.dev.: 0.0432) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 8.59% (6.2844 => 6.8244, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.34% (11.4440 => 12.2840, std.dev.: 0.0357) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.05% (5.7280 => 6.1320, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.77% (5.6680 => 6.0520, std.dev.: 0.0397) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.14% (9.5802 => 10.1682, std.dev.: 0.0470) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0160) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.69% (1.1240 => 1.1880, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.36% (0.2240 => 0.2360, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2760 => 0.2880, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0136) MultiSource/Applications/lua/lua: 4.11% (4.7720 => 4.9680, std.dev.: 0.0268) SingleSource/UnitTests/Vector/constpool: 3.85% (11.0207 => 11.4447, std.dev.: 0.0999) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (1.3400 => 1.3840, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (6.8280 => 7.0200, std.dev.: 0.0476) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (1.7320 => 1.7800, std.dev.: 0.0184) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.68% (49.1529 => 50.4689, std.dev.: 0.1202) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0150) MultiSource/Applications/ClamAV/clamscan: 2.35% (19.2243 => 19.6764, std.dev.: 0.0625) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 2.17% (24.7575 => 25.2935, std.dev.: 0.0477) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (2.7282 => 2.7802, std.dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: 1.28% (39.0726 => 39.5726, std.dev.: 0.0830) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.3000 => 0.3320, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.53% (3.9842 => 4.2843, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.70% (6.8204 => 7.0044, std.dev.: 0.0468) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.87% (4.0563 => 4.1323, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/methcall: -45.45% (0.0440 => 0.0240, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0012) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0892) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0192) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3401 => 2.3121, std.dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 10:33:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 12:33:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403173325.F1B952A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24319?compare_to=24315&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24319, Order: 205530, Start Time: 2014-04-03 12:52:42, End Time: 2014-04-03 17:39:40 To: 24315, Order: 205523, Start Time: 2014-04-03 11:32:41, End Time: 2014-04-03 16:20:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (97 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C++/EH/function_try_block: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.73% (1.0280 => 1.1280, std.dev.: 0.0267) MultiSource/Benchmarks/sim/sim: 4.76% (0.3360 => 0.3520, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.70% (1.3321 => 1.3681, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 41.67% (0.0480 => 0.0680, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.17% (3.4202 => 3.4602, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/hash: 1.13% (4.2483 => 4.2963, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 40.00% (0.0400 => 0.0560, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.82% (0.1560 => 0.1760, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.38% (1.1921 => 1.2681, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0638) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.16% (1.3641 => 1.4481, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0231) SingleSource/UnitTests/Vector/constpool: 4.48% (10.8967 => 11.3847, std.dev.: 0.1529) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0487) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0204) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0402) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0348) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (5.8000 => 5.9520, std.dev.: 0.0501) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 2.32% (17.6165 => 18.0245, std.dev.: 0.0613) MultiSource/Applications/sqlite3/sqlite3: 2.29% (23.7574 => 24.3015, std.dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 2.01% (37.0925 => 37.8365, std.dev.: 0.0714) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0386) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0105) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.62% (48.1088 => 48.8889, std.dev.: 0.0899) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0196) MultiSource/Applications/kimwitu++/kc: 1.19% (18.8170 => 19.0410, std.dev.: 0.0565) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0397) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 5.29% (6.6564 => 7.0084, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.2601 => 1.2841, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.89% (1.2601 => 1.1481, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3361 => 2.3081, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 11:30:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 13:30:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403183046.297B72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24320?compare_to=24319&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24320, Order: 205537, Start Time: 2014-04-03 13:52:10, End Time: 2014-04-03 18:36:59 To: 24319, Order: 205530, Start Time: 2014-04-03 12:52:42, End Time: 2014-04-03 17:39:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (101 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 40.00% (0.0400 => 0.0560, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3080 => 0.3320, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.21% (1.2681 => 1.2961, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.93% (1.4481 => 1.4761, std.dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: 1.72% (11.3847 => 11.5807, std.dev.: 0.0444) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0066) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.37% (0.1960 => 0.2320, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.57% (1.2161 => 1.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.05% (1.1921 => 1.2761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 6.77% (1.2401 => 1.3241, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (10.6960 => 11.3840, std.dev.: 0.0762) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: 6.28% (10.8967 => 11.5807, std.dev.: 0.0444) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (6.0160 => 6.3640, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0146) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0070) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0397) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.39% (8.1441 => 8.4201, std.dev.: 0.0590) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0414) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0465) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0452) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0472) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0251) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.4400 => 1.4720, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (5.8400 => 5.9560, std.dev.: 0.0425) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8166, std.dev.: 0.0550) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0446) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.85% (48.1088 => 49.0010, std.dev.: 0.0656) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0178) MultiSource/Applications/kimwitu++/kc: 1.25% (18.8170 => 19.0530, std.dev.: 0.0698) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 5.35% (6.6564 => 7.0124, std.dev.: 0.0218) MultiSource/Applications/obsequi/Obsequi: 3.48% (2.0681 => 2.1401, std.dev.: 0.0171) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/bmm/bmm: -19.05% (0.0840 => 0.0680, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0169) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 12:14:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 14:14:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403191450.D0C572A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24321?compare_to=24320&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24321, Order: 205538, Start Time: 2014-04-03 14:33:55, End Time: 2014-04-03 19:21:05 To: 24320, Order: 205537, Start Time: 2014-04-03 13:52:10, End Time: 2014-04-03 18:36:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (103 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-4: 166.67% (0.0120 => 0.0320, std.dev.: 0.0057) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.07% (0.3960 => 0.4240, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 5.92% (0.6760 => 0.7160, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.49% (0.3440 => 0.3560, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.69% (0.8921 => 0.9161, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.9481 => 0.9681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.25% (1.2841 => 1.3001, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.62% (1.6801 => 1.7241, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.2521 => 1.2761, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0063) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.61% (1.2081 => 1.3121, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.98% (1.2601 => 1.3481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.92% (1.1561 => 1.2361, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.17% (1.2321 => 1.3081, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (10.6960 => 11.3200, std.dev.: 0.0712) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0105) SingleSource/UnitTests/Vector/constpool: 4.66% (10.8967 => 11.4047, std.dev.: 0.1051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (8.1441 => 8.4561, std.dev.: 0.0446) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0174) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0432) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.8000 => 5.9560, std.dev.: 0.0432) MultiSource/Applications/obsequi/Obsequi: 2.53% (1.2640 => 1.2960, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0578) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0284) MultiSource/Benchmarks/Bullet/bullet: 2.01% (37.0925 => 37.8366, std.dev.: 0.0502) MultiSource/Applications/sqlite3/sqlite3: 1.95% (23.7574 => 24.2215, std.dev.: 0.0438) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0210, std.dev.: 0.0741) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.63% (4.9000 => 4.9800, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0141) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 1.30% (18.8170 => 19.0610, std.dev.: 0.0487) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 9.09% (0.1320 => 0.1440, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 5.41% (6.6564 => 7.0164, std.dev.: 0.0304) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0091) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0463) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -19.05% (0.0840 => 0.0680, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: -2.60% (1.3841 => 1.3481, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 13:12:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 15:12:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403201243.C3AFB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24322?compare_to=24321&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24322, Order: 205540, Start Time: 2014-04-03 15:29:43, End Time: 2014-04-03 20:18:58 To: 24321, Order: 205538, Start Time: 2014-04-03 14:33:55, End Time: 2014-04-03 19:21:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (93 on baseline) Performance Improvements: 2 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (1005 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2008-01-07-LongDouble: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Queens: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.09% (0.1760 => 0.1920, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.14% (1.3081 => 1.3361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.78% (1.3481 => 1.3721, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.20% (1.3281 => 1.3441, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: -80.00% (0.0200 => 0.0040, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -2.15% (0.7440 => 0.7280, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0126) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0530) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0174) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0237) SingleSource/UnitTests/Vector/constpool: 4.44% (10.8967 => 11.3807, std.dev.: 0.1469) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0170) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0333) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0049) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.90% (5.8000 => 5.9680, std.dev.: 0.0437) MultiSource/Applications/JM/lencod/lencod: 2.59% (17.6165 => 18.0725, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (5.8400 => 5.9560, std.dev.: 0.0315) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0125) MultiSource/Benchmarks/Bullet/bullet: 1.94% (37.0925 => 37.8125, std.dev.: 0.0830) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0409) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.73% (48.1088 => 48.9410, std.dev.: 0.0535) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (7.8562 => 7.9882, std.dev.: 0.0381) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1290, std.dev.: 0.0324) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0127) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0127) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.49% (0.7280 => 0.7680, std.dev.: 0.0113) MultiSource/Applications/minisat/minisat: 4.57% (6.6564 => 6.9604, std.dev.: 0.0361) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0189) MultiSource/Applications/obsequi/Obsequi: 2.13% (2.0681 => 2.1121, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.68% (4.5203 => 4.5963, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bisort/bisort: -2.15% (0.7440 => 0.7280, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 13:43:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 15:43:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403204300.685692A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24323?compare_to=24313&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24323, Order: 205540, Start Time: 2014-04-03 16:00:17, End Time: 2014-04-03 20:49:19 To: 24313, Order: 205523, Start Time: 2014-04-03 11:05:20, End Time: 2014-04-03 15:54:20 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 22 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1090 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-08-20-FoldBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 53.33% (0.0600 => 0.0920, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: 33.33% (0.0480 => 0.0640, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.12% (0.1960 => 0.2080, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.53% (0.3400 => 0.3520, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 3.39% (0.4720 => 0.4880, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3600 => 0.3720, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.58% (0.6200 => 0.6360, std.dev.: 0.0047) MultiSource/Applications/d/make_dparser: 2.07% (4.0561 => 4.1401, std.dev.: 0.0165) MultiSource/Benchmarks/nbench/nbench: 1.93% (1.8681 => 1.9041, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/nestedloop: 1.80% (1.1081 => 1.1281, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.72% (2.0880 => 2.1240, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.38% (1.7401 => 1.7641, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.35% (1.7761 => 1.8001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.03% (1.9401 => 1.9601, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0113) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 13:48:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 15:48:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140403204821.6606E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24324?compare_to=24314&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24324, Order: 205540, Start Time: 2014-04-03 16:04:36, End Time: 2014-04-03 20:54:36 To: 24314, Order: 205523, Start Time: 2014-04-03 11:08:13, End Time: 2014-04-03 15:58:37 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (141 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/casts: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 11.54% (0.1040 => 0.1160, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.78% (0.3600 => 0.3880, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (1.5960 => 1.6400, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.63% (1.7201 => 1.7481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.54% (1.5601 => 1.5841, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.01% (1.5841 => 1.6001, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.33% (0.0360 => 0.0480, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/strcat: 27.59% (0.1160 => 0.1480, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.79% (0.3080 => 0.3320, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.35% (11.3687 => 31.1899, std.dev.: 0.0489) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0101) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0048) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.00% (0.0960 => 0.1200, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0150) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.3640 => 0.4160, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.82% (0.3120 => 0.3520, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.49% (0.3480 => 0.3880, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.1800 => 0.2000, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.44% (1.6521 => 1.8081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.23% (1.5601 => 1.7041, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 8.48% (0.6600 => 0.7160, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.39% (0.6200 => 0.6720, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.27% (1.5481 => 1.6761, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0260) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.20% (1.0240 => 1.1080, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.7361 => 1.8681, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.95% (1.7841 => 1.9081, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0109) SingleSource/UnitTests/Vector/constpool: 6.44% (10.6247 => 11.3087, std.dev.: 0.1223) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.35% (1.4481 => 1.5401, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.20% (1.4841 => 1.5761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.13% (1.4361 => 1.5241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (11.6440 => 12.3240, std.dev.: 0.0575) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0096) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (9.4842 => 10.0242, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0107) MultiSource/Applications/spiff/spiff: 5.56% (1.0080 => 1.0640, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.7400 => 1.8360, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (1.7401 => 1.8361, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.44% (6.4680 => 6.8200, std.dev.: 0.0409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.7000 => 0.7360, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (1.5600 => 1.6400, std.dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 5.06% (10.0443 => 10.5523, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0286) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.52% (0.7960 => 0.8320, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0304) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (5.3600 => 5.5760, std.dev.: 0.0394) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 3.70% (21.9606 => 22.7728, std.dev.: 0.0728) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0186) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (6.5080 => 6.7320, std.dev.: 0.0515) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.44% (50.0290 => 51.7490, std.dev.: 0.1061) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4720 => 0.4880, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (3.0282 => 3.1282, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.18% (6.5440 => 6.7520, std.dev.: 0.0489) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (4.1843 => 4.3163, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 3.02% (38.4046 => 39.5646, std.dev.: 0.0625) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.7480 => 0.7680, std.dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 2.67% (18.4404 => 18.9326, std.dev.: 0.0415) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0263) MultiSource/Applications/kimwitu++/kc: 2.28% (19.6891 => 20.1371, std.dev.: 0.0299) MultiSource/Applications/ClamAV/clamscan: 2.23% (19.0444 => 19.4683, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (16.3483 => 16.6803, std.dev.: 0.0479) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0563 => 13.1883, std.dev.: 0.0290) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0268) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.14% (2.1401 => 2.4642, std.dev.: 0.0307) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.44% (0.7200 => 0.7520, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 1.51% (3.9842 => 4.0443, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -77.18% (2.9442 => 0.6720, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: -5.14% (1.8680 => 1.7720, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.51% (91.8497 => 49.1311, std.dev.: 8.4373) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.47% (50.3031 => 32.9621, std.dev.: 0.2240) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.01% (26.0616 => 17.1971, std.dev.: 0.0573) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.68% (42.1466 => 28.7938, std.dev.: 0.3622) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.0912) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (1.3761 => 1.3521, std.dev.: 0.0068) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.17% (2.7442 => 2.7122, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0186) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 14:07:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 16:07:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403210704.24BD72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24325?compare_to=24322&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24325, Order: 205541, Start Time: 2014-04-03 16:26:00, End Time: 2014-04-03 21:13:17 To: 24322, Order: 205540, Start Time: 2014-04-03 15:29:43, End Time: 2014-04-03 20:18:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (101 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/family/family: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 25.00% (0.0640 => 0.0800, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.49% (0.6320 => 0.6920, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.31% (0.4440 => 0.4720, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.00% (0.4000 => 0.4120, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.9920 => 2.0400, std.dev.: 0.0180) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.17% (0.3240 => 0.3440, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.54% (1.1041 => 1.1321, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.39% (1.7321 => 1.7081, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.4602 => 2.4282, std.dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.50% (1.1761 => 1.2761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.49% (1.2281 => 1.3201, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.42% (1.2401 => 1.3321, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.10% (10.6960 => 11.3480, std.dev.: 0.0525) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 6.06% (0.3960 => 0.4200, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: 4.99% (10.8967 => 11.4407, std.dev.: 0.1092) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0177) MultiSource/Benchmarks/McCat/05-eks/eks: 4.12% (0.6800 => 0.7080, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0180) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (8.1441 => 8.4481, std.dev.: 0.0513) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0326) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0385) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0301) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0339) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.8000 => 5.9560, std.dev.: 0.0511) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0451) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.85% (48.1088 => 49.0009, std.dev.: 0.0692) MultiSource/Benchmarks/Bullet/bullet: 1.81% (37.0925 => 37.7645, std.dev.: 0.0704) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.63% (4.9000 => 4.9800, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 1.51% (18.8170 => 19.1010, std.dev.: 0.0440) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 5.17% (6.6564 => 7.0004, std.dev.: 0.0440) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0058) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.89% (1.6601 => 1.7081, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0217) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0289) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0028) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/mason/mason: -15.79% (0.0760 => 0.0640, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3361 => 2.3081, std.dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 14:17:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 16:17:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140403211706.9CAB12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24326?compare_to=24316&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24326, Order: 205541, Start Time: 2014-04-03 16:32:37, End Time: 2014-04-03 21:23:24 To: 24316, Order: 205523, Start Time: 2014-04-03 11:35:04, End Time: 2014-04-03 16:26:18 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (125 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (956 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.1120 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 12.22% (0.3600 => 0.4040, std.dev.: 0.0150) SingleSource/Benchmarks/McGill/chomp: 4.92% (0.2440 => 0.2560, std.dev.: 0.0040) SingleSource/Regression/C/sumarray2d: 1.84% (0.6520 => 0.6640, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.20% (1.3361 => 1.3521, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0482 => 3.0802, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 25.00% (0.1120 => 0.1400, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0057) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 36.17% (0.1880 => 0.2560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.11% (1.7241 => 2.0881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.52% (1.6961 => 2.0441, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.13% (1.8081 => 2.1721, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.33% (1.8001 => 2.1481, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.28% (1.6801 => 2.0041, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.07% (1.8881 => 2.2481, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.96% (1.9601 => 2.3121, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/tsp/tsp: 17.65% (0.1360 => 0.1600, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.11% (1.9641 => 2.3001, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.63% (0.1640 => 0.1880, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: 9.43% (0.2120 => 0.2320, std.dev.: 0.0075) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.7880 => 12.5080, std.dev.: 0.0413) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.00% (0.2000 => 0.2120, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.83% (6.7200 => 7.1120, std.dev.: 0.0361) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9920 => 1.0480, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/football/football: 4.73% (1.1000 => 1.1520, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 4.51% (4.7920 => 5.0080, std.dev.: 0.0239) SingleSource/UnitTests/Vector/constpool: 4.47% (10.9087 => 11.3967, std.dev.: 0.1629) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (1.6481 => 1.7201, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.20% (1.5240 => 1.5880, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.97% (9.9842 => 10.3802, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (2.0680 => 2.1480, std.dev.: 0.0257) MultiSource/Applications/d/make_dparser: 3.73% (3.9641 => 4.1121, std.dev.: 0.0235) MultiSource/Applications/oggenc/oggenc: 3.65% (6.9124 => 7.1644, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.4680 => 0.4840, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.99% (6.8321 => 7.0361, std.dev.: 0.0387) MultiSource/Applications/treecc/treecc: 2.90% (2.6200 => 2.6960, std.dev.: 0.0272) MultiSource/Applications/JM/lencod/lencod: 2.74% (22.6287 => 23.2487, std.dev.: 0.0538) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (10.3203 => 10.5923, std.dev.: 0.0386) MultiSource/Applications/SPASS/SPASS: 2.58% (18.4924 => 18.9686, std.dev.: 0.0559) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (2.0440 => 2.0960, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2203 => 4.3123, std.dev.: 0.0135) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.03% (51.1089 => 52.1489, std.dev.: 0.1194) MultiSource/Benchmarks/Bullet/bullet: 1.99% (38.9366 => 39.7126, std.dev.: 0.1108) MultiSource/Applications/kimwitu++/kc: 1.97% (19.7371 => 20.1251, std.dev.: 0.0357) MultiSource/Applications/ClamAV/clamscan: 1.90% (20.2445 => 20.6285, std.dev.: 0.0870) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (16.5963 => 16.8443, std.dev.: 0.0537) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (6.0244 => 6.1084, std.dev.: 0.0267) MultiSource/Applications/sqlite3/sqlite3: 1.19% (25.1895 => 25.4895, std.dev.: 0.0676) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7722 => 2.8002, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/flops: 24.36% (7.3405 => 9.1286, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.51% (1.2681 => 1.4521, std.dev.: 0.0132) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0385) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.74% (4.1323 => 4.2043, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 1.72% (21.6534 => 22.0254, std.dev.: 0.0571) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (4.2443 => 4.3083, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.43% (4.7563 => 4.8243, std.dev.: 0.0133) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.50% (6.2884 => 1.3521, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/nestedloop: -64.78% (2.9642 => 1.0441, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.33% (3.1762 => 1.2601, std.dev.: 0.0068) MultiSource/Applications/obsequi/Obsequi: -33.39% (2.6481 => 1.7640, std.dev.: 0.0195) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.90% (7.4801 => 6.2160, std.dev.: 0.0425) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.47% (7.5041 => 6.2680, std.dev.: 0.0435) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -7.26% (0.7160 => 0.6640, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (13.5243 => 13.1243, std.dev.: 0.0367) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -15.03% (7.8005 => 6.6284, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.39% (5.8884 => 5.5123, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (5.1603 => 5.0403, std.dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -1.52% (4.9883 => 4.9123, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 14:24:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 16:24:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140403212457.1E3682A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24327?compare_to=24317&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24327, Order: 205541, Start Time: 2014-04-03 16:38:15, End Time: 2014-04-03 21:31:11 To: 24317, Order: 205523, Start Time: 2014-04-03 11:39:25, End Time: 2014-04-03 16:32:21 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 7 (122 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (958 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/UnitTests/SignlessTypes/cast-bug: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 8.42% (0.3800 => 0.4120, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.13% (4.6043 => 4.7483, std.dev.: 0.0396) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.50% (17.6723 => 19.5284, std.dev.: 0.0786) MultiSource/Applications/sqlite3/sqlite3: 1415.53% (1.7001 => 25.7656, std.dev.: 0.0402) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.30% (50.1010 => 51.7530, std.dev.: 0.1010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (1.0520 => 1.1240, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (11.3920 => 12.3080, std.dev.: 0.0380) SingleSource/Benchmarks/Misc/oourafft: 175.06% (11.3407 => 31.1939, std.dev.: 0.0860) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0080) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0108) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/cast-bug: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Quicksort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/UnitTests/vla: 50.00% (0.0320 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.60% (1.8081 => 2.0721, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.97% (1.9121 => 2.1601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4042, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (1.8361 => 2.0521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.41% (1.8441 => 2.0361, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/09-vor/vor: 9.57% (0.3760 => 0.4120, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0045) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.65% (0.4160 => 0.4520, std.dev.: 0.0108) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 8.54% (0.3280 => 0.3560, std.dev.: 0.0100) SingleSource/UnitTests/Vector/constpool: 7.81% (10.4007 => 11.2127, std.dev.: 0.1133) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.57% (0.7400 => 0.7960, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0172) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.60% (2.9721 => 3.1682, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (6.4800 => 6.8680, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0171) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0095) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0222) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (9.6042 => 10.0402, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4920 => 0.5120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (5.8281 => 6.0441, std.dev.: 0.0377) MultiSource/Applications/hbd/hbd: 3.47% (1.7280 => 1.7880, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (5.3960 => 5.5800, std.dev.: 0.0242) MultiSource/Applications/lua/lua: 3.17% (4.7920 => 4.9440, std.dev.: 0.0253) MultiSource/Applications/oggenc/oggenc: 2.95% (7.0524 => 7.2605, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (16.3003 => 16.7683, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.57% (6.5360 => 6.7040, std.dev.: 0.0454) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.45% (6.5320 => 6.6920, std.dev.: 0.0612) MultiSource/Applications/JM/lencod/lencod: 2.43% (22.2206 => 22.7608, std.dev.: 0.0670) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (2.3401 => 2.3961, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0157) MultiSource/Applications/SPASS/SPASS: 2.27% (18.5284 => 18.9485, std.dev.: 0.0491) MultiSource/Benchmarks/Bullet/bullet: 2.26% (38.6366 => 39.5086, std.dev.: 0.0637) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.95% (1.0241 => 1.0441, std.dev.: 0.0065) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0190) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (10.2283 => 10.3723, std.dev.: 0.0476) MultiSource/Applications/siod/siod: 1.31% (2.7522 => 2.7882, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 1.15% (19.8291 => 20.0571, std.dev.: 0.0452) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.10% (2.1201 => 2.4402, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 5.59% (2.8642 => 3.0242, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.00% (6.5964 => 6.7284, std.dev.: 0.0389) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.63% (3.9442 => 4.0083, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -77.00% (2.9562 => 0.6800, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: -5.97% (1.8760 => 1.7640, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.27% (94.8339 => 49.0551, std.dev.: 9.6626) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.90% (25.7136 => 16.9971, std.dev.: 0.1403) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.90% (49.9431 => 33.0141, std.dev.: 0.1820) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.92% (3.0722 => 2.3681, std.dev.: 0.0992) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.30% (37.0863 => 28.8178, std.dev.: 0.3964) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0208) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 15:13:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 17:13:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140403221321.911102A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24328?compare_to=24318&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24328, Order: 205543, Start Time: 2014-04-03 17:26:03, End Time: 2014-04-03 22:19:39 To: 24318, Order: 205525, Start Time: 2014-04-03 12:09:46, End Time: 2014-04-03 17:05:00 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 18 (152 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/short_circuit_dtor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/methcall: 66.67% (0.0240 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 9.09% (0.1320 => 0.1440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.80% (0.7360 => 0.7640, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.65% (1.5120 => 1.5520, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.83% (1.5280 => 1.5560, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 1.82% (5.4840 => 5.5840, std.dev.: 0.0307) MultiSource/Applications/siod/siod: 1.30% (2.7602 => 2.7962, std.dev.: 0.0102) SingleSource/Benchmarks/Stanford/Puzzle: 1.25% (1.6001 => 1.6201, std.dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: 1.00% (19.9371 => 20.1371, std.dev.: 0.0317) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/stmtexpr: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1950.00% (0.0320 => 0.6560, std.dev.: 0.0112) SingleSource/Benchmarks/Stanford/Puzzle: 1206.53% (0.1240 => 1.6201, std.dev.: 0.0072) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 757.89% (0.0760 => 0.6520, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 392.10% (0.2520 => 1.2401, std.dev.: 0.0160) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0080) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0052) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 115.38% (0.1040 => 0.2240, std.dev.: 0.0063) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0042) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.87% (1.2401 => 1.5361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: 21.84% (1.3920 => 1.6960, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 18.42% (8.5802 => 10.1603, std.dev.: 0.0388) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.21% (1.2521 => 1.4801, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.18% (1.1441 => 1.3521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.84% (1.1881 => 1.4001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.53% (1.2321 => 1.4481, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.13% (1.2841 => 1.5041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.00% (1.2001 => 1.4041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 15.31% (19.5406 => 22.5327, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.47% (5.3360 => 6.1081, std.dev.: 0.0268) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.6800 => 0.7640, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0170) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.11% (0.1800 => 0.2000, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 9.14% (11.3843 => 12.4243, std.dev.: 0.0381) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0198) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.19% (5.6680 => 6.1320, std.dev.: 0.0375) SingleSource/UnitTests/Vectorizer/gcc-loops: 7.91% (0.5560 => 0.6000, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (11.4440 => 12.2480, std.dev.: 0.0687) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.77% (5.7280 => 6.1160, std.dev.: 0.0653) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.47% (9.5802 => 10.2002, std.dev.: 0.0533) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (0.4960 => 0.5200, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.42% (0.4520 => 0.4720, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (1.6240 => 1.6920, std.dev.: 0.0258) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.1480 => 1.1960, std.dev.: 0.0118) MultiSource/Applications/lua/lua: 4.11% (4.7720 => 4.9680, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.90% (1.2320 => 1.2800, std.dev.: 0.0179) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (5.3840 => 5.5840, std.dev.: 0.0307) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (6.8280 => 7.0640, std.dev.: 0.0511) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (1.7600 => 1.8200, std.dev.: 0.0175) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0103) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.26% (49.1529 => 50.7529, std.dev.: 0.0823) MultiSource/Applications/ClamAV/clamscan: 2.91% (19.2243 => 19.7844, std.dev.: 0.0264) MultiSource/Applications/hbd/hbd: 2.69% (1.7840 => 1.8320, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 2.34% (24.7575 => 25.3375, std.dev.: 0.0316) MultiSource/Applications/SIBsim4/SIBsim4: 2.12% (1.6961 => 1.7321, std.dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 1.96% (19.7491 => 20.1371, std.dev.: 0.0317) MultiSource/Benchmarks/Bullet/bullet: 1.68% (39.0726 => 39.7286, std.dev.: 0.0690) MultiSource/Applications/siod/siod: 1.45% (2.7562 => 2.7962, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0701) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0183) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 2.87% (6.8204 => 7.0164, std.dev.: 0.0333) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0937) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: -1.76% (4.9963 => 4.9083, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.0963 => 5.0323, std.dev.: 0.0175) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 15:41:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 17:41:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403224152.7E7792A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24329?compare_to=24325&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24329, Order: 205543, Start Time: 2014-04-03 18:00:48, End Time: 2014-04-03 22:47:48 To: 24325, Order: 205541, Start Time: 2014-04-03 16:26:00, End Time: 2014-04-03 21:13:17 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (101 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-20-FoldBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 35.29% (0.0680 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.63% (0.4320 => 0.4520, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 4.46% (0.4480 => 0.4680, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.68% (0.7600 => 0.7880, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: 3.03% (0.7920 => 0.8160, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (1.6161 => 1.6561, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.82% (1.7600 => 1.7920, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4282 => 2.4562, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 30.77% (0.0520 => 0.0680, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.16% (1.1761 => 1.2721, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.10% (1.2401 => 1.3281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0520) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: 5.32% (10.8967 => 11.4767, std.dev.: 0.1762) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.7080 => 1.7920, std.dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0574) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0185) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0322) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0459) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0458) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0338) MultiSource/Applications/lua/lua: 2.83% (4.5200 => 4.6480, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0406) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0504) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0335) MultiSource/Benchmarks/Bullet/bullet: 2.01% (37.0925 => 37.8366, std.dev.: 0.0673) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.85% (48.1088 => 49.0010, std.dev.: 0.1356) MultiSource/Applications/sqlite3/sqlite3: 1.84% (23.7574 => 24.1935, std.dev.: 0.0449) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0146) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.6321 => 1.6561, std.dev.: 0.0087) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0181) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0734) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0247) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.53% (0.3040 => 0.3360, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0579) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0154) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -33.33% (0.0360 => 0.0240, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 6.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 16:37:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 18:37:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140403233721.2C4272A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24330?compare_to=24329&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24330, Order: 205549, Start Time: 2014-04-03 18:58:04, End Time: 2014-04-03 23:43:35 To: 24329, Order: 205543, Start Time: 2014-04-03 18:00:48, End Time: 2014-04-03 22:47:48 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (107 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C/sumarraymalloc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: 40.00% (0.0400 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.52% (0.1680 => 0.1840, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2960 => 0.3120, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.26% (1.0640 => 1.1200, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.02% (0.6960 => 0.7240, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.83% (1.2721 => 1.3081, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 1.89% (4.6480 => 4.7360, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.49% (1.3401 => 1.3601, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (8.5081 => 8.6001, std.dev.: 0.0286) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0018) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0043) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0076) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.87% (0.1840 => 0.2040, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (10.6960 => 11.5120, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (6.0160 => 6.4640, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.60% (8.1441 => 8.6001, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: 5.21% (10.8967 => 11.4647, std.dev.: 0.0698) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0165) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0313) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0192) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0319) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 3.36% (17.6165 => 18.2085, std.dev.: 0.0591) MultiSource/Applications/sqlite3/sqlite3: 2.59% (23.7574 => 24.3735, std.dev.: 0.0348) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0123) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0149) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2329, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0385) MultiSource/Benchmarks/Bullet/bullet: 2.30% (37.0925 => 37.9446, std.dev.: 0.0480) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0361) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1490, std.dev.: 0.0495) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0211) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0741) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0181) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0318) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0075) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0165) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0221) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (4.0643 => 4.1283, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (1.3481 => 1.3321, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.08% (1.4881 => 1.4721, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 3 17:18:51 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 03 Apr 2014 17:18:51 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140404001855.B1CDB4F04E6D@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/725 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205483 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpTflCSPexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpTflCSPexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpk38Aezexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpk38Aezexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Thu Apr 3 17:21:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 19:21:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140404002156.A7F5F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24331?compare_to=24330&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24331, Order: 205554, Start Time: 2014-04-03 19:42:05, End Time: 2014-04-04 00:28:06 To: 24330, Order: 205549, Start Time: 2014-04-03 18:58:04, End Time: 2014-04-03 23:43:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (111 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.00% (0.1600 => 0.1840, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.70% (0.4440 => 0.4560, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.05% (1.3681 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.54% (1.2961 => 1.3161, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.34% (5.9760 => 6.0560, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.28% (1.2481 => 1.2641, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (2.6202 => 2.6482, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 23.08% (0.0520 => 0.0640, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 12.86% (1.2441 => 1.4041, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.38% (5.3883 => 5.5163, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.03% (1.1641 => 1.1761, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/SignlessTypes/Large/cast: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.75% (1.2721 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.06% (0.2480 => 0.2680, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0390) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0431) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 4.98% (1.1240 => 1.1800, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0492) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.59% (0.4360 => 0.4560, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (5.8000 => 6.0640, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 4.42% (10.4082 => 10.8682, std.dev.: 0.0291) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0238) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0333) MultiSource/Applications/JM/lencod/lencod: 3.70% (17.6165 => 18.2685, std.dev.: 0.0412) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (5.8400 => 6.0560, std.dev.: 0.0233) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.64% (0.9880 => 1.0240, std.dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: 3.63% (10.8967 => 11.2927, std.dev.: 0.1366) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 2.53% (23.7574 => 24.3575, std.dev.: 0.0309) MultiSource/Benchmarks/Bullet/bullet: 2.45% (37.0925 => 38.0005, std.dev.: 0.0547) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.44% (1.1480 => 1.1760, std.dev.: 0.0080) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.36% (48.1088 => 49.2450, std.dev.: 0.0718) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: 2.32% (2.5882 => 2.6482, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.87% (18.8170 => 19.1690, std.dev.: 0.0514) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0210) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0422) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 28.32% (0.9321 => 1.1961, std.dev.: 0.0182) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0271) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0321) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0336) MultiSource/Applications/lua/lua: 1.10% (21.1533 => 21.3853, std.dev.: 0.0328) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 18:23:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 20:23:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140404012330.6899E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24332?compare_to=24331&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24332, Order: 205560, Start Time: 2014-04-03 20:39:50, End Time: 2014-04-04 01:29:39 To: 24331, Order: 205554, Start Time: 2014-04-03 19:42:05, End Time: 2014-04-04 00:28:06 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (113 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Towers: 40.00% (0.0400 => 0.0560, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.67% (0.0600 => 0.0760, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.17% (0.9201 => 0.9401, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.18% (2.3961 => 2.4962, std.dev.: 0.0365) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.43% (1.3961 => 1.3761, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 29.41% (0.0680 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0112) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0633) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0568) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (8.1441 => 8.5641, std.dev.: 0.0380) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0183) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0339) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0229) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0169) SingleSource/UnitTests/Vector/constpool: 4.29% (10.8967 => 11.3647, std.dev.: 0.1354) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0369) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0460) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0076) MultiSource/Applications/hbd/hbd: 3.33% (1.6800 => 1.7360, std.dev.: 0.0175) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 3.27% (17.6165 => 18.1925, std.dev.: 0.0447) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0465) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0501) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 2.45% (2.4480 => 2.5080, std.dev.: 0.0199) MultiSource/Applications/sqlite3/sqlite3: 2.39% (23.7574 => 24.3255, std.dev.: 0.0530) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0418) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0107) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.21% (48.1088 => 49.1730, std.dev.: 0.0736) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8886, std.dev.: 0.1021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0314) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (2.5882 => 2.6402, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 1.85% (18.8170 => 19.1650, std.dev.: 0.0231) MultiSource/Applications/SPASS/SPASS: 1.73% (17.5484 => 17.8524, std.dev.: 0.0463) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0460) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (15.2282 => 15.3882, std.dev.: 0.0608) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0333) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: 2.13% (2.0681 => 2.1121, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0240) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0492) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0241) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (1.3481 => 1.3321, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 18:53:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 20:53:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140404015344.EBD5E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24333?compare_to=24323&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24333, Order: 205562, Start Time: 2014-04-03 21:10:40, End Time: 2014-04-04 01:59:57 To: 24323, Order: 205540, Start Time: 2014-04-03 16:00:17, End Time: 2014-04-03 20:49:19 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1094 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/conditional-gnu-ext-cxx: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/15-trie/trie: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.67% (0.2400 => 0.2680, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.09% (0.1320 => 0.1440, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.33% (0.1440 => 0.1560, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 8.22% (0.2920 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.23% (0.9960 => 1.0680, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (1.5440 => 1.6120, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (1.0241 => 1.0441, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.64% (7.0520 => 7.1680, std.dev.: 0.0256) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.43% (10.3602 => 10.5082, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.32% (1.8121 => 1.8361, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (16.8403 => 17.0363, std.dev.: 0.0268) SingleSource/Benchmarks/Stanford/Puzzle: 1.09% (1.8321 => 1.8521, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/throw_rethrow_test: -50.00% (0.0320 => 0.0160, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0139) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 4.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 19:00:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 21:00:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140404020005.0FD552A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24334?compare_to=24324&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24334, Order: 205563, Start Time: 2014-04-03 21:16:09, End Time: 2014-04-04 02:06:20 To: 24324, Order: 205540, Start Time: 2014-04-03 16:04:36, End Time: 2014-04-03 20:54:36 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 15 (143 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 44.44% (0.0360 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 23.08% (0.1040 => 0.1280, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary2: 8.11% (0.2960 => 0.3200, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.76% (0.6720 => 0.7040, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.61% (1.9841 => 2.0161, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (16.6803 => 16.8803, std.dev.: 0.0515) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (6.8200 => 6.9000, std.dev.: 0.0296) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 6.19% (0.3880 => 0.4120, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.03% (0.5960 => 0.6200, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.3761 => 1.3961, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2006-12-11-LoadConstants: -12.20% (0.1640 => 0.1440, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.81% (11.3687 => 31.2420, std.dev.: 0.1009) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7484, std.dev.: 0.0049) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0132) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0048) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.18% (0.0680 => 0.0960, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0065) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0236) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 12.73% (0.6600 => 0.7440, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.35% (0.3240 => 0.3640, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.01% (1.8161 => 2.0161, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.34% (0.3480 => 0.3840, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.74% (1.5601 => 1.7121, std.dev.: 0.0161) MultiSource/Applications/aha/aha: 9.68% (0.1240 => 0.1360, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: 9.59% (0.2920 => 0.3200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.78% (1.5481 => 1.6841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.72% (1.6521 => 1.7961, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.21% (1.6081 => 1.7401, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/18-imp/imp: 8.18% (0.4400 => 0.4760, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary3: 8.11% (0.2960 => 0.3200, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: 7.94% (1.0080 => 1.0880, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 7.69% (1.5080 => 1.6240, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0117) SingleSource/UnitTests/Vector/constpool: 7.19% (10.6247 => 11.3887, std.dev.: 0.0874) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (6.4680 => 6.9000, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.8440 => 1.9600, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.6440 => 12.3560, std.dev.: 0.0743) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.4640 => 1.5520, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0090) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (9.4842 => 10.0242, std.dev.: 0.0519) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.67% (1.6921 => 1.7881, std.dev.: 0.0176) MultiSource/Applications/sgefa/sgefa: 5.48% (0.5840 => 0.6160, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (2.0440 => 2.1480, std.dev.: 0.0222) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (10.0443 => 10.5243, std.dev.: 0.0402) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4400 => 0.4600, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 4.45% (21.9606 => 22.9368, std.dev.: 0.0474) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0120) MultiSource/Applications/hbd/hbd: 3.92% (1.7360 => 1.8040, std.dev.: 0.0161) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.90% (50.0290 => 51.9810, std.dev.: 0.0796) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (6.5080 => 6.7560, std.dev.: 0.0382) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (6.5440 => 6.7920, std.dev.: 0.0542) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.73% (4.1843 => 4.3403, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0229) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (5.3600 => 5.5480, std.dev.: 0.0478) MultiSource/Applications/oggenc/oggenc: 3.49% (6.9844 => 7.2285, std.dev.: 0.0193) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0248) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 3.35% (38.4046 => 39.6926, std.dev.: 0.0858) MultiSource/Applications/lua/lua: 3.26% (4.7880 => 4.9440, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.25% (16.3483 => 16.8803, std.dev.: 0.0515) MultiSource/Applications/SPASS/SPASS: 3.21% (18.4404 => 19.0326, std.dev.: 0.0564) MultiSource/Applications/d/make_dparser: 2.92% (3.9681 => 4.0841, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: 2.67% (19.0444 => 19.5524, std.dev.: 0.0559) MultiSource/Applications/kimwitu++/kc: 2.40% (19.6891 => 20.1611, std.dev.: 0.0367) MultiSource/Applications/siod/siod: 2.36% (2.7162 => 2.7802, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (13.0563 => 13.2323, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.21% (2.1401 => 2.4442, std.dev.: 0.0520) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0327) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4205 => 7.5885, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.09% (2.9442 => 0.7040, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.36% (1.5641 => 0.6200, std.dev.: 0.0064) MultiSource/Applications/obsequi/Obsequi: -4.50% (1.8680 => 1.7840, std.dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.66% (91.8497 => 48.9911, std.dev.: 9.9711) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.73% (50.3031 => 32.8341, std.dev.: 0.2063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.49% (26.0616 => 17.0731, std.dev.: 0.1323) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.29% (42.1466 => 28.5378, std.dev.: 0.6010) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1044) SingleSource/UnitTests/Vector/multiplies: -19.81% (1.6961 => 1.3601, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 19:13:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 21:13:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140404021347.0E9BF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24335?compare_to=24332&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24335, Order: 205565, Start Time: 2014-04-03 21:34:19, End Time: 2014-04-04 02:20:01 To: 24332, Order: 205560, Start Time: 2014-04-03 20:39:50, End Time: 2014-04-04 01:29:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (107 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/initp1: 44.44% (0.0360 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0024) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: 5.77% (0.2080 => 0.2200, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (1.3241 => 1.3441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.24% (1.2881 => 1.3041, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.00% (0.2400 => 0.2520, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0040) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.05% (1.1921 => 1.2761, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0670) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0425) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: 5.03% (10.8967 => 11.4447, std.dev.: 0.1151) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0525) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0126) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0385) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0409) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0552) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0207) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0573) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0432) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0414) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.56% (0.4680 => 0.4800, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 2.44% (23.7574 => 24.3375, std.dev.: 0.0500) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0097) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.99% (48.1088 => 49.0650, std.dev.: 0.0505) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 1.77% (37.0925 => 37.7485, std.dev.: 0.0877) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0385) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0493) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (15.2282 => 15.3842, std.dev.: 0.0372) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/strcat: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0320) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 19:29:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 21:29:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140404022939.39A702A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24336?compare_to=24326&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24336, Order: 205565, Start Time: 2014-04-03 21:44:32, End Time: 2014-04-04 02:35:52 To: 24326, Order: 205541, Start Time: 2014-04-03 16:32:37, End Time: 2014-04-03 21:23:24 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (140 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/ccc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 9.86% (0.2840 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.88% (0.2040 => 0.2160, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.3280 => 0.3440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.16% (1.0121 => 1.0441, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.47% (1.4600 => 1.4960, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 1.64% (5.5960 => 5.6880, std.dev.: 0.0320) MultiSource/Applications/siod/siod: 1.14% (2.8002 => 2.8322, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.00% (10.3802 => 10.4842, std.dev.: 0.0229) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 12.90% (0.1240 => 0.1400, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 500.00% (0.0040 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 296.51% (0.4560 => 1.8081, std.dev.: 0.0125) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.08% (1.7081 => 2.0681, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.18% (1.7641 => 2.1201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.55% (1.8001 => 2.1521, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0122) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.31% (1.9641 => 2.3041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.33% (1.9601 => 2.2801, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0056) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 7.81% (0.2560 => 0.2760, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.66% (3.5002 => 3.7682, std.dev.: 0.0163) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.85% (11.7880 => 12.5960, std.dev.: 0.0510) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: 6.42% (0.4360 => 0.4640, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (6.7200 => 7.1320, std.dev.: 0.0484) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.12% (0.7840 => 0.8320, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: 5.68% (10.9087 => 11.5287, std.dev.: 0.1214) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (1.4160 => 1.4960, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0266) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.59% (0.6440 => 0.6800, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (1.2400 => 1.3080, std.dev.: 0.0221) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (9.9842 => 10.4842, std.dev.: 0.0229) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.99% (1.5240 => 1.6000, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (1.0001 => 1.0441, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0406) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (1.6481 => 1.7161, std.dev.: 0.0105) MultiSource/Applications/treecc/treecc: 3.82% (2.6200 => 2.7200, std.dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (6.8321 => 7.0761, std.dev.: 0.0475) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (2.0440 => 2.1160, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 3.47% (6.9124 => 7.1524, std.dev.: 0.0300) MultiSource/Applications/d/make_dparser: 3.33% (3.9641 => 4.0961, std.dev.: 0.0289) MultiSource/Applications/JM/lencod/lencod: 3.25% (22.6287 => 23.3647, std.dev.: 0.0493) MultiSource/Applications/SPASS/SPASS: 3.25% (18.4924 => 19.0926, std.dev.: 0.0648) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0211) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (10.3203 => 10.6443, std.dev.: 0.0502) MultiSource/Applications/siod/siod: 2.76% (2.7562 => 2.8322, std.dev.: 0.0085) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.68% (51.1089 => 52.4809, std.dev.: 0.0972) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.5480 => 5.6880, std.dev.: 0.0320) MultiSource/Benchmarks/Bullet/bullet: 2.47% (38.9366 => 39.8966, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (16.5963 => 17.0043, std.dev.: 0.0545) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 2.31% (20.2445 => 20.7125, std.dev.: 0.0645) MultiSource/Applications/kimwitu++/kc: 2.31% (19.7371 => 20.1931, std.dev.: 0.0441) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2203 => 4.3123, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.04% (2.1560 => 2.2000, std.dev.: 0.0170) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (2.7722 => 2.8282, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.0244 => 6.1364, std.dev.: 0.0176) MultiSource/Applications/sqlite3/sqlite3: 1.79% (25.1895 => 25.6416, std.dev.: 0.0584) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.73% (3.0122 => 3.0642, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (29.4578 => 29.7699, std.dev.: 0.0465) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 27.58% (0.9281 => 1.1841, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.51% (1.2681 => 1.4521, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.90% (3.4842 => 3.6202, std.dev.: 0.0424) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0104) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (3.4402 => 3.5322, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9604 => 6.0644, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.61% (21.6534 => 22.0014, std.dev.: 0.0713) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (4.2443 => 4.3043, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (4.7563 => 4.8163, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4041 => 1.4201, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (1.0881 => 1.1001, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.82% (6.2884 => 1.3321, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/nestedloop: -64.78% (2.9642 => 1.0441, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.20% (3.1762 => 1.2641, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.31% (7.4801 => 6.2600, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.21% (7.5041 => 6.2880, std.dev.: 0.0536) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0058) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: -2.75% (13.5243 => 13.1523, std.dev.: 0.0374) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: -26.32% (0.0760 => 0.0560, std.dev.: 0.0068) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0108) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7603 => 4.6763, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -1.76% (4.9883 => 4.9003, std.dev.: 0.0156) MultiSource/Applications/JM/lencod/lencod: -1.73% (8.3085 => 8.1645, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -1.03% (11.6527 => 11.5327, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: -1.02% (25.7976 => 25.5336, std.dev.: 0.0306) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 19:39:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 21:39:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140404023940.B1A812A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24337?compare_to=24327&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24337, Order: 205571, Start Time: 2014-04-03 21:52:50, End Time: 2014-04-04 02:45:55 To: 24327, Order: 205541, Start Time: 2014-04-03 16:38:15, End Time: 2014-04-03 21:31:11 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 22 (148 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0025) SingleSource/Regression/C/matrixTranspose: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2080 => 0.2240, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 5.45% (0.4400 => 0.4640, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 4.20% (0.4760 => 0.4960, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.95% (0.3040 => 0.3160, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.82% (0.6280 => 0.6520, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 3.45% (1.1600 => 1.2000, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3840 => 0.3960, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.97% (6.6920 => 6.8240, std.dev.: 0.0426) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0683 => 13.2003, std.dev.: 0.0359) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.67% (0.9601 => 1.0241, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.32% (1.2041 => 1.2561, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7041 => 1.7241, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.39% (17.6723 => 19.6843, std.dev.: 0.0427) MultiSource/Applications/sqlite3/sqlite3: 1420.24% (1.7001 => 25.8456, std.dev.: 0.0358) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.46% (50.1010 => 51.8330, std.dev.: 0.1048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (1.0520 => 1.0880, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (11.3920 => 12.3560, std.dev.: 0.0675) SingleSource/Benchmarks/Misc/oourafft: 174.92% (11.3407 => 31.1779, std.dev.: 0.1199) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0603, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0121) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0141) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0053) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.05% (1.8601 => 2.1401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.80% (1.8921 => 2.1721, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.20% (1.9721 => 2.2521, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.57% (1.9161 => 2.1761, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.30% (1.9241 => 2.1801, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.79% (1.8761 => 2.1161, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.50% (0.4160 => 0.4680, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.79% (2.1041 => 2.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.8441 => 2.0401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/EH/except: 10.34% (0.2320 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.45% (1.9481 => 2.1321, std.dev.: 0.0146) SingleSource/UnitTests/Vector/constpool: 8.96% (10.4007 => 11.3327, std.dev.: 0.1087) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.6960 => 1.8160, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0379) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.9960 => 1.0560, std.dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 6.01% (1.1320 => 1.2000, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.93% (2.9721 => 3.1482, std.dev.: 0.0203) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.84% (0.6160 => 0.6520, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/moments: 5.45% (0.4400 => 0.4640, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0230) MultiSource/Benchmarks/nbench/nbench: 5.42% (1.7721 => 1.8681, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.26% (1.7480 => 1.8400, std.dev.: 0.0245) MultiSource/Applications/Burg/burg: 5.24% (1.5280 => 1.6080, std.dev.: 0.0236) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0090) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (9.6042 => 10.0642, std.dev.: 0.0457) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.47% (6.5320 => 6.8240, std.dev.: 0.0426) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (5.8281 => 6.0441, std.dev.: 0.0351) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.1600 => 2.2360, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (16.3003 => 16.8483, std.dev.: 0.0410) MultiSource/Applications/oggenc/oggenc: 3.35% (7.0524 => 7.2885, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (6.5360 => 6.7440, std.dev.: 0.0483) MultiSource/Applications/JM/lencod/lencod: 2.97% (22.2206 => 22.8808, std.dev.: 0.0640) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 2.78% (2.5880 => 2.6600, std.dev.: 0.0244) MultiSource/Applications/lua/lua: 2.75% (4.7920 => 4.9240, std.dev.: 0.0439) MultiSource/Applications/SPASS/SPASS: 2.74% (18.5284 => 19.0366, std.dev.: 0.0517) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (5.3960 => 5.5400, std.dev.: 0.0539) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (2.1240 => 2.1760, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.5040 => 1.5360, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 2.07% (38.6366 => 39.4366, std.dev.: 0.0805) MultiSource/Applications/d/make_dparser: 2.01% (3.9761 => 4.0561, std.dev.: 0.0266) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (10.2283 => 10.4323, std.dev.: 0.0462) MultiSource/Applications/kimwitu++/kc: 1.78% (19.8291 => 20.1811, std.dev.: 0.0346) MultiSource/Applications/siod/siod: 1.74% (2.7522 => 2.8002, std.dev.: 0.0103) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (13.0363 => 13.2003, std.dev.: 0.0359) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.80% (2.1201 => 2.4762, std.dev.: 0.0349) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.36% (6.5964 => 6.7524, std.dev.: 0.0402) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (4.0003 => 4.0763, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0185) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.86% (2.9562 => 0.6840, std.dev.: 0.0213) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0070) MultiSource/Applications/obsequi/Obsequi: -5.33% (1.8760 => 1.7760, std.dev.: 0.0209) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.93% (94.8339 => 49.3831, std.dev.: 9.4128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.45% (49.9431 => 32.7380, std.dev.: 0.2546) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.54% (25.7136 => 17.0891, std.dev.: 0.1063) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.0967) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.54% (37.0863 => 28.7258, std.dev.: 0.5683) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.61% (2.7482 => 2.4842, std.dev.: 0.0983) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.1563 => 5.0963, std.dev.: 0.0156) MultiSource/Benchmarks/BitBench/five11/five11: -1.02% (2.3521 => 2.3281, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 20:12:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 22:12:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140404031212.2C0552A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24338?compare_to=24328&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24338, Order: 205572, Start Time: 2014-04-03 22:24:02, End Time: 2014-04-04 03:18:12 To: 24328, Order: 205543, Start Time: 2014-04-03 17:26:03, End Time: 2014-04-03 22:19:39 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (150 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-ManyArguments: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C/sumarray: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 19.23% (0.1040 => 0.1240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 16.00% (0.1000 => 0.1160, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.10% (0.6560 => 0.6960, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.78% (1.3521 => 1.3761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.56% (1.5361 => 1.5601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.45% (1.3761 => 1.3961, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.66% (0.9841 => 1.0201, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.78% (4.7203 => 4.8043, std.dev.: 0.0271) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1987.50% (0.0320 => 0.6680, std.dev.: 0.0063) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0085) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 393.69% (0.2520 => 1.2441, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0063) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0070) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0031) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0042) SingleSource/Regression/C/matrixTranspose: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 48.86% (0.7040 => 1.0480, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 29.63% (0.1080 => 0.1400, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.00% (1.2321 => 1.5401, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.13% (1.1761 => 1.4481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: 22.41% (1.3920 => 1.7040, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.80% (1.2321 => 1.4761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 18.42% (8.5802 => 10.1603, std.dev.: 0.0425) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 16.00% (0.1000 => 0.1160, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 15.96% (0.3760 => 0.4360, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 15.48% (19.5406 => 22.5647, std.dev.: 0.0507) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.62% (5.3360 => 6.1161, std.dev.: 0.0377) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0123) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.49% (1.7400 => 1.9400, std.dev.: 0.0283) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 9.56% (11.3843 => 12.4723, std.dev.: 0.0279) MultiSource/Applications/oggenc/oggenc: 9.10% (6.2844 => 6.8564, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.61% (5.6680 => 6.1560, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.52% (5.7280 => 6.2160, std.dev.: 0.0441) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.11% (0.4440 => 0.4800, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (11.4440 => 12.2920, std.dev.: 0.0678) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.41% (0.6480 => 0.6960, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (9.5802 => 10.2442, std.dev.: 0.0467) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0116) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 3.60% (4.7720 => 4.9440, std.dev.: 0.0364) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (6.8280 => 7.0720, std.dev.: 0.0473) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.4520 => 0.4680, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0342) SingleSource/UnitTests/Vector/constpool: 3.30% (11.0207 => 11.3847, std.dev.: 0.1051) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.12% (49.1529 => 50.6889, std.dev.: 0.0692) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (2.0920 => 2.1520, std.dev.: 0.0232) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0128) MultiSource/Applications/ClamAV/clamscan: 2.64% (19.2243 => 19.7324, std.dev.: 0.0527) MultiSource/Applications/hbd/hbd: 2.47% (1.7840 => 1.8280, std.dev.: 0.0157) MultiSource/Applications/sqlite3/sqlite3: 2.42% (24.7575 => 25.3575, std.dev.: 0.0623) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0159) MultiSource/Applications/kimwitu++/kc: 1.52% (19.7491 => 20.0491, std.dev.: 0.0333) MultiSource/Benchmarks/Bullet/bullet: 1.16% (39.0726 => 39.5246, std.dev.: 0.0842) MultiSource/Applications/SPASS/SPASS: 1.02% (18.7966 => 18.9887, std.dev.: 0.0341) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.08% (0.2360 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/llubenchmark/llu: 4.84% (5.1203 => 5.3683, std.dev.: 0.0849) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.86% (3.3122 => 3.4402, std.dev.: 0.0476) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.24% (0.9881 => 1.0201, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.60% (3.2362 => 3.3202, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 2.58% (6.8204 => 6.9964, std.dev.: 0.0356) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.3085 => 7.4725, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -15.73% (7.8605 => 6.6244, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.52% (3.4722 => 3.1762, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.60% (5.2763 => 4.9283, std.dev.: 0.0725) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -1.92% (4.9963 => 4.9003, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.84% (4.1243 => 4.0483, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.0963 => 5.0443, std.dev.: 0.0142) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 12.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 20:33:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 22:33:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140404033323.37FD52A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24339?compare_to=24335&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24339, Order: 205572, Start Time: 2014-04-03 22:52:16, End Time: 2014-04-04 03:39:39 To: 24335, Order: 205565, Start Time: 2014-04-03 21:34:19, End Time: 2014-04-04 02:20:01 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (106 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.7240 => 0.7400, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.05% (1.3641 => 1.3921, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.6361 => 1.6681, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.94% (1.2401 => 1.2641, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.88% (1.2761 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.79% (1.3441 => 1.3681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.55% (1.2921 => 1.3121, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.3000 => 0.3320, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.78% (0.2360 => 0.2520, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0544) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0382) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0182) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (8.1441 => 8.5641, std.dev.: 0.0460) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0234) SingleSource/UnitTests/Vector/constpool: 4.22% (10.8967 => 11.3567, std.dev.: 0.1473) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0213) MultiSource/Applications/spiff/spiff: 4.05% (0.9880 => 1.0280, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0545) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0320) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0402) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0378) MultiSource/Applications/Burg/burg: 2.74% (1.4600 => 1.5000, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0423) MultiSource/Applications/SIBsim4/SIBsim4: 2.21% (1.6321 => 1.6681, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 2.00% (5.7964 => 5.9124, std.dev.: 0.0128) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.00% (48.1088 => 49.0689, std.dev.: 0.0725) MultiSource/Benchmarks/Bullet/bullet: 1.89% (37.0925 => 37.7926, std.dev.: 0.0528) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0156) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0191) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0810, std.dev.: 0.0294) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0471) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0084) MultiSource/Applications/minisat/minisat: 5.23% (6.6564 => 7.0044, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: 3.29% (2.0681 => 2.1361, std.dev.: 0.0155) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0247) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/pi: -50.00% (0.0240 => 0.0120, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 3 21:14:07 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 03 Apr 2014 21:14:07 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140404041411.C711B4F0716E@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/726 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205515 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpt19WF5exe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpt19WF5exe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpbWVXgoexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpbWVXgoexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Thu Apr 3 21:26:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Apr 2014 23:26:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140404042648.60BA92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24340?compare_to=24339&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24340, Order: 205581, Start Time: 2014-04-03 23:47:42, End Time: 2014-04-04 04:33:02 To: 24339, Order: 205572, Start Time: 2014-04-03 22:52:16, End Time: 2014-04-04 03:39:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (108 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/Vector/build2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.76% (0.1640 => 0.1800, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.65% (0.6800 => 0.7320, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.95% (0.6720 => 0.7120, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.69% (1.1080 => 1.1600, std.dev.: 0.0064) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.05% (1.1840 => 1.2320, std.dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 35.00% (0.0800 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.32% (4.6603 => 4.7683, std.dev.: 0.0312) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.57% (1.2161 => 1.3081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0523) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0499) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.3160 => 0.3360, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wc: 6.15% (0.2600 => 0.2760, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.45% (8.1441 => 8.5881, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.39% (1.7080 => 1.8000, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0160) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0324) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0222) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0380) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0441) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0340) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0274) MultiSource/Benchmarks/Bullet/bullet: 2.29% (37.0925 => 37.9405, std.dev.: 0.0563) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7964 => 5.9084, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0062) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.74% (48.1088 => 48.9449, std.dev.: 0.1412) MultiSource/Applications/sqlite3/sqlite3: 1.53% (23.7574 => 24.1215, std.dev.: 0.0599) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0560) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/moments: 17.39% (0.0920 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 5.29% (6.6564 => 7.0084, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 2.83% (2.6882 => 2.7642, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.53% (0.6320 => 0.6480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 22:14:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Apr 2014 00:14:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140404051420.3C0A02A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24341?compare_to=24340&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24341, Order: 205591, Start Time: 2014-04-04 00:34:53, End Time: 2014-04-04 05:20:24 To: 24340, Order: 205581, Start Time: 2014-04-03 23:47:42, End Time: 2014-04-04 04:33:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (100 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0022) SingleSource/UnitTests/2002-10-09-ArrayResolution: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/Vector/sumarray-dbl: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-7: 100.00% (0.0160 => 0.0320, std.dev.: 0.0044) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: 26.67% (0.0600 => 0.0760, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 3.39% (0.7080 => 0.7320, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.84% (1.3041 => 1.3281, std.dev.: 0.0067) MultiSource/Applications/d/make_dparser: 1.05% (3.7960 => 3.8360, std.dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.09% (0.1760 => 0.1920, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bisort/bisort: 2.79% (0.7160 => 0.7360, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/strcat: -37.50% (0.0320 => 0.0200, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0155) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists: 6.85% (0.2920 => 0.3120, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0760) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.45% (1.3641 => 1.4521, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: 4.99% (10.8967 => 11.4407, std.dev.: 0.0902) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.7080 => 1.7920, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0173) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0425) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0488) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0334) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0394) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0318) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0378) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0075) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.89% (48.1088 => 49.0168, std.dev.: 0.0495) MultiSource/Applications/sqlite3/sqlite3: 1.80% (23.7574 => 24.1855, std.dev.: 0.0279) MultiSource/Benchmarks/Bullet/bullet: 1.64% (37.0925 => 37.7006, std.dev.: 0.0816) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0108) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0156) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/mason/mason: -21.05% (0.0760 => 0.0600, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 23:19:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Apr 2014 01:19:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140404061948.A8EBB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24342?compare_to=24341&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24342, Order: 205592, Start Time: 2014-04-04 01:36:22, End Time: 2014-04-04 06:26:03 To: 24341, Order: 205591, Start Time: 2014-04-04 00:34:53, End Time: 2014-04-04 05:20:24 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (104 on baseline) Performance Improvements: 1 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/hash: 33.33% (0.0480 => 0.0640, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/exptree: 18.18% (0.0880 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.29% (0.0840 => 0.0960, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.82% (0.2720 => 0.2960, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.59% (1.3600 => 1.4360, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3040 => 0.3160, std.dev.: 0.0038) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.67% (1.2000 => 1.2320, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.35% (5.4443 => 5.5723, std.dev.: 0.0250) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -30.77% (0.0520 => 0.0360, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0030) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary3: 11.27% (0.2840 => 0.3160, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.50% (1.1761 => 1.2761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0624) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0291) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.38% (1.1921 => 1.2681, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0446) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0222) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0288) SingleSource/UnitTests/Vector/constpool: 4.04% (10.8967 => 11.3367, std.dev.: 0.1195) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0160) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0334) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0361) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0514) MultiSource/Applications/lua/lua: 2.83% (4.5200 => 4.6480, std.dev.: 0.0384) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0332) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0413) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8165, std.dev.: 0.0648) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.84% (48.1088 => 48.9929, std.dev.: 0.1258) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 1.73% (23.7574 => 24.1695, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0338) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0189) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0462) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0453) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.31% (5.5003 => 5.5723, std.dev.: 0.0250) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.68% (7.7485 => 6.6884, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0172) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -4.90% (0.4080 => 0.3880, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 23:50:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Apr 2014 01:50:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140404065003.642A12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24343?compare_to=24333&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24343, Order: 205598, Start Time: 2014-04-04 02:06:38, End Time: 2014-04-04 06:56:15 To: 24333, Order: 205562, Start Time: 2014-04-03 21:10:40, End Time: 2014-04-04 01:59:57 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/ccc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 27.78% (0.0720 => 0.0920, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 26.32% (0.0760 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.45% (0.1760 => 0.2120, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.90% (0.1680 => 0.1880, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.30% (0.3440 => 0.3760, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.36% (0.8480 => 0.8680, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.19% (1.4600 => 1.4920, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.20% (1.9961 => 2.0201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.13% (1.7641 => 1.7841, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 1.36% (2.3521 => 2.3841, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.52% (1.8361 => 1.8081, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.20% (2.3241 => 2.2961, std.dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0177) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 3 23:56:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Apr 2014 01:56:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140404065628.9314A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24344?compare_to=24334&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24344, Order: 205598, Start Time: 2014-04-04 02:12:54, End Time: 2014-04-04 07:02:48 To: 24334, Order: 205563, Start Time: 2014-04-03 21:16:09, End Time: 2014-04-04 02:06:20 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 19 (139 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/15-trie/trie: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.25% (0.3200 => 0.3560, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.82% (0.3520 => 0.3760, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.69% (0.2560 => 0.2680, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 3.06% (1.1760 => 1.2120, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.15% (1.7401 => 1.7601, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.47% (1.2961 => 1.3281, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.90% (0.8441 => 0.8601, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.19% (2.0161 => 1.9921, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.52% (11.3687 => 31.2099, std.dev.: 0.1093) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0104) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0076) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0044) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0640 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 22.73% (0.1760 => 0.2160, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0159) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 11.54% (0.2080 => 0.2320, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.83% (1.4241 => 1.5641, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.44% (1.4401 => 1.5761, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.89% (1.1160 => 1.2040, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.7361 => 1.8681, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (1.1640 => 1.2520, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 7.45% (1.1280 => 1.2120, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0140) SingleSource/UnitTests/Vector/constpool: 6.78% (10.6247 => 11.3447, std.dev.: 0.1189) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.4680 => 6.8760, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.15% (11.6440 => 12.3600, std.dev.: 0.0472) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.64% (1.5600 => 1.6480, std.dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0189) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (9.4842 => 10.0082, std.dev.: 0.0468) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (5.8121 => 6.1321, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.45% (1.4681 => 1.5481, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.35% (1.4201 => 1.4961, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 5.10% (10.0443 => 10.5563, std.dev.: 0.0409) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0198) SingleSource/Benchmarks/McGill/chomp: 5.00% (0.2400 => 0.2520, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0071) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.58% (6.5440 => 6.8440, std.dev.: 0.0374) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.4640 => 1.5280, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (2.0440 => 2.1320, std.dev.: 0.0287) MultiSource/Applications/JM/lencod/lencod: 4.15% (21.9606 => 22.8728, std.dev.: 0.0575) MultiSource/Applications/hbd/hbd: 4.15% (1.7360 => 1.8080, std.dev.: 0.0206) MultiSource/Applications/oggenc/oggenc: 3.90% (6.9844 => 7.2565, std.dev.: 0.0137) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0102) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.68% (50.0290 => 51.8690, std.dev.: 0.0577) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 3.51% (4.7880 => 4.9560, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (6.5080 => 6.7360, std.dev.: 0.0356) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (5.3600 => 5.5440, std.dev.: 0.0528) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (4.1843 => 4.3163, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 3.07% (38.4046 => 39.5846, std.dev.: 0.0485) MultiSource/Applications/SPASS/SPASS: 3.04% (18.4404 => 19.0005, std.dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0135) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0185) MultiSource/Applications/siod/siod: 2.36% (2.7162 => 2.7802, std.dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: 2.31% (19.0444 => 19.4843, std.dev.: 0.0605) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (16.3483 => 16.7163, std.dev.: 0.0448) MultiSource/Applications/kimwitu++/kc: 2.07% (19.6891 => 20.0971, std.dev.: 0.0540) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (13.0563 => 13.2243, std.dev.: 0.0177) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0240) SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.65% (2.1401 => 2.4322, std.dev.: 0.0456) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 5.59% (2.8602 => 3.0202, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0262) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.11% (3.9842 => 4.0283, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: -5.14% (1.8680 => 1.7720, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.07% (91.8497 => 49.5351, std.dev.: 9.5362) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.39% (50.3031 => 33.0061, std.dev.: 0.2140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.37% (26.0616 => 17.1051, std.dev.: 0.1222) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.64% (42.1466 => 28.8098, std.dev.: 0.4064) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1003) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/five11/five11: -1.02% (2.3561 => 2.3321, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 4 00:05:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Apr 2014 02:05:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140404070559.B78B82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24345?compare_to=24342&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24345, Order: 205601, Start Time: 2014-04-04 02:26:40, End Time: 2014-04-04 07:12:14 To: 24342, Order: 205592, Start Time: 2014-04-04 01:36:22, End Time: 2014-04-04 06:26:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (99 on baseline) Performance Improvements: 1 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-04-22-Switch: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.26% (0.3040 => 0.3200, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.47% (1.3561 => 1.3761, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1520 => 1.1680, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.46% (0.2960 => 0.3240, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.74% (1.3801 => 1.4041, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -7.59% (0.3160 => 0.2920, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0062) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/2003-04-22-Switch: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.98% (0.3280 => 0.3640, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.16% (0.3920 => 0.4240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.36% (0.6520 => 0.7000, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0714) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 6.73% (1.1881 => 1.2681, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9200 => 0.9720, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (8.1441 => 8.5921, std.dev.: 0.0364) SingleSource/UnitTests/Vector/constpool: 5.40% (10.8967 => 11.4847, std.dev.: 0.1083) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.15% (1.7080 => 1.7960, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0325) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0332) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0406) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (5.8400 => 6.0400, std.dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0332) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0333) MultiSource/Benchmarks/Bullet/bullet: 2.34% (37.0925 => 37.9606, std.dev.: 0.1001) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.32% (48.1088 => 49.2249, std.dev.: 0.0676) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.95% (23.7574 => 24.2215, std.dev.: 0.0563) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1290, std.dev.: 0.0502) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 1.37% (17.5484 => 17.7884, std.dev.: 0.0542) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0198) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 4.63% (6.6564 => 6.9644, std.dev.: 0.0295) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 4 00:30:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Apr 2014 02:30:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140404073022.490B62A6C044@llvm.org> http://llvm.org/perf/db_default/v4/nts/24346?compare_to=24336&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24346, Order: 205605, Start Time: 2014-04-04 02:44:54, End Time: 2014-04-04 07:36:31 To: 24336, Order: 205565, Start Time: 2014-04-03 21:44:32, End Time: 2014-04-04 02:35:52 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (140 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.14% (0.2240 => 0.2400, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.35% (0.2520 => 0.2680, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 5.88% (0.2040 => 0.2160, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.4680 => 0.4840, std.dev.: 0.0061) MultiSource/Applications/hbd/hbd: 3.13% (1.7880 => 1.8440, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (1.0320 => 1.0640, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.68% (1.7880 => 1.8360, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.93% (2.2801 => 2.3241, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.89% (1.0601 => 1.0801, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 1.37% (4.0961 => 4.1521, std.dev.: 0.0123) MultiSource/Applications/obsequi/Obsequi: 1.35% (1.7840 => 1.8080, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 28.57% (0.0560 => 0.0720, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/test_indvars: -14.81% (0.1080 => 0.0920, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 400.00% (0.0040 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0069) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 36.17% (0.1880 => 0.2560, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/heapsort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.42% (1.7241 => 2.0761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.07% (1.8881 => 2.2481, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0114) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0116) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.38% (0.2080 => 0.2400, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0066) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0050) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.16% (0.7840 => 0.8480, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 8.00% (0.3000 => 0.3240, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.69% (0.7800 => 0.8400, std.dev.: 0.0193) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.26% (0.9920 => 1.0640, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.02% (11.7880 => 12.6160, std.dev.: 0.0514) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (6.7200 => 7.1560, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.00% (1.7320 => 1.8360, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.5000 => 0.5280, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3600 => 0.3800, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0211) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (9.9842 => 10.4762, std.dev.: 0.0482) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.1440 => 1.2000, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0230) SingleSource/UnitTests/Vector/constpool: 4.80% (10.9087 => 11.4327, std.dev.: 0.0833) MultiSource/Applications/d/make_dparser: 4.74% (3.9641 => 4.1521, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.5240 => 1.5960, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 4.51% (4.7920 => 5.0080, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.25% (1.0361 => 1.0801, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 3.99% (6.9124 => 7.1884, std.dev.: 0.0122) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.86% (1.3480 => 1.4000, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (6.8321 => 7.0881, std.dev.: 0.0323) MultiSource/Applications/SPASS/SPASS: 3.61% (18.4924 => 19.1605, std.dev.: 0.0433) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0100) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.50% (1.3720 => 1.4200, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.4680 => 0.4840, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 3.36% (2.6200 => 2.7080, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0069) MultiSource/Applications/hbd/hbd: 3.13% (1.7880 => 1.8440, std.dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 3.11% (22.6287 => 23.3327, std.dev.: 0.0571) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (10.3203 => 10.6323, std.dev.: 0.0387) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0104) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (51.1089 => 52.3729, std.dev.: 0.1852) MultiSource/Applications/siod/siod: 2.47% (2.7562 => 2.8242, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 2.46% (38.9366 => 39.8926, std.dev.: 0.0949) MultiSource/Applications/ClamAV/clamscan: 2.39% (20.2445 => 20.7285, std.dev.: 0.0426) MultiSource/Applications/kimwitu++/kc: 2.31% (19.7371 => 20.1931, std.dev.: 0.0371) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (16.5963 => 16.9603, std.dev.: 0.0489) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (5.5480 => 5.6680, std.dev.: 0.0382) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 1.48% (25.1895 => 25.5616, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (3.0122 => 3.0562, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0244 => 6.1044, std.dev.: 0.0209) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.67% (3.4842 => 3.6122, std.dev.: 0.0393) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.86% (1.2921 => 1.3161, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.68% (4.7563 => 4.8363, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 1.57% (21.6534 => 21.9934, std.dev.: 0.0879) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.47% (1.0881 => 1.1041, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.50% (6.2884 => 1.3521, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0070) MultiSource/Applications/obsequi/Obsequi: -31.72% (2.6481 => 1.8080, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.36% (7.4801 => 6.2560, std.dev.: 0.0518) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.57% (7.5041 => 6.3360, std.dev.: 0.0249) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: -2.78% (13.5243 => 13.1483, std.dev.: 0.0489) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: -4.85% (2.5562 => 2.4322, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0309) MultiSource/Applications/JM/lencod/lencod: -1.88% (8.3085 => 8.1525, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -1.03% (11.6527 => 11.5327, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: -1.01% (25.7976 => 25.5376, std.dev.: 0.0274) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 6.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 4 00:42:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Apr 2014 02:42:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140404074209.6993A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24347?compare_to=24337&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24347, Order: 205605, Start Time: 2014-04-04 02:54:59, End Time: 2014-04-04 07:48:20 To: 24337, Order: 205571, Start Time: 2014-04-03 21:52:50, End Time: 2014-04-04 02:45:55 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 12 (139 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0760 => 0.0960, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/em3d/em3d: 22.22% (0.1800 => 0.2200, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 18.18% (0.0880 => 0.1040, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Oscar: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.14% (0.1680 => 0.1800, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.68% (0.6840 => 0.7160, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.86% (0.4200 => 0.4320, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (2.1761 => 2.2041, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 17.74% (0.2480 => 0.2920, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 2.87% (0.9761 => 1.0041, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.16% (17.6723 => 19.6444, std.dev.: 0.0682) MultiSource/Applications/sqlite3/sqlite3: 1418.12% (1.7001 => 25.8096, std.dev.: 0.0437) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.98% (50.1010 => 52.0930, std.dev.: 0.0785) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (1.0520 => 1.0840, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.06% (11.3920 => 12.4240, std.dev.: 0.0565) SingleSource/Benchmarks/Misc/oourafft: 175.38% (11.3407 => 31.2300, std.dev.: 0.0964) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0603, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0102) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 315.76% (0.4320 => 1.7961, std.dev.: 0.0107) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.86% (2.1361 => 2.4322, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.53% (1.8921 => 2.1481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0127) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.64% (2.0681 => 2.2881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/objinst: 10.17% (0.2360 => 0.2600, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0159) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: 9.73% (10.4007 => 11.4127, std.dev.: 0.1172) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0043) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.14% (0.7280 => 0.7800, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 6.90% (0.4640 => 0.4960, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.27% (1.2120 => 1.2880, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.21% (0.7080 => 0.7520, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (6.4800 => 6.8800, std.dev.: 0.0491) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 5.91% (1.0160 => 1.0760, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.58% (0.7880 => 0.8320, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3600 => 0.3800, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.33% (9.6042 => 10.1162, std.dev.: 0.0303) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.90% (0.9801 => 1.0281, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 4.71% (1.5280 => 1.6000, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (5.8281 => 6.0761, std.dev.: 0.0447) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (6.5320 => 6.7920, std.dev.: 0.0737) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.7480 => 1.8160, std.dev.: 0.0235) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (5.3960 => 5.6000, std.dev.: 0.0239) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.1600 => 2.2360, std.dev.: 0.0143) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0221) MultiSource/Applications/lua/lua: 3.26% (4.7920 => 4.9480, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (16.3003 => 16.7803, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0626) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 2.89% (7.0524 => 7.2565, std.dev.: 0.0243) MultiSource/Benchmarks/Bullet/bullet: 2.88% (38.6366 => 39.7486, std.dev.: 0.0740) MultiSource/Applications/JM/lencod/lencod: 2.86% (22.2206 => 22.8567, std.dev.: 0.0413) MultiSource/Applications/treecc/treecc: 2.78% (2.5880 => 2.6600, std.dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0092) MultiSource/Applications/d/make_dparser: 2.72% (3.9761 => 4.0841, std.dev.: 0.0163) MultiSource/Applications/SPASS/SPASS: 2.59% (18.5284 => 19.0086, std.dev.: 0.0603) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (10.2283 => 10.4483, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 1.71% (19.8291 => 20.1691, std.dev.: 0.0442) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0158) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (13.0363 => 13.2003, std.dev.: 0.0430) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0598) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 2.49% (6.5964 => 6.7604, std.dev.: 0.0365) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (3.9442 => 3.9962, std.dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -75.78% (2.9562 => 0.7160, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0045) SingleSource/UnitTests/printargs: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -5.33% (1.8760 => 1.7760, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.06% (94.8339 => 49.2551, std.dev.: 9.7063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.99% (25.7136 => 16.9731, std.dev.: 0.1909) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.82% (49.9431 => 33.0541, std.dev.: 0.1670) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.02% (37.0863 => 28.5498, std.dev.: 0.5428) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.64% (5.6124 => 5.5203, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0171) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 7.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 4 01:15:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Apr 2014 03:15:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140404081523.CEDC12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24348?compare_to=24338&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24348, Order: 205606, Start Time: 2014-04-04 03:27:37, End Time: 2014-04-04 08:21:20 To: 24338, Order: 205572, Start Time: 2014-04-03 22:24:02, End Time: 2014-04-04 03:18:12 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (151 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Queens: 71.43% (0.0280 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Regression/C/test_indvars: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/almabench: 20.00% (0.0800 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 11.36% (0.1760 => 0.1960, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2200 => 0.2360, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.10% (0.7320 => 0.7840, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.25% (0.2560 => 0.2720, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 4.59% (0.4360 => 0.4560, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.80% (0.7360 => 0.7640, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.05% (1.0480 => 1.0800, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.13% (7.0720 => 7.1520, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.53% (0.3040 => 0.3360, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.15% (1.7321 => 1.7121, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1987.50% (0.0320 => 0.6680, std.dev.: 0.0080) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0066) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 395.28% (0.2520 => 1.2481, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0050) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 88.46% (0.1040 => 0.1960, std.dev.: 0.0117) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0072) MultiSource/Applications/obsequi/Obsequi: 24.71% (1.3920 => 1.7360, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.67% (1.2321 => 1.5361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.75% (1.2481 => 1.5321, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 19.81% (1.2921 => 1.5481, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.45% (1.1721 => 1.4001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: 18.88% (8.5802 => 10.2003, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 16.07% (0.4480 => 0.5200, std.dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: 15.68% (19.5406 => 22.6047, std.dev.: 0.0446) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 14.79% (1.3521 => 1.5521, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.62% (5.3360 => 6.1161, std.dev.: 0.0260) SingleSource/Benchmarks/CoyoteBench/almabench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.56% (1.7400 => 1.9760, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.6800 => 0.7640, std.dev.: 0.0096) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 9.42% (11.3843 => 12.4563, std.dev.: 0.0342) MultiSource/Applications/oggenc/oggenc: 8.91% (6.2844 => 6.8444, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.75% (5.6680 => 6.1640, std.dev.: 0.0270) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.66% (5.7280 => 6.2240, std.dev.: 0.0351) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.11% (0.4440 => 0.4800, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.2520 => 0.2720, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.93% (11.4440 => 12.3520, std.dev.: 0.0632) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.35% (9.5802 => 10.2842, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (1.4760 => 1.5600, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0044) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.44% (1.3240 => 1.3960, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.36% (0.2240 => 0.2360, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0191) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.75% (6.8280 => 7.1520, std.dev.: 0.0218) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0324) MultiSource/Applications/spiff/spiff: 4.20% (1.0480 => 1.0920, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.08% (0.9800 => 1.0200, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0462) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.29% (49.1529 => 50.7689, std.dev.: 0.0732) MultiSource/Applications/ClamAV/clamscan: 3.08% (19.2243 => 19.8164, std.dev.: 0.0549) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.41% (24.7575 => 25.3535, std.dev.: 0.0399) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.90% (1.0521 => 1.0721, std.dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: 1.84% (19.7491 => 20.1131, std.dev.: 0.0331) MultiSource/Benchmarks/PAQ8p/paq8p: 1.76% (2.7282 => 2.7762, std.dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: 1.66% (39.0726 => 39.7206, std.dev.: 0.0792) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.48% (1.2401 => 1.4321, std.dev.: 0.0170) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.64% (0.9881 => 1.0241, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0075) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.84% (3.2362 => 3.3282, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0278) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.26% (3.4802 => 3.5242, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0855) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.33% (0.6000 => 0.5800, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.0963 => 5.0403, std.dev.: 0.0205) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (2.3401 => 2.3161, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 17.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 4 07:56:41 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 04 Apr 2014 07:56:41 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140404145645.635954F0C7D7@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/727 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205557 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpZHolz1exe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpZHolz1exe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpuzsgWaexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpuzsgWaexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvmlab-buildmaster at lab.llvm.org Fri Apr 4 21:21:03 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 04 Apr 2014 21:21:03 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140405042107.D96524F13729@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/728 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205613 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpSx5Wewexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpSx5Wewexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpwN22LBexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpwN22LBexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvmlab-buildmaster at lab.llvm.org Sat Apr 5 09:21:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 05 Apr 2014 09:21:52 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140405162157.4247A4F189D6@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/729 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205636 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpeKykuRexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpeKykuRexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpOP0Fuoexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpOP0Fuoexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvmlab-buildmaster at lab.llvm.org Sat Apr 5 11:36:43 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 05 Apr 2014 11:36:43 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140405183643.DE8D14F19967@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/730 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205653 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp4nsGyvexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp4nsGyvexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpowq4S5exe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpowq4S5exe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvmlab-buildmaster at lab.llvm.org Sun Apr 6 02:59:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 06 Apr 2014 02:59:52 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase3 - tree health Message-ID: <20140406100027.9D5D74F20313@lab.llvm.org> The Buildbot has detected a build exception on builder phase3 - tree health while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase3%20-%20tree%20health/builds/2330 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205669 Blamelist: atrick,dblaikie,fjahanian,hfinkel,jrose,rtrieu BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 6 02:59:59 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 06 Apr 2014 02:59:59 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase2 - living Message-ID: <20140406100027.957344F20312@lab.llvm.org> The Buildbot has detected a build exception on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7497 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205677 Blamelist: compnerd,dblaikie BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sun Apr 6 04:33:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 06:33:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140406113350.3CCB82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24348?compare_to=24345&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24348, Order: 205686, Start Time: 2014-04-06 06:54:04, End Time: 2014-04-06 11:39:47 To: 24345, Order: 205601, Start Time: 2014-04-04 02:26:40, End Time: 2014-04-04 07:12:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (102 on baseline) Performance Improvements: 3 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/ackermann: 200.00% (0.0080 => 0.0240, std.dev.: 0.0050) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/treeadd/treeadd: 40.00% (0.0400 => 0.0560, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.2280 => 1.2640, std.dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 1.97% (1.6281 => 1.6601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.27% (1.2561 => 1.2721, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/reversefile: -8.49% (0.4240 => 0.3880, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.68% (1.7960 => 1.7120, std.dev.: 0.0289) SingleSource/Benchmarks/Shootout-C++/moments: -4.42% (0.4520 => 0.4320, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0053) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0111) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0475) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0370) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: 4.41% (10.8967 => 11.3767, std.dev.: 0.1198) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0142) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0477) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0236) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0495) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0352) MultiSource/Applications/sqlite3/sqlite3: 2.46% (23.7574 => 24.3415, std.dev.: 0.0432) MultiSource/Benchmarks/Bullet/bullet: 2.34% (37.0925 => 37.9606, std.dev.: 0.0563) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.21% (0.5440 => 0.5560, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (4.9000 => 4.9920, std.dev.: 0.0286) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0067) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.73% (48.1088 => 48.9409, std.dev.: 0.1152) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0130) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: 1.28% (18.8170 => 19.0570, std.dev.: 0.0449) MultiSource/Applications/ClamAV/clamscan: 1.10% (17.4082 => 17.6002, std.dev.: 0.0487) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0396) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 1.17% (21.1533 => 21.4013, std.dev.: 0.0599) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 07:00:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 09:00:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140406140032.EC6712A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24349?compare_to=24348&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24349, Order: 205687, Start Time: 2014-04-06 09:23:59, End Time: 2014-04-06 14:06:53 To: 24348, Order: 205686, Start Time: 2014-04-06 06:54:04, End Time: 2014-04-06 11:39:47 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 5 (101 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.05% (0.1680 => 0.2000, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.4400 => 1.4680, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/inlined_cleanup: -37.50% (0.0320 => 0.0200, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0057) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0564) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: 5.91% (10.8967 => 11.5407, std.dev.: 0.1125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0207) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0414) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0521) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0184) MultiSource/Applications/JM/lencod/lencod: 3.36% (17.6165 => 18.2085, std.dev.: 0.0499) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0504) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0339) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0512) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0453) MultiSource/Benchmarks/Bullet/bullet: 2.28% (37.0925 => 37.9366, std.dev.: 0.0548) MultiSource/Applications/sqlite3/sqlite3: 2.26% (23.7574 => 24.2935, std.dev.: 0.0719) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.4400 => 1.4680, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.93% (48.1088 => 49.0370, std.dev.: 0.0667) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0090) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0370) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0207) MultiSource/Applications/SPASS/SPASS: 1.03% (17.5484 => 17.7284, std.dev.: 0.0561) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 4.57% (6.6564 => 6.9604, std.dev.: 0.0281) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0120) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0152) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0283) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: -9.09% (0.2200 => 0.2000, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/d/make_dparser: -42.86% (0.0280 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2403 => 4.1963, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 08:11:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 10:11:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140406151146.2ABAE2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24350?compare_to=24349&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24350, Order: 205688, Start Time: 2014-04-06 10:33:36, End Time: 2014-04-06 15:18:06 To: 24349, Order: 205687, Start Time: 2014-04-06 09:23:59, End Time: 2014-04-06 14:06:53 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (100 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1560 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.00% (0.1000 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.05% (1.3840 => 1.4400, std.dev.: 0.0166) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.86% (0.9880 => 1.0360, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0115) SingleSource/UnitTests/Vector/constpool: 4.70% (10.8967 => 11.4087, std.dev.: 0.0677) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0251) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0553) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3800 => 1.4400, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0402) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0146) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0561) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0506) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.4400 => 1.4680, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 1.79% (37.0925 => 37.7566, std.dev.: 0.0681) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.75% (48.1088 => 48.9530, std.dev.: 0.0668) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0523) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 1.17% (18.8170 => 19.0370, std.dev.: 0.0322) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 27.89% (0.9321 => 1.1921, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 5.41% (6.6564 => 7.0164, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.20% (1.0921 => 1.1161, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0315) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0214) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 09:19:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 11:19:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140406161951.79C502A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24351?compare_to=24343&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24351, Order: 205688, Start Time: 2014-04-06 11:37:29, End Time: 2014-04-06 16:26:11 To: 24343, Order: 205598, Start Time: 2014-04-04 02:06:38, End Time: 2014-04-04 06:56:15 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 4 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 21.43% (0.1120 => 0.1360, std.dev.: 0.0055) MultiSource/Applications/aha/aha: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 13.33% (0.1200 => 0.1360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 9.68% (0.1240 => 0.1360, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 8.51% (0.1880 => 0.2040, std.dev.: 0.0033) SingleSource/Regression/C/bigstack: 7.14% (0.1680 => 0.1800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.31% (1.8361 => 1.8601, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.30% (0.9241 => 0.9361, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.16% (1.7281 => 1.7481, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.15% (6.2880 => 6.3600, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.15% (0.6600 => 0.7600, std.dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/office/office: -7.69% (0.2600 => 0.2400, std.dev.: 0.0075) SingleSource/Regression/C++/ofstream_ctor: -6.25% (0.2560 => 0.2400, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: -3.63% (1.2120 => 1.1680, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.84% (1.8320 => 1.7800, std.dev.: 0.0169) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0133) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 09:21:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 11:21:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140406162101.C3ECF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24352?compare_to=24344&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24352, Order: 205688, Start Time: 2014-04-06 11:37:54, End Time: 2014-04-06 16:27:23 To: 24344, Order: 205598, Start Time: 2014-04-04 02:12:54, End Time: 2014-04-04 07:02:48 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 12 (132 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (957 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/badidx: 300.00% (0.0080 => 0.0320, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.33% (0.1440 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.4440 => 0.4640, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 3.33% (0.4800 => 0.4960, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.81% (1.5481 => 1.5761, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.20% (1.6681 => 1.6881, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 1.01% (2.7802 => 2.8082, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -8.47% (0.2360 => 0.2160, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.10% (11.3687 => 31.1619, std.dev.: 0.0796) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 293.93% (0.4600 => 1.8121, std.dev.: 0.0121) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/FloatPrecision: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0060) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.87% (0.1840 => 0.2040, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.57% (1.8161 => 2.0081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.77% (0.4560 => 0.4960, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (1.0240 => 1.1120, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.44% (1.6121 => 1.7481, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8881 => 0.9601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.97% (1.4561 => 1.5721, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.74% (0.6200 => 0.6680, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.71% (1.6081 => 1.7321, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (1.1640 => 1.2520, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: 7.53% (10.6247 => 11.4247, std.dev.: 0.0938) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (6.4680 => 6.9080, std.dev.: 0.0285) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.73% (1.7841 => 1.9041, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.85% (1.4361 => 1.5201, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (1.5480 => 1.6360, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (5.8121 => 6.1241, std.dev.: 0.0300) MultiSource/Applications/SIBsim4/SIBsim4: 5.36% (1.7921 => 1.8881, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.19% (9.4842 => 9.9762, std.dev.: 0.0560) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.15% (11.6440 => 12.2440, std.dev.: 0.0814) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.7000 => 0.7360, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.7400 => 1.8280, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.00% (1.5201 => 1.5961, std.dev.: 0.0192) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.82% (1.6601 => 1.7401, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.55% (6.5080 => 6.8040, std.dev.: 0.0377) MultiSource/Applications/JM/ldecod/ldecod: 4.54% (10.0443 => 10.5003, std.dev.: 0.0427) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.52% (0.7960 => 0.8320, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 4.48% (21.9606 => 22.9448, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (1.8440 => 1.9200, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (6.5440 => 6.8040, std.dev.: 0.0544) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (5.3600 => 5.5640, std.dev.: 0.0433) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0148) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.65% (50.0290 => 51.8530, std.dev.: 0.0924) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 3.39% (2.7162 => 2.8082, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.9681 => 1.0001, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0182) MultiSource/Applications/SPASS/SPASS: 3.17% (18.4404 => 19.0244, std.dev.: 0.0378) MultiSource/Benchmarks/Bullet/bullet: 3.07% (38.4046 => 39.5846, std.dev.: 0.0694) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (16.3483 => 16.8043, std.dev.: 0.0361) MultiSource/Applications/ClamAV/clamscan: 2.56% (19.0444 => 19.5324, std.dev.: 0.0691) MultiSource/Applications/kimwitu++/kc: 2.42% (19.6891 => 20.1651, std.dev.: 0.0268) MultiSource/Applications/d/make_dparser: 2.02% (3.9681 => 4.0481, std.dev.: 0.0297) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0563 => 13.1883, std.dev.: 0.0295) MultiSource/Benchmarks/PAQ8p/paq8p: 1.00% (2.7922 => 2.8202, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.65% (2.1401 => 2.4322, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.25% (0.1920 => 0.2040, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0333) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.31% (3.9842 => 4.0363, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.77% (2.9442 => 0.6840, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0065) MultiSource/Applications/obsequi/Obsequi: -6.00% (1.8680 => 1.7560, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.15% (91.8497 => 49.4591, std.dev.: 10.2168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.54% (50.3031 => 32.9261, std.dev.: 0.1844) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.97% (26.0616 => 17.2091, std.dev.: 0.0903) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.55% (42.1466 => 28.4298, std.dev.: 0.5552) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1097) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0207) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 09:23:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 11:23:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140406162316.A7D8F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24353?compare_to=24350&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24353, Order: 205689, Start Time: 2014-04-06 11:41:08, End Time: 2014-04-06 16:29:36 To: 24350, Order: 205688, Start Time: 2014-04-06 10:33:36, End Time: 2014-04-06 15:18:06 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (97 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-26-Shorts: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 27.78% (0.0720 => 0.0920, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 22.73% (0.0880 => 0.1080, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 16.67% (0.0960 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 5.71% (0.2800 => 0.2960, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.09% (1.3680 => 1.4240, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.94% (0.5080 => 0.5280, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 2.57% (4.9800 => 5.1080, std.dev.: 0.0270) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 20.75% (0.2120 => 0.2560, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 19.67% (0.2440 => 0.2920, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: 16.00% (0.1000 => 0.1160, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.46% (1.3401 => 1.4401, std.dev.: 0.0284) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0621) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0509) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0148) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0260) SingleSource/UnitTests/Vector/constpool: 4.18% (10.8967 => 11.3527, std.dev.: 0.1448) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0270) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0507) MultiSource/Applications/JM/lencod/lencod: 3.09% (17.6165 => 18.1605, std.dev.: 0.0353) MultiSource/Benchmarks/mafft/pairlocalalign: 2.57% (10.4082 => 10.6762, std.dev.: 0.0626) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0418) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (5.8400 => 5.9640, std.dev.: 0.0444) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8486, std.dev.: 0.0672) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0082) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.69% (48.1088 => 48.9209, std.dev.: 0.0877) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 1.02% (18.8170 => 19.0090, std.dev.: 0.0593) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/moments: 26.09% (0.0920 => 0.1160, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.88% (1.3601 => 1.4401, std.dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0155) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0235) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 09:29:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 11:29:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140406162940.CFA352A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24354?compare_to=24346&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24354, Order: 205689, Start Time: 2014-04-06 11:44:34, End Time: 2014-04-06 16:36:03 To: 24346, Order: 205605, Start Time: 2014-04-04 02:44:54, End Time: 2014-04-04 07:36:31 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (123 on baseline) Performance Improvements: 3 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (959 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Treesort: 55.56% (0.0360 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.45% (0.2200 => 0.2320, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 4.44% (0.3600 => 0.3760, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.34% (2.0961 => 2.1241, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -4.77% (1.8440 => 1.7560, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.22% (1.0801 => 1.0561, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.71% (12.6160 => 12.4000, std.dev.: 0.0716) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 130.36% (0.2240 => 0.5160, std.dev.: 0.0047) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 301.78% (0.4560 => 1.8321, std.dev.: 0.0066) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0065) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0058) SingleSource/Benchmarks/Stanford/Treesort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.96% (1.6761 => 2.0441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.79% (1.7441 => 2.1241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.67% (1.6801 => 2.0441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.51% (1.6921 => 2.0561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.48% (1.7321 => 2.1041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.46% (1.6961 => 2.0601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.28% (1.6921 => 2.0521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.89% (1.8001 => 2.1761, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.76% (1.7921 => 2.1641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.62% (1.8041 => 2.1761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.59% (1.7481 => 2.1081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.40% (1.8041 => 2.1721, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.22% (1.8201 => 2.1881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.13% (1.8281 => 2.1961, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.04% (1.8361 => 2.2041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.18% (1.9801 => 2.3401, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.51% (3.5002 => 3.7282, std.dev.: 0.0289) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0255) MultiSource/Benchmarks/McCat/18-imp/imp: 6.14% (0.4560 => 0.4840, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: 5.66% (0.2120 => 0.2240, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9920 => 1.0480, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0210) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.19% (11.7880 => 12.4000, std.dev.: 0.0716) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (9.9842 => 10.4402, std.dev.: 0.0482) MultiSource/Applications/d/make_dparser: 4.54% (3.9641 => 4.1441, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.27% (0.4680 => 0.4880, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: 4.22% (10.9087 => 11.3687, std.dev.: 0.1227) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0232) MultiSource/Applications/lua/lua: 4.01% (4.7920 => 4.9840, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (1.6481 => 1.7121, std.dev.: 0.0121) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.86% (1.3480 => 1.4000, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 3.36% (6.9124 => 7.1444, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (6.8321 => 7.0561, std.dev.: 0.0277) MultiSource/Applications/SPASS/SPASS: 3.18% (18.4924 => 19.0806, std.dev.: 0.0388) MultiSource/Applications/JM/lencod/lencod: 2.92% (22.6287 => 23.2887, std.dev.: 0.0405) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (10.3203 => 10.6123, std.dev.: 0.0473) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 2.60% (2.6200 => 2.6880, std.dev.: 0.0216) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.18% (51.1089 => 52.2249, std.dev.: 0.0621) MultiSource/Applications/ClamAV/clamscan: 2.17% (20.2445 => 20.6845, std.dev.: 0.0556) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (3.0122 => 3.0762, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 2.06% (38.9366 => 39.7406, std.dev.: 0.1337) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (16.5963 => 16.9123, std.dev.: 0.0467) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 1.84% (19.7371 => 20.1011, std.dev.: 0.0449) MultiSource/Applications/sqlite3/sqlite3: 1.65% (25.1895 => 25.6056, std.dev.: 0.0408) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0244 => 6.1124, std.dev.: 0.0214) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (2.2721 => 2.3001, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 25.86% (0.9281 => 1.1681, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.13% (1.0921 => 1.1481, std.dev.: 0.0151) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0473) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.01% (0.9961 => 1.0161, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.7563 => 4.8203, std.dev.: 0.0131) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0168) SingleSource/UnitTests/2003-08-11-VaListArg: -30.00% (0.0400 => 0.0280, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.36% (7.4801 => 6.2560, std.dev.: 0.0369) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.10% (7.5041 => 6.2960, std.dev.: 0.0518) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -3.22% (13.5243 => 13.0883, std.dev.: 0.0447) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -2.71% (5.1603 => 5.0203, std.dev.: 0.0266) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 09:33:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 11:33:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140406163334.D38AC2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24355?compare_to=24347&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24355, Order: 205689, Start Time: 2014-04-06 11:47:34, End Time: 2014-04-06 16:39:57 To: 24347, Order: 205605, Start Time: 2014-04-04 02:54:59, End Time: 2014-04-04 07:48:20 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 16 (120 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (960 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 38.46% (0.0520 => 0.0720, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 2.44% (0.4920 => 0.5040, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.36% (1.0161 => 1.0401, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 1.81% (1.1080 => 1.1280, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.56% (2.0561 => 2.0881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.32% (2.1281 => 2.1561, std.dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 1.31% (1.8321 => 1.8561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.21% (1.9761 => 2.0001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.14% (2.1081 => 2.1321, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -7.35% (0.2720 => 0.2520, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3640 => 0.3440, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.91% (17.6723 => 19.6004, std.dev.: 0.0530) MultiSource/Applications/sqlite3/sqlite3: 1418.83% (1.7001 => 25.8216, std.dev.: 0.0379) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.21% (50.1010 => 51.7090, std.dev.: 0.1086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (11.3920 => 12.2360, std.dev.: 0.0830) SingleSource/Benchmarks/Misc/oourafft: 175.49% (11.3407 => 31.2420, std.dev.: 0.1236) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0483, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0111) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0091) SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0160 => 0.0320, std.dev.: 0.0060) SingleSource/Regression/C/sumarray2d: 100.00% (0.0200 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0043) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.41% (1.8281 => 2.1281, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.31% (1.9601 => 2.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 15.18% (1.9241 => 2.2161, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.62% (1.8601 => 2.1321, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.02% (1.9121 => 2.1801, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.45% (2.1121 => 2.3961, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.06% (2.1441 => 2.4242, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.55% (1.9761 => 2.2241, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.53% (1.8201 => 2.0481, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.29% (1.9201 => 2.1561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 12.26% (1.8601 => 2.0881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.21% (1.9001 => 2.1321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.19% (1.7721 => 1.9881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.13% (1.8801 => 2.1081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.60% (2.0681 => 2.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0123) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.47% (1.9481 => 2.1521, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.06% (0.6360 => 0.7000, std.dev.: 0.0185) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: 9.38% (10.4007 => 11.3767, std.dev.: 0.0817) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.62% (0.4640 => 0.5040, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.60% (0.7880 => 0.8400, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (6.4800 => 6.8520, std.dev.: 0.0517) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0168) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.53% (6.5320 => 6.8280, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4920 => 0.5120, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (5.8281 => 6.0641, std.dev.: 0.0317) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (9.6042 => 9.9482, std.dev.: 0.0681) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (6.5360 => 6.7600, std.dev.: 0.0320) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (5.3960 => 5.5800, std.dev.: 0.0257) MultiSource/Applications/lua/lua: 3.17% (4.7920 => 4.9440, std.dev.: 0.0351) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1600 => 2.2200, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (16.3003 => 16.7523, std.dev.: 0.0599) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0209) MultiSource/Applications/JM/lencod/lencod: 2.61% (22.2206 => 22.8007, std.dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2243 => 4.3243, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 2.30% (38.6366 => 39.5246, std.dev.: 0.0739) MultiSource/Applications/JM/ldecod/ldecod: 2.27% (10.2283 => 10.4603, std.dev.: 0.0344) MultiSource/Applications/SPASS/SPASS: 2.25% (18.5284 => 18.9446, std.dev.: 0.0420) MultiSource/Applications/d/make_dparser: 2.11% (3.9761 => 4.0601, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.56% (1.0241 => 1.0401, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 1.25% (19.8291 => 20.0771, std.dev.: 0.0760) MultiSource/Applications/siod/siod: 1.16% (2.7522 => 2.7842, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.55% (2.1201 => 2.4922, std.dev.: 0.0329) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.38% (1.6561 => 1.7121, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.61% (6.5964 => 6.7684, std.dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (3.7442 => 3.7962, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.73% (2.9562 => 0.6880, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: -7.25% (1.8760 => 1.7400, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.21% (94.8339 => 49.1151, std.dev.: 10.4121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.96% (49.9431 => 32.9821, std.dev.: 0.2666) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.60% (25.7136 => 17.0731, std.dev.: 0.0907) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.54% (37.0863 => 28.7258, std.dev.: 0.5498) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0190) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 09:35:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 11:35:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140406163555.EBB122A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24356?compare_to=24338&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24356, Order: 205689, Start Time: 2014-04-06 11:49:11, End Time: 2014-04-06 16:42:15 To: 24338, Order: 205572, Start Time: 2014-04-03 22:24:02, End Time: 2014-04-04 03:18:12 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 18 (150 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2008-04-18-LoopBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Queens: 85.71% (0.0280 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/15-trie/trie: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 11.36% (0.1760 => 0.1960, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.20% (1.0480 => 1.0920, std.dev.: 0.0103) MultiSource/Applications/d/make_dparser: 1.77% (4.0761 => 4.1481, std.dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 33.33% (0.0600 => 0.0800, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 4.30% (2.1401 => 2.2321, std.dev.: 0.0326) SingleSource/Benchmarks/Dhrystone/fldry: 2.78% (0.5760 => 0.5920, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (0.6840 => 0.6960, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -13.79% (0.1160 => 0.1000, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0076) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0086) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 757.89% (0.0760 => 0.6520, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 390.52% (0.2520 => 1.2361, std.dev.: 0.0136) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 275.91% (0.2320 => 0.8721, std.dev.: 0.0109) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0061) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0057) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0057) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0063) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 55.11% (0.7040 => 1.0920, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 44.44% (0.0720 => 0.1040, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0142) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0130) MultiSource/Applications/obsequi/Obsequi: 20.98% (1.3920 => 1.6840, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.07% (1.1561 => 1.3881, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.45% (1.1721 => 1.4001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 18.79% (8.5802 => 10.1923, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.53% (1.1441 => 1.3561, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.27% (1.1601 => 1.3721, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.39% (1.2881 => 1.5121, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: 15.64% (19.5406 => 22.5967, std.dev.: 0.0589) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.32% (5.3360 => 6.1001, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0169) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0199) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0048) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 9.10% (6.2844 => 6.8564, std.dev.: 0.0170) MultiSource/Benchmarks/mafft/pairlocalalign: 9.07% (11.3843 => 12.4163, std.dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.7280 => 6.1960, std.dev.: 0.0384) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.11% (0.4440 => 0.4800, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.90% (5.6680 => 6.1160, std.dev.: 0.0477) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (11.4440 => 12.3440, std.dev.: 0.0469) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.72% (9.5802 => 10.2242, std.dev.: 0.0387) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0116) MultiSource/Applications/spiff/spiff: 6.11% (1.0480 => 1.1120, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0082) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 4.11% (4.7720 => 4.9680, std.dev.: 0.0265) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0407) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0167) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.6961 => 1.7601, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7600 => 1.8240, std.dev.: 0.0142) SingleSource/UnitTests/Vector/constpool: 3.59% (11.0207 => 11.4167, std.dev.: 0.0980) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (1.0680 => 1.1040, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 3.16% (19.2243 => 19.8324, std.dev.: 0.0515) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0065) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.05% (49.1529 => 50.6529, std.dev.: 0.1203) MultiSource/Applications/sqlite3/sqlite3: 2.70% (24.7575 => 25.4255, std.dev.: 0.0438) MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (2.7282 => 2.8002, std.dev.: 0.0106) MultiSource/Applications/treecc/treecc: 2.27% (2.6480 => 2.7080, std.dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: 1.72% (19.7491 => 20.0891, std.dev.: 0.0535) MultiSource/Benchmarks/Bullet/bullet: 1.45% (39.0726 => 39.6406, std.dev.: 0.0739) MultiSource/Applications/SPASS/SPASS: 1.23% (18.7966 => 19.0285, std.dev.: 0.0378) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0518) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.07% (3.3122 => 3.4802, std.dev.: 0.0583) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 2.52% (6.8204 => 6.9924, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0354) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.1002) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.0963 => 5.0403, std.dev.: 0.0127) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 14:11:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 16:11:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140406211116.B140D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24357?compare_to=24351&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24357, Order: 205689, Start Time: 2014-04-06 16:29:14, End Time: 2014-04-06 21:17:36 To: 24351, Order: 205688, Start Time: 2014-04-06 11:37:29, End Time: 2014-04-06 16:26:11 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1104 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-26-Shorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/div: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/FloatMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: 7.41% (0.3240 => 0.3480, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.97% (0.8040 => 0.8520, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/ReedSolomon: 4.84% (0.2480 => 0.2600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/nestedloop: 2.18% (1.1001 => 1.1241, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.57% (4.6683 => 4.7883, std.dev.: 0.0340) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.73% (0.7280 => 0.5480, std.dev.: 0.0139) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 14:13:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 16:13:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140406211333.27C932A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24358?compare_to=24352&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24358, Order: 205689, Start Time: 2014-04-06 16:30:28, End Time: 2014-04-06 21:19:52 To: 24352, Order: 205688, Start Time: 2014-04-06 11:37:54, End Time: 2014-04-06 16:27:23 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 17 (137 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (954 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-31-CastToBool: 200.00% (0.0080 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_shift: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 15.38% (0.1040 => 0.1200, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.26% (0.3040 => 0.3200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: 3.08% (2.6000 => 2.6800, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/football/football: 1.81% (1.1040 => 1.1240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.39% (1.7321 => 1.7561, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 8.00% (0.7000 => 0.7560, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/lists1: 7.81% (0.2560 => 0.2760, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.24% (11.3687 => 31.1779, std.dev.: 0.0764) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0116) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Puzzle: 294.80% (0.4600 => 1.8161, std.dev.: 0.0113) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0031) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.18% (0.0680 => 0.0960, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 25.00% (0.0960 => 0.1200, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/15-trie/trie: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.69% (0.1160 => 0.1400, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.08% (1.5481 => 1.7041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (1.5521 => 1.7041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0195) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.45% (1.7361 => 1.9001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.68% (1.6121 => 1.7521, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.64% (0.3240 => 0.3520, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.11% (0.2960 => 0.3200, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.95% (1.7841 => 1.9081, std.dev.: 0.0136) SingleSource/UnitTests/Vector/constpool: 6.81% (10.6247 => 11.3487, std.dev.: 0.1446) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.4680 => 6.8760, std.dev.: 0.0473) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.6440 => 12.3560, std.dev.: 0.0565) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.7400 => 1.8400, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.65% (1.4161 => 1.4961, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2160 => 0.2280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 5.36% (1.7921 => 1.8881, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (10.0443 => 10.5443, std.dev.: 0.0279) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (5.8121 => 6.0801, std.dev.: 0.0404) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (9.4842 => 9.9202, std.dev.: 0.0621) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.49% (0.9800 => 1.0240, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.46% (6.5440 => 6.8360, std.dev.: 0.0422) MultiSource/Applications/JM/lencod/lencod: 4.39% (21.9606 => 22.9248, std.dev.: 0.0475) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (2.0440 => 2.1320, std.dev.: 0.0286) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.5600 => 1.6240, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (6.5080 => 6.7520, std.dev.: 0.0487) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.73% (50.0290 => 51.8930, std.dev.: 0.0861) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.9681 => 1.0041, std.dev.: 0.0118) MultiSource/Applications/treecc/treecc: 3.72% (2.5840 => 2.6800, std.dev.: 0.0191) MultiSource/Applications/lua/lua: 3.68% (4.7880 => 4.9640, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0225) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (5.3600 => 5.5440, std.dev.: 0.0459) MultiSource/Applications/siod/siod: 3.24% (2.7162 => 2.8042, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0131) MultiSource/Benchmarks/Bullet/bullet: 3.08% (38.4046 => 39.5886, std.dev.: 0.0939) MultiSource/Applications/hbd/hbd: 3.00% (1.7360 => 1.7880, std.dev.: 0.0167) MultiSource/Applications/SPASS/SPASS: 2.93% (18.4404 => 18.9805, std.dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0164) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.7721 => 1.8201, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (16.3483 => 16.7883, std.dev.: 0.0449) MultiSource/Applications/ClamAV/clamscan: 2.60% (19.0444 => 19.5403, std.dev.: 0.0441) MultiSource/Applications/kimwitu++/kc: 2.23% (19.6891 => 20.1291, std.dev.: 0.0344) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (1.1000 => 1.1240, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0204) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.28% (2.1401 => 2.4242, std.dev.: 0.0337) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.89% (0.7200 => 0.7480, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: 2.53% (2.0521 => 2.1041, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.21% (3.9842 => 4.0323, std.dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.09% (2.9442 => 0.7040, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: -6.42% (1.8680 => 1.7480, std.dev.: 0.0262) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.27% (91.8497 => 49.3511, std.dev.: 9.8116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.87% (26.0616 => 16.9731, std.dev.: 0.1428) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.15% (50.3031 => 33.1261, std.dev.: 0.1566) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.60% (42.1466 => 28.8298, std.dev.: 0.5681) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.68% (3.1122 => 2.3441, std.dev.: 0.1092) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0048) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 15:10:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 17:10:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140406221017.16FA62A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24359?compare_to=24353&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24359, Order: 205691, Start Time: 2014-04-06 17:31:34, End Time: 2014-04-06 22:16:36 To: 24353, Order: 205689, Start Time: 2014-04-06 11:41:08, End Time: 2014-04-06 16:29:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (100 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/UnitTests/Threads/tls: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bisort/bisort: 38.46% (0.0520 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2760 => 0.3000, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.79% (0.3080 => 0.3320, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.00% (0.4000 => 0.4200, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2440 => 0.2560, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: 1.55% (11.3527 => 11.5287, std.dev.: 0.0564) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.17% (1.3721 => 1.3881, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (4.9520 => 5.0040, std.dev.: 0.0177) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (10.6762 => 10.7842, std.dev.: 0.0351) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 13.89% (0.2880 => 0.3280, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.86% (0.3160 => 0.3440, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.26% (0.3760 => 0.3920, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 4.22% (1.9921 => 2.0761, std.dev.: 0.0230) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0827) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: 5.80% (10.8967 => 11.5287, std.dev.: 0.0564) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0125) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0340) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0168) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0211) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0410) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0259) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0177) MultiSource/Applications/sqlite3/sqlite3: 2.12% (23.7574 => 24.2615, std.dev.: 0.0443) MultiSource/Benchmarks/Bullet/bullet: 1.93% (37.0925 => 37.8086, std.dev.: 0.0564) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (7.8562 => 7.9962, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0128) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.53% (48.1088 => 48.8450, std.dev.: 0.1316) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.31% (0.9161 => 0.9281, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0247) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0227) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0183) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.20% (1.0921 => 1.1161, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0164) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/ccc: -71.43% (0.0280 => 0.0080, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 15:16:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 17:16:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140406221643.EC9CB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24360?compare_to=24354&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24360, Order: 205691, Start Time: 2014-04-06 17:31:34, End Time: 2014-04-06 22:23:06 To: 24354, Order: 205689, Start Time: 2014-04-06 11:44:34, End Time: 2014-04-06 16:36:03 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (120 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (959 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-09-18-BitFieldTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.33% (0.2400 => 0.2600, std.dev.: 0.0076) SingleSource/Regression/C/bigstack: 7.32% (0.1640 => 0.1760, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.89% (0.7360 => 0.7720, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3600 => 0.3760, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3360 => 0.3480, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.37% (2.0401 => 2.0681, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.09% (0.1760 => 0.1920, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 8.31% (1.3001 => 1.4081, std.dev.: 0.0409) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0035) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0086) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.51% (1.6881 => 2.0681, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.78% (1.7081 => 2.0801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.46% (1.6961 => 2.0601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.15% (1.7401 => 2.1081, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.05% (1.7481 => 2.1161, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.04% (1.7681 => 2.1401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.04% (1.6921 => 2.0481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.84% (1.8041 => 2.1801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.81% (1.9801 => 2.3921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.80% (1.8081 => 2.1841, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.69% (1.8281 => 2.1881, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.18% (1.9601 => 2.3361, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.08% (1.9081 => 2.2721, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.74% (1.9641 => 2.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0123) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.77% (1.9801 => 2.3121, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0239) MultiSource/Applications/viterbi/viterbi: 11.32% (0.2120 => 0.2360, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.22% (0.7200 => 0.7720, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (11.7880 => 12.4760, std.dev.: 0.0657) MultiSource/Benchmarks/McCat/08-main/main: 5.75% (0.3480 => 0.3680, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.24% (6.7200 => 7.0720, std.dev.: 0.0555) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0141) SingleSource/UnitTests/Vector/constpool: 4.77% (10.9087 => 11.4287, std.dev.: 0.0974) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.5240 => 1.5920, std.dev.: 0.0230) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.9842 => 10.4122, std.dev.: 0.0329) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0158) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (2.0680 => 2.1520, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.86% (6.8321 => 7.0961, std.dev.: 0.0300) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 3.23% (3.9641 => 4.0921, std.dev.: 0.0331) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 3.07% (6.9124 => 7.1244, std.dev.: 0.0182) MultiSource/Applications/SPASS/SPASS: 2.96% (18.4924 => 19.0405, std.dev.: 0.0583) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (10.3203 => 10.6203, std.dev.: 0.0449) MultiSource/Applications/JM/lencod/lencod: 2.81% (22.6287 => 23.2648, std.dev.: 0.0582) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.38% (51.1089 => 52.3249, std.dev.: 0.0546) MultiSource/Benchmarks/Bullet/bullet: 2.15% (38.9366 => 39.7726, std.dev.: 0.0705) MultiSource/Applications/kimwitu++/kc: 2.09% (19.7371 => 20.1491, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (16.5963 => 16.9243, std.dev.: 0.0666) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 1.87% (0.8560 => 0.8720, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0088) MultiSource/Applications/ClamAV/clamscan: 1.72% (20.2445 => 20.5925, std.dev.: 0.0784) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (3.0122 => 3.0602, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0244 => 6.1124, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: 1.30% (25.1895 => 25.5175, std.dev.: 0.0272) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.14% (1.2681 => 1.4601, std.dev.: 0.0132) MultiSource/Applications/minisat/minisat: 2.82% (6.8204 => 7.0124, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.68% (4.7563 => 4.8363, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 1.61% (21.6534 => 22.0014, std.dev.: 0.1305) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.82% (6.2884 => 1.3321, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0107) MultiSource/Applications/obsequi/Obsequi: -32.48% (2.6481 => 1.7880, std.dev.: 0.0152) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.63% (7.4801 => 6.2360, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.94% (7.5041 => 6.3080, std.dev.: 0.0383) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -9.09% (0.1760 => 0.1600, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -3.08% (13.5243 => 13.1083, std.dev.: 0.0344) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -15.03% (7.8005 => 6.6284, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (0.9281 => 0.8561, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0128) MultiSource/Applications/lambda-0_1_3/lambda: -2.17% (5.1603 => 5.0483, std.dev.: 0.0168) MultiSource/Applications/JM/lencod/lencod: -1.88% (8.3085 => 8.1525, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3401 => 2.3081, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0188) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 15:17:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 17:17:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140406221750.204072A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24361?compare_to=24355&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24361, Order: 205691, Start Time: 2014-04-06 17:31:39, End Time: 2014-04-06 22:24:12 To: 24355, Order: 205689, Start Time: 2014-04-06 11:47:34, End Time: 2014-04-06 16:39:57 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 9 (118 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (962 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 2.53% (1.5800 => 1.6200, std.dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.89% (4.4443 => 4.5283, std.dev.: 0.0304) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.71% (17.6723 => 19.5644, std.dev.: 0.0606) MultiSource/Applications/sqlite3/sqlite3: 1416.00% (1.7001 => 25.7736, std.dev.: 0.0448) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.32% (50.1010 => 51.7650, std.dev.: 0.1161) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (1.0520 => 1.0720, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (11.3920 => 12.2840, std.dev.: 0.0626) SingleSource/Benchmarks/Misc/oourafft: 175.06% (11.3407 => 31.1939, std.dev.: 0.0916) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0106) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0067) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.00% (0.1920 => 0.2400, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.41% (1.8281 => 2.1281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.15% (1.8081 => 2.1001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 16.04% (1.8201 => 2.1121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.45% (1.9161 => 2.2121, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.19% (2.0281 => 2.3361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.01% (1.8921 => 2.1761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.01% (1.9721 => 2.2681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.43% (1.9121 => 2.1881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0179) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.55% (1.9761 => 2.2241, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.15% (1.8441 => 2.0681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.00% (1.9001 => 2.1281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.87% (1.9201 => 2.1481, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (1.8361 => 2.0521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.18% (1.8601 => 2.0681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.88% (1.9481 => 2.1601, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: 8.96% (10.4007 => 11.3327, std.dev.: 0.1494) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.81% (0.6360 => 0.6920, std.dev.: 0.0152) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.46% (1.0880 => 1.1800, std.dev.: 0.0338) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8881 => 0.9601, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (6.4800 => 6.8880, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 6.02% (1.5280 => 1.6200, std.dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.4480 => 0.4720, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (0.4760 => 0.5000, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0272) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (1.2120 => 1.2600, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.1600 => 2.2360, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (6.5360 => 6.7640, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.7480 => 1.8080, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.36% (5.8281 => 6.0241, std.dev.: 0.0565) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (16.3003 => 16.7683, std.dev.: 0.0492) MultiSource/Applications/lua/lua: 2.75% (4.7920 => 4.9240, std.dev.: 0.0287) MultiSource/Applications/JM/lencod/lencod: 2.68% (22.2206 => 22.8167, std.dev.: 0.0510) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.62% (9.6042 => 9.8562, std.dev.: 0.0735) MultiSource/Applications/SPASS/SPASS: 2.57% (18.5284 => 19.0045, std.dev.: 0.0369) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0204) MultiSource/Benchmarks/Bullet/bullet: 2.47% (38.6366 => 39.5926, std.dev.: 0.0660) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0125) MultiSource/Applications/d/make_dparser: 2.01% (3.9761 => 4.0561, std.dev.: 0.0222) MultiSource/Applications/JM/ldecod/ldecod: 1.64% (10.2283 => 10.3963, std.dev.: 0.0431) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2243 => 4.2923, std.dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 1.27% (19.8291 => 20.0811, std.dev.: 0.0515) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.74% (2.1201 => 2.4962, std.dev.: 0.0343) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0282) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (3.9442 => 3.9962, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -75.92% (2.9562 => 0.7120, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.24% (1.5881 => 0.5520, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: -6.18% (1.8760 => 1.7600, std.dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.20% (94.8339 => 49.1271, std.dev.: 10.4979) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.16% (49.9431 => 32.8821, std.dev.: 0.3358) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.59% (25.7136 => 17.0771, std.dev.: 0.0954) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.02% (37.0863 => 28.5498, std.dev.: 0.5849) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0056) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.78% (5.6124 => 5.5123, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 15:18:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 17:18:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140406221833.0A3732A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24362?compare_to=24356&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24362, Order: 205691, Start Time: 2014-04-06 17:31:38, End Time: 2014-04-06 22:24:55 To: 24356, Order: 205689, Start Time: 2014-04-06 11:49:11, End Time: 2014-04-06 16:42:15 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 8 (145 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.00% (1.1000 => 1.1880, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.81% (0.7680 => 0.8280, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4520 => 0.4720, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.55% (0.2200 => 0.2520, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1987.50% (0.0320 => 0.6680, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Puzzle: 1206.53% (0.1240 => 1.6201, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 390.52% (0.2520 => 1.2361, std.dev.: 0.0190) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0065) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0062) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0092) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0065) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/ary3: 62.50% (0.0320 => 0.0520, std.dev.: 0.0031) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.00% (0.7040 => 1.0560, std.dev.: 0.0198) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0107) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0144) MultiSource/Applications/obsequi/Obsequi: 19.54% (1.3920 => 1.6640, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: 18.56% (8.5802 => 10.1723, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.86% (1.2321 => 1.4521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.39% (1.2881 => 1.5121, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 15.21% (19.5406 => 22.5127, std.dev.: 0.0563) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.65% (5.3360 => 6.0641, std.dev.: 0.0299) MultiSource/Benchmarks/nbench/nbench: 13.31% (1.3521 => 1.5321, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.11% (1.7400 => 1.9160, std.dev.: 0.0322) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0157) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 9.03% (11.3843 => 12.4123, std.dev.: 0.0266) MultiSource/Applications/oggenc/oggenc: 8.40% (6.2844 => 6.8124, std.dev.: 0.0219) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.7280 => 6.1960, std.dev.: 0.0391) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.76% (5.6680 => 6.1080, std.dev.: 0.0628) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.72% (11.4440 => 12.3280, std.dev.: 0.0470) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.18% (9.5802 => 10.1722, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6120 => 0.6480, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 3.94% (4.7720 => 4.9600, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: 3.63% (11.0207 => 11.4207, std.dev.: 0.1088) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3320 => 0.3440, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (6.8280 => 7.0720, std.dev.: 0.0461) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.4320 => 1.4800, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0201) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.04% (49.1529 => 50.6489, std.dev.: 0.0763) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.7600 => 1.8080, std.dev.: 0.0185) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.69% (1.3400 => 1.3760, std.dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 2.66% (19.2243 => 19.7364, std.dev.: 0.0513) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (5.3840 => 5.5240, std.dev.: 0.0506) MultiSource/Applications/sqlite3/sqlite3: 2.39% (24.7575 => 25.3495, std.dev.: 0.0356) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0113) MultiSource/Applications/kimwitu++/kc: 1.80% (19.7491 => 20.1051, std.dev.: 0.0396) MultiSource/Benchmarks/Bullet/bullet: 1.46% (39.0726 => 39.6446, std.dev.: 0.0525) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0026) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0234) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0281) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 2.07% (4.0563 => 4.1403, std.dev.: 0.0253) MultiSource/Benchmarks/Olden/power/power: 2.06% (1.3601 => 1.3881, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -8.64% (3.4722 => 3.1722, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0792) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.5602 => 3.5162, std.dev.: 0.0143) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 19:03:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 21:03:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407020348.8F0F02A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24363?compare_to=24357&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24363, Order: 205691, Start Time: 2014-04-06 21:21:23, End Time: 2014-04-07 02:10:06 To: 24357, Order: 205689, Start Time: 2014-04-06 16:29:14, End Time: 2014-04-06 21:17:36 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1103 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: 19.05% (0.0840 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 10.34% (0.2320 => 0.2560, std.dev.: 0.0058) SingleSource/UnitTests/Vector/multiplies: 8.33% (0.1440 => 0.1560, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 25.00% (0.1600 => 0.2000, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: -7.14% (0.2800 => 0.2600, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.82% (0.7280 => 0.5400, std.dev.: 0.0149) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 6 19:06:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Apr 2014 21:06:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407020641.98A4F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24364?compare_to=24358&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24364, Order: 205691, Start Time: 2014-04-06 21:23:39, End Time: 2014-04-07 02:13:01 To: 24358, Order: 205689, Start Time: 2014-04-06 16:30:28, End Time: 2014-04-06 21:19:52 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (131 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (957 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 12.00% (0.2000 => 0.2240, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2200 => 0.2360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: 4.05% (0.2960 => 0.3080, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.03% (1.5601 => 1.5761, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.05% (4.6883 => 4.7843, std.dev.: 0.0318) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.10% (11.3687 => 31.1619, std.dev.: 0.1014) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0072) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0085) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0054) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 42.86% (0.0280 => 0.0400, std.dev.: 0.0022) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0640 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0134) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.44% (1.4401 => 1.5761, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.31% (1.4601 => 1.5961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: 8.73% (1.0080 => 1.0960, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.36% (1.4841 => 1.6081, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.39% (0.7040 => 0.7560, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.02% (0.2280 => 0.2440, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0109) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.41% (1.4361 => 1.5281, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.25% (1.0240 => 1.0880, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: 6.14% (10.6247 => 11.2767, std.dev.: 0.1328) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.91% (1.6921 => 1.7921, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (6.4680 => 6.8400, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (11.6440 => 12.3000, std.dev.: 0.0545) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.7400 => 1.8360, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0363) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.5480 => 1.6240, std.dev.: 0.0260) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (9.4842 => 9.9402, std.dev.: 0.0487) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.61% (6.5080 => 6.8080, std.dev.: 0.0400) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.0443 => 10.4963, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: 4.24% (1.5080 => 1.5720, std.dev.: 0.0223) MultiSource/Applications/JM/lencod/lencod: 4.08% (21.9606 => 22.8568, std.dev.: 0.0443) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (6.5440 => 6.7920, std.dev.: 0.0541) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (2.3281 => 2.4082, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (1.6601 => 1.7161, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (5.3600 => 5.5360, std.dev.: 0.0589) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.20% (50.0290 => 51.6290, std.dev.: 0.0985) MultiSource/Applications/oggenc/oggenc: 3.04% (6.9844 => 7.1964, std.dev.: 0.0194) MultiSource/Benchmarks/Bullet/bullet: 2.98% (38.4046 => 39.5486, std.dev.: 0.0780) MultiSource/Applications/SPASS/SPASS: 2.95% (18.4404 => 18.9846, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (4.1843 => 4.2843, std.dev.: 0.0129) MultiSource/Applications/treecc/treecc: 2.32% (2.5840 => 2.6440, std.dev.: 0.0226) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (16.3483 => 16.7243, std.dev.: 0.0627) MultiSource/Applications/ClamAV/clamscan: 2.16% (19.0444 => 19.4564, std.dev.: 0.0692) MultiSource/Applications/siod/siod: 1.91% (2.7162 => 2.7682, std.dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 1.73% (19.6891 => 20.0291, std.dev.: 0.0554) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (13.0563 => 13.2003, std.dev.: 0.0257) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0306) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.31% (4.6763 => 4.7843, std.dev.: 0.0318) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 1.20% (6.6684 => 6.7484, std.dev.: 0.0199) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.36% (2.9442 => 0.6960, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.10% (1.5641 => 0.6240, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: -5.78% (1.8680 => 1.7600, std.dev.: 0.0286) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.10% (91.8497 => 49.5071, std.dev.: 10.2821) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.58% (26.0616 => 17.0491, std.dev.: 0.1549) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.41% (50.3031 => 32.9941, std.dev.: 0.2784) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.71% (42.1466 => 28.7818, std.dev.: 0.2605) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1040) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0120) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0168) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 01:39:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 03:39:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407083937.BCF772A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24365?compare_to=24363&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24365, Order: 205695, Start Time: 2014-04-07 03:56:39, End Time: 2014-04-07 08:45:50 To: 24363, Order: 205691, Start Time: 2014-04-06 21:21:23, End Time: 2014-04-07 02:10:06 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1101 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.48% (1.7760 => 1.8200, std.dev.: 0.0140) MultiSource/Benchmarks/nbench/nbench: 1.48% (1.8881 => 1.9161, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0115) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 01:39:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 03:39:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407083955.72BAE2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24366?compare_to=24364&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24366, Order: 205695, Start Time: 2014-04-07 03:56:43, End Time: 2014-04-07 08:46:17 To: 24364, Order: 205691, Start Time: 2014-04-06 21:23:39, End Time: 2014-04-07 02:13:01 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 10 (123 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (966 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/Vector/sumarray: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Regression/C++/EH/exception_spec_test: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.90% (0.3480 => 0.3720, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists1: 4.49% (0.3560 => 0.3720, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.00% (0.2400 => 0.2520, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.28% (11.3687 => 31.1819, std.dev.: 0.0671) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0134) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0063) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0030) SingleSource/UnitTests/2002-10-12-StructureArgs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0074) SingleSource/Regression/C/test_indvars: 17.39% (0.0920 => 0.1080, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.05% (0.3320 => 0.3720, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.62% (1.4841 => 1.6121, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0135) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.9800 => 1.0600, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0157) MultiSource/Applications/spiff/spiff: 7.94% (1.0080 => 1.0880, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0170) SingleSource/UnitTests/Vector/constpool: 7.68% (10.6247 => 11.4407, std.dev.: 0.1099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.87% (1.1640 => 1.2440, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.73% (1.7841 => 1.9041, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (6.4680 => 6.8880, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.23% (1.5401 => 1.6361, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (11.6440 => 12.2760, std.dev.: 0.0631) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.36% (0.2240 => 0.2360, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (2.0440 => 2.1520, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0230) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.34% (9.4842 => 9.8962, std.dev.: 0.0706) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.0443 => 10.4763, std.dev.: 0.0358) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 4.17% (21.9606 => 22.8768, std.dev.: 0.0433) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5440 => 6.8160, std.dev.: 0.0356) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.5480 => 1.6120, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.05% (0.2960 => 0.3080, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (6.5080 => 6.7480, std.dev.: 0.0358) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.8440 => 1.9120, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6601 => 1.7201, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (5.3600 => 5.5400, std.dev.: 0.0394) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.30% (50.0290 => 51.6810, std.dev.: 0.0980) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 3.26% (4.7880 => 4.9440, std.dev.: 0.0340) MultiSource/Applications/oggenc/oggenc: 3.21% (6.9844 => 7.2085, std.dev.: 0.0160) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.92% (2.3281 => 2.3961, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 2.79% (38.4046 => 39.4766, std.dev.: 0.0970) MultiSource/Applications/treecc/treecc: 2.79% (2.5840 => 2.6560, std.dev.: 0.0246) MultiSource/Applications/SPASS/SPASS: 2.73% (18.4404 => 18.9446, std.dev.: 0.0804) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.64% (3.0282 => 3.1082, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.54% (0.4720 => 0.4840, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (16.3483 => 16.7443, std.dev.: 0.0315) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (4.1843 => 4.2843, std.dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: 2.35% (19.0444 => 19.4924, std.dev.: 0.0326) MultiSource/Applications/kimwitu++/kc: 1.69% (19.6891 => 20.0211, std.dev.: 0.0480) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.77% (2.1401 => 2.4562, std.dev.: 0.0378) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 5.59% (2.8602 => 3.0202, std.dev.: 0.0254) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0129) MultiSource/Applications/obsequi/Obsequi: 3.51% (2.0521 => 2.1241, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.21% (3.9842 => 4.0323, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (3.9562 => 4.0003, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.63% (2.9442 => 0.6880, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0065) MultiSource/Applications/obsequi/Obsequi: -6.42% (1.8680 => 1.7480, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.33% (91.8497 => 49.2951, std.dev.: 9.6002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.48% (50.3031 => 32.9581, std.dev.: 0.1705) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.47% (26.0616 => 17.0771, std.dev.: 0.0828) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.19% (42.1466 => 28.5778, std.dev.: 0.4685) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1007) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.16% (4.1243 => 4.0763, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 01:41:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 03:41:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140407084150.376B82A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24367?compare_to=24360&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24367, Order: 205695, Start Time: 2014-04-07 03:56:40, End Time: 2014-04-07 08:48:11 To: 24360, Order: 205691, Start Time: 2014-04-06 17:31:34, End Time: 2014-04-06 22:23:06 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (132 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.39% (0.3080 => 0.3400, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 5.08% (0.2360 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.39% (2.0201 => 2.0481, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 40.00% (0.0400 => 0.0560, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.48% (0.2440 => 0.2720, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0113) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 22.19% (1.6761 => 2.0481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.80% (1.6881 => 2.0561, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.58% (1.7241 => 2.0961, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.54% (1.7081 => 2.0761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.16% (1.7201 => 2.0841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.10% (1.7441 => 2.1121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.99% (1.6961 => 2.0521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.98% (1.7921 => 2.1681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.35% (1.8281 => 2.2001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.18% (1.9601 => 2.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0105) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.18% (1.9801 => 2.3401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.86% (3.5002 => 3.7402, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (6.7200 => 7.1240, std.dev.: 0.0498) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (11.7880 => 12.4840, std.dev.: 0.0487) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.77% (1.5240 => 1.6120, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.4800 => 0.5040, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (9.9842 => 10.4522, std.dev.: 0.0248) MultiSource/Applications/lua/lua: 4.59% (4.7920 => 5.0120, std.dev.: 0.0369) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.32% (0.5560 => 0.5800, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: 4.25% (10.9087 => 11.3727, std.dev.: 0.1266) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0140) MultiSource/Applications/d/make_dparser: 4.14% (3.9641 => 4.1281, std.dev.: 0.0231) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (1.6481 => 1.7161, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0126) MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 3.97% (2.6200 => 2.7240, std.dev.: 0.0166) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.8201 => 1.8921, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0054) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.56% (1.3480 => 1.3960, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.37% (0.3560 => 0.3680, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (10.3203 => 10.6643, std.dev.: 0.0281) MultiSource/Applications/oggenc/oggenc: 3.30% (6.9124 => 7.1404, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0210) MultiSource/Applications/SPASS/SPASS: 3.07% (18.4924 => 19.0607, std.dev.: 0.0521) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (6.8321 => 7.0321, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (1.2400 => 1.2760, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: 2.63% (22.6287 => 23.2247, std.dev.: 0.0563) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 2.34% (0.8560 => 0.8760, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: 2.25% (20.2445 => 20.7005, std.dev.: 0.0523) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.12% (51.1089 => 52.1929, std.dev.: 0.1604) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (16.5963 => 16.9483, std.dev.: 0.0470) MultiSource/Benchmarks/Bullet/bullet: 2.11% (38.9366 => 39.7566, std.dev.: 0.0870) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (5.5480 => 5.6560, std.dev.: 0.0382) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2203 => 4.2963, std.dev.: 0.0163) MultiSource/Applications/kimwitu++/kc: 1.78% (19.7371 => 20.0891, std.dev.: 0.0470) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (6.0244 => 6.1084, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (3.0122 => 3.0522, std.dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 1.30% (25.1895 => 25.5175, std.dev.: 0.0420) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 40.00% (0.0400 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 27.58% (0.9281 => 1.1841, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: 24.36% (7.3405 => 9.1286, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.14% (1.2681 => 1.4601, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0394) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 1.64% (21.6534 => 22.0094, std.dev.: 0.0588) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0229) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.85% (7.4801 => 6.2200, std.dev.: 0.0405) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.05% (7.5041 => 6.3000, std.dev.: 0.0395) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -8.11% (0.2960 => 0.2720, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: -3.31% (13.5243 => 13.0763, std.dev.: 0.0426) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0055) SingleSource/Benchmarks/Linpack/linpack-pc: -15.03% (7.8005 => 6.6284, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -2.17% (5.1603 => 5.0483, std.dev.: 0.0166) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.25% (3.8442 => 3.7962, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 01:42:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 03:42:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140407084228.BF8602A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24368?compare_to=24361&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24368, Order: 205695, Start Time: 2014-04-07 03:56:40, End Time: 2014-04-07 08:48:49 To: 24361, Order: 205691, Start Time: 2014-04-06 17:31:39, End Time: 2014-04-06 22:24:12 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 23 (137 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Regression/C/badidx: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 100.00% (0.0200 => 0.0400, std.dev.: 0.0042) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/objinst: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/UnitTests/Vector/sumarray-dbl: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 40.00% (0.0400 => 0.0560, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Towers: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.54% (0.1040 => 0.1160, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.47% (0.2360 => 0.2560, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 5.66% (0.2120 => 0.2240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.08% (0.2360 => 0.2480, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.49% (0.3560 => 0.3720, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.48% (1.0720 => 1.1200, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.36% (1.0161 => 1.0401, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.46% (9.8562 => 10.0002, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.13% (2.1321 => 2.1561, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/spiff/spiff: 5.67% (1.9761 => 2.0881, std.dev.: 0.0315) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.00% (17.6723 => 19.6163, std.dev.: 0.0681) MultiSource/Applications/sqlite3/sqlite3: 1416.95% (1.7001 => 25.7896, std.dev.: 0.0411) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.32% (50.1010 => 51.7650, std.dev.: 0.1158) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.15% (11.3920 => 12.3200, std.dev.: 0.0769) SingleSource/Benchmarks/Misc/oourafft: 174.99% (11.3407 => 31.1859, std.dev.: 0.0926) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0115) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 400.00% (0.0040 => 0.0200, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0088) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0036) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: 66.67% (0.0240 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 55.56% (0.0360 => 0.0560, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/UnitTests/Vector/sumarray-dbl: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 26.09% (0.0920 => 0.1160, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.41% (1.8281 => 2.1281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.37% (1.8081 => 2.1041, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.95% (1.8561 => 2.1521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.92% (1.8761 => 2.1561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0117) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.64% (1.7721 => 1.9961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.42% (1.9001 => 2.1361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.29% (1.9201 => 2.1561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0130) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.09% (1.8201 => 2.0401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/ffbench: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.09% (1.9481 => 2.1641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.71% (0.3360 => 0.3720, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 9.85% (10.4007 => 11.4247, std.dev.: 0.1404) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0173) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.46% (1.0880 => 1.1800, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0198) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0091) MultiSource/Applications/spiff/spiff: 5.51% (1.0160 => 1.0720, std.dev.: 0.0211) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.37% (6.4800 => 6.8280, std.dev.: 0.0509) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.57% (0.7880 => 0.8240, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (9.6042 => 10.0002, std.dev.: 0.0381) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (6.5320 => 6.7960, std.dev.: 0.0484) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.7480 => 1.8080, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (5.8281 => 6.0281, std.dev.: 0.0418) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0309) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0095) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.25% (0.6160 => 0.6360, std.dev.: 0.0074) MultiSource/Applications/treecc/treecc: 3.25% (2.5880 => 2.6720, std.dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: 2.88% (22.2206 => 22.8607, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.82% (6.5360 => 6.7200, std.dev.: 0.0449) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (16.3003 => 16.7483, std.dev.: 0.0343) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: 2.64% (38.6366 => 39.6566, std.dev.: 0.0491) MultiSource/Applications/SPASS/SPASS: 2.33% (18.5284 => 18.9606, std.dev.: 0.0638) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0197) MultiSource/Applications/oggenc/oggenc: 2.04% (7.0524 => 7.1964, std.dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (3.0562 => 3.1122, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (10.2283 => 10.3923, std.dev.: 0.0324) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.56% (1.0241 => 1.0401, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 1.47% (19.8291 => 20.1211, std.dev.: 0.0440) MultiSource/Applications/siod/siod: 1.31% (2.7522 => 2.7882, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.99% (2.1201 => 2.4802, std.dev.: 0.0404) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0360) MultiSource/Applications/spiff/spiff: 4.82% (1.9921 => 2.0881, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.06% (6.5964 => 6.7324, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (4.0003 => 4.0683, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (3.9442 => 3.9962, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.19% (2.9562 => 0.7040, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.49% (1.5881 => 0.5480, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: -7.25% (1.8760 => 1.7400, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.11% (94.8339 => 49.2111, std.dev.: 10.1240) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.00% (49.9431 => 32.9621, std.dev.: 0.1489) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.62% (25.7136 => 17.0691, std.dev.: 0.1125) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.70% (3.0722 => 2.3441, std.dev.: 0.1121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.01% (37.0863 => 28.5538, std.dev.: 0.4412) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.44% (2.7482 => 2.5162, std.dev.: 0.0790) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0183) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 01:43:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 03:43:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140407084342.BD9232A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24369?compare_to=24362&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24369, Order: 205695, Start Time: 2014-04-07 03:56:40, End Time: 2014-04-07 08:50:02 To: 24362, Order: 205691, Start Time: 2014-04-06 17:31:38, End Time: 2014-04-06 22:24:55 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (146 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/Vector/build2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.29% (0.1680 => 0.1920, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.54% (1.0840 => 1.1440, std.dev.: 0.0161) SingleSource/Regression/C/sumarray2d: 3.03% (0.3960 => 0.4080, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (0.6840 => 0.6960, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1962.50% (0.0320 => 0.6600, std.dev.: 0.0111) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 1033.33% (0.0360 => 0.4080, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 388.93% (0.2520 => 1.2321, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/nestedloop: 281.08% (0.2320 => 0.8841, std.dev.: 0.0078) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0055) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0070) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0062) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0067) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 26.32% (0.0760 => 0.0960, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: 21.26% (1.3920 => 1.6880, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.39% (1.1761 => 1.4041, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 18.60% (8.5802 => 10.1763, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.09% (1.1721 => 1.3841, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 17.86% (1.2321 => 1.4521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.82% (1.2841 => 1.5001, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 15.46% (19.5406 => 22.5607, std.dev.: 0.0444) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.39% (5.3360 => 6.1041, std.dev.: 0.0315) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0241) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0102) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.26% (0.4320 => 0.4720, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.01% (0.4440 => 0.4840, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 8.75% (11.3843 => 12.3803, std.dev.: 0.0394) MultiSource/Applications/oggenc/oggenc: 8.40% (6.2844 => 6.8124, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.96% (5.7280 => 6.1840, std.dev.: 0.0328) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (11.4440 => 12.3200, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (5.6680 => 6.1000, std.dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0180) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (9.5802 => 10.1402, std.dev.: 0.0500) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.9800 => 1.0280, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.76% (1.0920 => 1.1440, std.dev.: 0.0161) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0163) MultiSource/Applications/lua/lua: 4.02% (4.7720 => 4.9640, std.dev.: 0.0299) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.88% (1.3400 => 1.3920, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (6.8280 => 7.0720, std.dev.: 0.0422) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 2.85% (19.2243 => 19.7724, std.dev.: 0.0358) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (1.7320 => 1.7800, std.dev.: 0.0160) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.76% (49.1529 => 50.5089, std.dev.: 0.1077) SingleSource/UnitTests/Vector/constpool: 2.65% (11.0207 => 11.3127, std.dev.: 0.1130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (5.3840 => 5.5160, std.dev.: 0.0462) MultiSource/Applications/sqlite3/sqlite3: 2.41% (24.7575 => 25.3535, std.dev.: 0.0410) MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (2.7282 => 2.7722, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 1.36% (39.0726 => 39.6046, std.dev.: 0.0713) MultiSource/Applications/kimwitu++/kc: 1.32% (19.7491 => 20.0091, std.dev.: 0.0621) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0434) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 2.52% (6.8204 => 6.9924, std.dev.: 0.0424) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.3085 => 7.4725, std.dev.: 0.0432) MultiSource/Applications/sqlite3/sqlite3: 2.17% (4.0563 => 4.1443, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-10-13-BadLoad: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.60% (5.2763 => 4.9283, std.dev.: 0.0247) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0296) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (2.3401 => 2.3161, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.0963 => 5.0443, std.dev.: 0.0152) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 01:46:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 03:46:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407084656.DB7BA2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24370?compare_to=24359&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24370, Order: 205695, Start Time: 2014-04-07 04:10:37, End Time: 2014-04-07 08:53:15 To: 24359, Order: 205691, Start Time: 2014-04-06 17:31:34, End Time: 2014-04-06 22:16:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (100 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/ccc: 200.00% (0.0080 => 0.0240, std.dev.: 0.0054) SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0022) SingleSource/Regression/C/sumarraymalloc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.09% (0.1760 => 0.1920, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0159) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 11.39% (0.3160 => 0.3520, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0187) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0112) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.20% (1.2201 => 1.3201, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (10.6960 => 11.3840, std.dev.: 0.0718) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0140) SingleSource/UnitTests/Vector/constpool: 4.37% (10.8967 => 11.3727, std.dev.: 0.1205) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0373) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0348) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0471) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0190) MultiSource/Applications/sqlite3/sqlite3: 2.12% (23.7574 => 24.2615, std.dev.: 0.0323) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 1.69% (37.0925 => 37.7206, std.dev.: 0.0889) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0068) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.51% (48.1088 => 48.8369, std.dev.: 0.1063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0850, std.dev.: 0.0444) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 1.00% (17.5484 => 17.7244, std.dev.: 0.0576) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0349) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0024) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0127) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0281) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 01:53:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 03:53:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407085355.C618F2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24371?compare_to=24370&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24371, Order: 205696, Start Time: 2014-04-07 04:11:37, End Time: 2014-04-07 09:00:15 To: 24370, Order: 205695, Start Time: 2014-04-07 04:10:37, End Time: 2014-04-07 08:53:15 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (93 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.55% (1.2921 => 1.3121, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 9.78% (1.1041 => 1.2121, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.23% (0.3320 => 0.3560, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.50% (1.1761 => 1.2761, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.54% (1.2201 => 1.3121, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0373) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0199) SingleSource/UnitTests/Vector/constpool: 4.99% (10.8967 => 11.4407, std.dev.: 0.1229) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.88% (8.1441 => 8.4601, std.dev.: 0.0444) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0153) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0181) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0522) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0267) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0260) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0458) MultiSource/Benchmarks/Bullet/bullet: 1.71% (37.0925 => 37.7286, std.dev.: 0.0867) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.70% (48.1088 => 48.9289, std.dev.: 0.0916) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 1.15% (18.8170 => 19.0330, std.dev.: 0.0500) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.89% (0.9321 => 1.1921, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 6.69% (1.1361 => 1.2121, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0410) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.9443 => 5.0003, std.dev.: 0.0199) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (1.3481 => 1.3321, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 02:28:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 04:28:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407092818.0955F2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24372?compare_to=24371&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24372, Order: 205697, Start Time: 2014-04-07 04:49:33, End Time: 2014-04-07 09:34:38 To: 24371, Order: 205696, Start Time: 2014-04-07 04:11:37, End Time: 2014-04-07 09:00:15 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (100 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR640: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 20.00% (0.0800 => 0.0960, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: 8.89% (0.1800 => 0.1960, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 5.00% (0.3200 => 0.3360, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2440 => 0.2560, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.4200 => 0.4400, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.81% (1.3281 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.63% (1.2281 => 1.2481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.49% (1.3401 => 1.3601, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.67% (0.2400 => 0.2560, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0038) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0145) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0128) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0583) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: 4.92% (10.8967 => 11.4327, std.dev.: 0.0804) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.9640 => 2.0600, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0252) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0263) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (8.1441 => 8.4761, std.dev.: 0.0392) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0432) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0428) MultiSource/Applications/JM/lencod/lencod: 3.09% (17.6165 => 18.1605, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0314) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0415) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.21% (0.5440 => 0.5560, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.17% (23.7574 => 24.2735, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0305) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 1.80% (37.0925 => 37.7606, std.dev.: 0.1008) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.75% (48.1088 => 48.9529, std.dev.: 0.0635) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0371) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0113) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0092) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0462) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0067) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0069) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -16.67% (0.1200 => 0.1000, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 05:14:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 07:14:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407121420.5F7762A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24373?compare_to=24372&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24373, Order: 205699, Start Time: 2014-04-07 07:35:44, End Time: 2014-04-07 12:20:40 To: 24372, Order: 205697, Start Time: 2014-04-07 04:49:33, End Time: 2014-04-07 09:34:38 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (94 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 28.57% (0.0560 => 0.0720, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.30% (0.1720 => 0.1880, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.2760 => 0.2920, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.17% (1.3681 => 1.3841, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.95% (0.1720 => 0.1960, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.09% (1.0881 => 1.1761, std.dev.: 0.0341) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.6840 => 0.7400, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.09% (1.2361 => 1.3361, std.dev.: 0.0132) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0683) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.86% (1.3641 => 1.4441, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0368) SingleSource/UnitTests/Vector/constpool: 4.48% (10.8967 => 11.3847, std.dev.: 0.1684) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0237) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0350) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0312) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0449) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0422) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0687) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0285) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0303) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0445) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8725, std.dev.: 0.0591) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0105) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.80% (48.1088 => 48.9730, std.dev.: 0.1076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0850, std.dev.: 0.0503) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0428) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0384) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.23% (4.2403 => 4.1883, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 06:49:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 08:49:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407134947.812F02A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24374?compare_to=24365&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24374, Order: 205699, Start Time: 2014-04-07 09:07:47, End Time: 2014-04-07 13:56:10 To: 24365, Order: 205695, Start Time: 2014-04-07 03:56:39, End Time: 2014-04-07 08:45:50 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 22 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1090 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/DuffsDevice: 166.67% (0.0120 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/family/family: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 40.00% (0.0600 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.08% (0.1040 => 0.1280, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0073) SingleSource/Regression/C/bigstack: 6.98% (0.1720 => 0.1840, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2320 => 0.2480, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 4.39% (0.4560 => 0.4760, std.dev.: 0.0056) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.03% (0.6600 => 0.6800, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.74% (0.5840 => 0.6000, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.7520 => 0.7720, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 2.11% (2.6600 => 2.7160, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.37% (1.7481 => 1.7721, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.86% (1.6761 => 1.7241, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: 2.04% (0.5880 => 0.6000, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0116) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 06:51:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 08:51:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407135132.4571D2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24375?compare_to=24366&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24375, Order: 205699, Start Time: 2014-04-07 09:07:58, End Time: 2014-04-07 13:57:54 To: 24366, Order: 205695, Start Time: 2014-04-07 03:56:43, End Time: 2014-04-07 08:46:17 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 1 (1 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 17 (144 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -0.08% (71.2645 => 71.2084, std.dev.: 0.1842) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/EH/class_hierarchy: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.68% (0.1240 => 0.1360, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.7840 => 0.8160, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.5040 => 1.5440, std.dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.59% (0.3640 => 0.3880, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/hash: 1.32% (4.2323 => 4.2883, std.dev.: 0.0128) MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (2.3081 => 2.3361, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: 0.79% (70.6484 => 71.2084, std.dev.: 0.1842) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 173.93% (11.3687 => 31.1419, std.dev.: 0.0573) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0104) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0086) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0052) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.62% (1.0240 => 1.1840, std.dev.: 0.0266) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0040) SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.02% (1.5601 => 1.7321, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/health/health: 8.70% (0.1840 => 0.2000, std.dev.: 0.0060) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0154) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0107) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: 7.23% (10.6247 => 11.3927, std.dev.: 0.0845) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (6.4680 => 6.9080, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.42% (0.7480 => 0.7960, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.37% (1.4161 => 1.4921, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.26% (1.5201 => 1.6001, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.15% (11.6440 => 12.2440, std.dev.: 0.0709) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (9.4842 => 9.9642, std.dev.: 0.0407) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.97% (0.7240 => 0.7600, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0238) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0168) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.0443 => 10.5043, std.dev.: 0.0436) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.40% (5.8121 => 6.0681, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (6.5440 => 6.8080, std.dev.: 0.0453) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (6.5080 => 6.7600, std.dev.: 0.0284) MultiSource/Applications/JM/lencod/lencod: 3.86% (21.9606 => 22.8088, std.dev.: 0.0519) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (5.3600 => 5.5560, std.dev.: 0.0316) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6601 => 1.7201, std.dev.: 0.0102) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.46% (50.0290 => 51.7610, std.dev.: 0.0770) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (2.3281 => 2.4042, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0189) MultiSource/Benchmarks/Bullet/bullet: 2.99% (38.4046 => 39.5526, std.dev.: 0.0586) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0091) MultiSource/Applications/treecc/treecc: 2.79% (2.5840 => 2.6560, std.dev.: 0.0140) MultiSource/Applications/oggenc/oggenc: 2.75% (6.9844 => 7.1764, std.dev.: 0.0234) MultiSource/Applications/SPASS/SPASS: 2.67% (18.4404 => 18.9326, std.dev.: 0.0692) MultiSource/Applications/ClamAV/clamscan: 2.60% (19.0444 => 19.5404, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (4.1843 => 4.2923, std.dev.: 0.0104) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.3483 => 16.7003, std.dev.: 0.0504) MultiSource/Applications/siod/siod: 1.91% (2.7162 => 2.7682, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 1.71% (19.6891 => 20.0251, std.dev.: 0.0417) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.97% (0.9241 => 1.1641, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.78% (0.3600 => 0.3880, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.41% (3.9842 => 4.0403, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (3.9562 => 4.0003, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.22% (2.9442 => 0.7000, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: -6.21% (1.8680 => 1.7520, std.dev.: 0.0225) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.34% (91.8497 => 49.2911, std.dev.: 9.9863) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.38% (26.0616 => 17.1011, std.dev.: 0.1426) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.12% (50.3031 => 33.1381, std.dev.: 0.1520) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.01% (42.1466 => 28.6538, std.dev.: 0.3802) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1158) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.34% (0.1160 => 0.1040, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/matrix: -4.23% (2.5562 => 2.4482) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0155) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.1563 => 5.0963, std.dev.: 0.0167) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 06:54:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 08:54:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140407135438.1BB662A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24376?compare_to=24367&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24376, Order: 205699, Start Time: 2014-04-07 09:09:39, End Time: 2014-04-07 14:00:59 To: 24367, Order: 205695, Start Time: 2014-04-07 03:56:40, End Time: 2014-04-07 08:48:11 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (122 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (959 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/matrixTranspose: 50.00% (0.0240 => 0.0360, std.dev.: 0.0024) SingleSource/Regression/C/casts: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0560 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.33% (0.1800 => 0.2040, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/moments: 3.60% (0.4440 => 0.4600, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.07% (0.6520 => 0.6720, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.91% (0.6280 => 0.6400, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.78% (6.2924 => 6.4044, std.dev.: 0.0434) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/fibo: -8.62% (0.2320 => 0.2120, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0066) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0033) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C++/EH/function_try_block: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.80% (1.6881 => 2.0561, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.63% (1.7201 => 2.0921, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.51% (1.6921 => 2.0561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.27% (1.7681 => 2.1441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.11% (1.7241 => 2.0881, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.93% (1.7201 => 2.0801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.44% (1.8201 => 2.1921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.29% (1.9081 => 2.2761, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0053) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0071) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.80% (0.6120 => 0.6720, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.51% (0.1880 => 0.2040, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (6.7200 => 7.1240, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (11.7880 => 12.4720, std.dev.: 0.0648) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: 4.88% (10.9087 => 11.4407, std.dev.: 0.1042) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0227) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (2.0440 => 2.1320, std.dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0328) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0225) MultiSource/Applications/d/make_dparser: 4.14% (3.9641 => 4.1281, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (9.9842 => 10.3562, std.dev.: 0.0433) MultiSource/Applications/oggenc/oggenc: 3.47% (6.9124 => 7.1524, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (6.8321 => 7.0641, std.dev.: 0.0371) MultiSource/Applications/JM/ldecod/ldecod: 3.29% (10.3203 => 10.6603, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0185) MultiSource/Applications/SPASS/SPASS: 2.90% (18.4924 => 19.0287, std.dev.: 0.0668) MultiSource/Applications/JM/lencod/lencod: 2.79% (22.6287 => 23.2607, std.dev.: 0.0537) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0090) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.20% (51.1089 => 52.2329, std.dev.: 0.0749) MultiSource/Applications/kimwitu++/kc: 2.19% (19.7371 => 20.1691, std.dev.: 0.0361) MultiSource/Benchmarks/Bullet/bullet: 1.98% (38.9366 => 39.7086, std.dev.: 0.0910) MultiSource/Applications/ClamAV/clamscan: 1.86% (20.2445 => 20.6205, std.dev.: 0.0750) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 1.54% (25.1895 => 25.5776, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (16.5963 => 16.8483, std.dev.: 0.0609) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (2.2721 => 2.3001, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.21% (3.4842 => 3.5962, std.dev.: 0.0426) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0292) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.85% (4.7563 => 4.8443, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 1.64% (21.6534 => 22.0094, std.dev.: 0.0659) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (1.2921 => 1.3121, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.39% (4.0203 => 4.0763, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.88% (6.2884 => 1.3281, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ConditionalExpr: -57.14% (0.0280 => 0.0120, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: -33.24% (2.6481 => 1.7680, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout/matrix: -31.25% (0.1280 => 0.0880, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.01% (7.4801 => 6.2080, std.dev.: 0.0590) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.85% (7.5041 => 6.2400, std.dev.: 0.0517) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -3.08% (13.5243 => 13.1083, std.dev.: 0.0273) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0432) MultiSource/Benchmarks/sim/sim: -1.60% (4.9883 => 4.9083, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -1.10% (11.6527 => 11.5247, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 06:56:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 08:56:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140407135658.3561D2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24377?compare_to=24368&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24377, Order: 205699, Start Time: 2014-04-07 09:10:32, End Time: 2014-04-07 14:03:19 To: 24368, Order: 205695, Start Time: 2014-04-07 03:56:40, End Time: 2014-04-07 08:48:49 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 6 (127 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (953 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 5.33% (0.3000 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.35% (6.8280 => 6.9200, std.dev.: 0.0287) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: 1.02% (1.5761 => 1.5921, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/callargs: -60.00% (0.0200 => 0.0080, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: -41.67% (0.0480 => 0.0280, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.86% (17.6723 => 19.5923, std.dev.: 0.0403) MultiSource/Applications/sqlite3/sqlite3: 1417.18% (1.7001 => 25.7936, std.dev.: 0.0471) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.54% (50.1010 => 51.8730, std.dev.: 0.0724) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.80% (1.0520 => 1.0920, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (11.3920 => 12.3480, std.dev.: 0.0566) SingleSource/Benchmarks/Misc/oourafft: 175.31% (11.3407 => 31.2220, std.dev.: 0.0787) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0323, std.dev.: 0.0194) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7164, std.dev.: 0.0146) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0078) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0018) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.1280 => 0.1560, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.69% (1.8361 => 2.1241, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.01% (1.9721 => 2.2681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.76% (1.9241 => 2.2081, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/08-main/main: 14.63% (0.3280 => 0.3760, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.44% (1.8561 => 2.1241, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.02% (1.9121 => 2.1801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.45% (2.1121 => 2.3961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.25% (2.1441 => 2.4282, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.83% (1.8081 => 2.0401, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.50% (0.4160 => 0.4680, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.19% (1.7721 => 1.9881, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.61% (1.8601 => 2.0761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.8441 => 2.0401, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/ary2: 9.72% (0.2880 => 0.3160, std.dev.: 0.0047) MultiSource/Applications/aha/aha: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.68% (0.3720 => 0.4080, std.dev.: 0.0135) SingleSource/UnitTests/Vector/constpool: 9.42% (10.4007 => 11.3807, std.dev.: 0.0974) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0058) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.20% (0.2440 => 0.2640, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (6.4800 => 6.9200, std.dev.: 0.0287) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 6.02% (1.5280 => 1.6200, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0159) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.17% (0.2320 => 0.2440, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (9.6042 => 10.0202, std.dev.: 0.0438) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0211) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (5.8281 => 6.0641, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (6.5360 => 6.8000, std.dev.: 0.0397) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (6.5320 => 6.7880, std.dev.: 0.0646) MultiSource/Applications/lua/lua: 3.84% (4.7920 => 4.9760, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0080) MultiSource/Applications/hbd/hbd: 3.70% (1.7280 => 1.7920, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/flops: 3.39% (0.4720 => 0.4880, std.dev.: 0.0057) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.38% (1.3000 => 1.3440, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 2.79% (22.2206 => 22.8407, std.dev.: 0.0369) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.3960 => 5.5440, std.dev.: 0.0492) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (16.3003 => 16.7403, std.dev.: 0.0491) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (2.1600 => 2.2160, std.dev.: 0.0210) MultiSource/Benchmarks/Bullet/bullet: 2.45% (38.6366 => 39.5846, std.dev.: 0.0808) MultiSource/Applications/SPASS/SPASS: 2.38% (18.5284 => 18.9685, std.dev.: 0.0523) MultiSource/Applications/oggenc/oggenc: 2.33% (7.0524 => 7.2165, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2243 => 4.3203, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0270) MultiSource/Applications/JM/ldecod/ldecod: 1.84% (10.2283 => 10.4163, std.dev.: 0.0368) MultiSource/Applications/kimwitu++/kc: 1.37% (19.8291 => 20.1011, std.dev.: 0.0572) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.85% (2.1201 => 2.4562, std.dev.: 0.0587) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.73% (2.9562 => 0.6880, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: -6.18% (1.8760 => 1.7600, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.22% (94.8339 => 49.1071, std.dev.: 10.6055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.68% (49.9431 => 33.1221, std.dev.: 0.1193) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.62% (25.7136 => 17.0691, std.dev.: 0.1144) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.53% (37.0863 => 28.7298, std.dev.: 0.4393) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 06:58:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 08:58:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140407135824.40F5B2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24378?compare_to=24369&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24378, Order: 205699, Start Time: 2014-04-07 09:11:40, End Time: 2014-04-07 14:04:44 To: 24369, Order: 205695, Start Time: 2014-04-07 03:56:40, End Time: 2014-04-07 08:50:02 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (146 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.98% (1.4121 => 1.4401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.60% (1.5001 => 1.5241, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 18.75% (0.0640 => 0.0760, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.5080 => 0.5280, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1962.50% (0.0320 => 0.6600, std.dev.: 0.0100) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0101) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0069) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 390.52% (0.2520 => 1.2361, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/nestedloop: 277.63% (0.2320 => 0.8761, std.dev.: 0.0077) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0048) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0057) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-3: 71.43% (0.0280 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0072) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.00% (0.7040 => 1.0560, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0066) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.55% (1.2401 => 1.5321, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: 20.69% (1.3920 => 1.6800, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.33% (1.2001 => 1.4441, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.65% (1.1401 => 1.3641, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.21% (1.2521 => 1.4801, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: 18.00% (8.5802 => 10.1243, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.84% (1.1881 => 1.4001, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.57% (1.2521 => 1.4721, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 15.33% (19.5406 => 22.5367, std.dev.: 0.0445) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.09% (5.3360 => 6.0881, std.dev.: 0.0336) SingleSource/Benchmarks/Shootout/lists: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 13.02% (1.3521 => 1.5281, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (11.3843 => 12.4363, std.dev.: 0.0332) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 8.59% (6.2844 => 6.8244, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.26% (5.6680 => 6.1360, std.dev.: 0.0195) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.10% (11.4440 => 12.2560, std.dev.: 0.0999) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.05% (5.7280 => 6.1320, std.dev.: 0.0551) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.89% (9.5802 => 10.2402, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.82% (0.3320 => 0.3480, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0112) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0088) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0169) MultiSource/Applications/lua/lua: 3.52% (4.7720 => 4.9400, std.dev.: 0.0325) MultiSource/Benchmarks/MallocBench/gs/gs: 3.42% (5.3840 => 5.5680, std.dev.: 0.0328) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (6.8280 => 7.0440, std.dev.: 0.0347) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.08% (49.1529 => 50.6649, std.dev.: 0.0619) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.69% (1.3400 => 1.3760, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 2.62% (19.2243 => 19.7284, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 2.52% (24.7575 => 25.3815, std.dev.: 0.0356) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0141) MultiSource/Applications/treecc/treecc: 2.27% (2.6480 => 2.7080, std.dev.: 0.0204) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 1.66% (19.7491 => 20.0771, std.dev.: 0.0398) MultiSource/Benchmarks/Bullet/bullet: 1.42% (39.0726 => 39.6286, std.dev.: 0.1031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0698) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0173) MultiSource/Benchmarks/llubenchmark/llu: 5.78% (5.1203 => 5.4163, std.dev.: 0.1021) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.24% (0.9881 => 1.0201, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.87% (4.0563 => 4.1323, std.dev.: 0.0273) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0200 => 0.0000, std.dev.: 0.0045) SingleSource/Regression/C/globalrefs: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.52% (3.4722 => 3.1762, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.90% (5.2763 => 4.9123, std.dev.: 0.1012) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -1.76% (4.9963 => 4.9083, std.dev.: 0.0116) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.0963 => 5.0363, std.dev.: 0.0197) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 08:34:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 10:34:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407153437.BADFB2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24379?compare_to=24373&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24379, Order: 205701, Start Time: 2014-04-07 10:55:42, End Time: 2014-04-07 15:40:58 To: 24373, Order: 205699, Start Time: 2014-04-07 07:35:44, End Time: 2014-04-07 12:20:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (102 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/tls: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 16.67% (0.1200 => 0.1400, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.22% (0.2920 => 0.3160, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.2880 => 0.3040, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.45% (3.5842 => 3.6362, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/power/power: 1.22% (1.3161 => 1.3321, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0087) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 4.74% (10.8967 => 11.4127, std.dev.: 0.1026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0446) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0341) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.83% (5.8000 => 5.9640, std.dev.: 0.0593) MultiSource/Applications/JM/lencod/lencod: 2.59% (17.6165 => 18.0725, std.dev.: 0.0572) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0402) MultiSource/Applications/sqlite3/sqlite3: 2.24% (23.7574 => 24.2895, std.dev.: 0.0361) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (2.1201 => 2.1641, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0370) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0432) MultiSource/Benchmarks/MallocBench/gs/gs: 2.03% (4.9200 => 5.0200, std.dev.: 0.0351) MultiSource/Benchmarks/Bullet/bullet: 1.82% (37.0925 => 37.7685, std.dev.: 0.0796) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0102) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.65% (48.1088 => 48.9048, std.dev.: 0.1180) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 1.19% (18.8170 => 19.0410, std.dev.: 0.0398) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0197) MultiSource/Applications/SPASS/SPASS: 1.03% (17.5484 => 17.7284, std.dev.: 0.0407) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0203) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0413) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.94% (3.5322 => 3.6362, std.dev.: 0.0194) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/lists: 2.41% (5.8164 => 5.9564, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/mason/mason: -15.79% (0.0760 => 0.0640, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.68% (7.7485 => 6.6884, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 10:41:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 12:41:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407174152.E46E42A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24380?compare_to=24379&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24380, Order: 205706, Start Time: 2014-04-07 13:03:04, End Time: 2014-04-07 17:48:13 To: 24379, Order: 205701, Start Time: 2014-04-07 10:55:42, End Time: 2014-04-07 15:40:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (107 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 400.00% (0.0040 => 0.0200, std.dev.: 0.0018) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/Regression/C++/global_ctor: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.86% (0.3160 => 0.3440, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.2520 => 0.2720, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 3.57% (0.3360 => 0.3480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.5280 => 1.5760, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.87% (1.2801 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.61% (1.2441 => 1.2641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.49% (1.3441 => 1.3641, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (2.6082 => 2.6362, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.07% (6.3720 => 6.4400, std.dev.: 0.0255) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4322 => 2.4602, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/random: -45.45% (0.0440 => 0.0240, std.dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0038) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/global_ctor: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.15% (1.2201 => 1.3561, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.3200 => 0.3440, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0551) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.2560 => 0.2720, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: 5.54% (10.8967 => 11.5007, std.dev.: 0.0880) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0097) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.39% (1.1880 => 1.2520, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0313) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0178) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0293) MultiSource/Applications/JM/lencod/lencod: 3.29% (17.6165 => 18.1965, std.dev.: 0.0430) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0374) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0437) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0272) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.07% (23.7574 => 24.2495, std.dev.: 0.0421) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.06% (48.1088 => 49.1009, std.dev.: 0.0820) MultiSource/Benchmarks/nbench/nbench: 1.92% (1.2480 => 1.2720, std.dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0506) MultiSource/Benchmarks/Bullet/bullet: 1.86% (37.0925 => 37.7806, std.dev.: 0.0960) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 1.81% (18.8170 => 19.1571, std.dev.: 0.0413) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0157) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0411) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0209) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.33% (0.1800 => 0.2040, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 5.47% (6.6564 => 7.0204, std.dev.: 0.0370) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: -13.33% (0.1200 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.89% (1.2601 => 1.1481, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 10:42:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 12:42:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407174213.9D3A82A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24381?compare_to=24379&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24381, Order: 205705, Start Time: 2014-04-07 13:05:39, End Time: 2014-04-07 17:48:34 To: 24379, Order: 205701, Start Time: 2014-04-07 10:55:42, End Time: 2014-04-07 15:40:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (101 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.78% (0.2360 => 0.2520, std.dev.: 0.0061) MultiSource/Benchmarks/sim/sim: 4.76% (0.3360 => 0.3520, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.98% (0.9400 => 0.9680, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.94% (1.2361 => 1.2601, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.84% (0.3040 => 0.3400, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0592) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 6.06% (0.3960 => 0.4200, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: 5.21% (10.8967 => 11.4647, std.dev.: 0.0812) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0573) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0492) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 3.01% (4.5200 => 4.6560, std.dev.: 0.0419) MultiSource/Applications/JM/lencod/lencod: 2.88% (17.6165 => 18.1245, std.dev.: 0.0563) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0321) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.17% (48.1088 => 49.1529, std.dev.: 0.0684) MultiSource/Benchmarks/Bullet/bullet: 2.11% (37.0925 => 37.8766, std.dev.: 0.0841) MultiSource/Applications/sqlite3/sqlite3: 2.09% (23.7574 => 24.2535, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 1.91% (18.8170 => 19.1771, std.dev.: 0.0524) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0529) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.59% (0.3160 => 0.3400, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 5.17% (6.6564 => 7.0004, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.04% (4.5203 => 4.6123, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.9443 => 5.0003, std.dev.: 0.0186) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 11:06:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 13:06:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407180628.98BEE2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24382?compare_to=24380&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24382, Order: 205708, Start Time: 2014-04-07 13:27:20, End Time: 2014-04-07 18:12:49 To: 24380, Order: 205706, Start Time: 2014-04-07 13:03:04, End Time: 2014-04-07 17:48:13 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (108 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.55% (0.2200 => 0.2520, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.77% (0.2280 => 0.2480, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.99% (1.1040 => 1.1480, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.26% (1.2401 => 1.2681, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 5.21% (0.3840 => 0.4040, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/global_ctor: -71.43% (0.0280 => 0.0080, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.53% (0.2280 => 0.2520, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0711) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: 5.21% (10.8967 => 11.4647, std.dev.: 0.1601) MultiSource/Applications/Burg/burg: 4.38% (1.4600 => 1.5240, std.dev.: 0.0160) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0371) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0184) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0200) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.68% (0.5440 => 0.5640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: 3.41% (0.3520 => 0.3640, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0443) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0378) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0569) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0426) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0246) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0324) MultiSource/Applications/sqlite3/sqlite3: 2.27% (23.7574 => 24.2975, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 2.14% (37.0925 => 37.8845, std.dev.: 0.0755) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1491, std.dev.: 0.0560) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.76% (48.1088 => 48.9570, std.dev.: 0.1513) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0112) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0500) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: 5.23% (6.6564 => 7.0044, std.dev.: 0.0379) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0191) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.13% (21.1533 => 21.3933, std.dev.: 0.0462) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: -20.45% (0.1760 => 0.1400, std.dev.: 0.0134) SingleSource/Benchmarks/Stanford/Puzzle: -13.33% (0.1200 => 0.1040, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0066) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3361 => 2.3081, std.dev.: 0.0105) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 11:16:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 13:16:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407181640.D17282A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24383?compare_to=24380&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24383, Order: 205707, Start Time: 2014-04-07 13:35:40, End Time: 2014-04-07 18:23:01 To: 24380, Order: 205706, Start Time: 2014-04-07 13:03:04, End Time: 2014-04-07 17:48:13 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (100 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0025) SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: 5.06% (0.3160 => 0.3320, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.7160 => 0.7400, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.16% (1.3841 => 1.4001, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.82% (0.7040 => 0.7520, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.2641 => 1.2841, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0137) SingleSource/Benchmarks/Linpack/linpack-pc: 5.06% (0.3160 => 0.3320, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: 4.92% (10.8967 => 11.4327, std.dev.: 0.0892) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.6840 => 0.7160, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0051) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0208) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0336) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.03% (8.1441 => 8.4721, std.dev.: 0.0541) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0528) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0518) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0299) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.20% (1.3760 => 1.4200, std.dev.: 0.0151) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0129) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.08% (48.1088 => 49.1089, std.dev.: 0.0591) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0439) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: 1.71% (37.0925 => 37.7285, std.dev.: 0.1032) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 1.53% (18.8170 => 19.1051, std.dev.: 0.0514) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0138) MultiSource/Applications/SPASS/SPASS: 1.03% (17.5484 => 17.7284, std.dev.: 0.0675) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.2601 => 1.2841, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0240) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 11:42:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 13:42:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407184211.28B2D2A6C045@llvm.org> http://llvm.org/perf/db_default/v4/nts/24384?compare_to=24374&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24384, Order: 205711, Start Time: 2014-04-07 13:59:48, End Time: 2014-04-07 18:48:32 To: 24374, Order: 205699, Start Time: 2014-04-07 09:07:47, End Time: 2014-04-07 13:56:10 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 200.00% (0.0080 => 0.0240, std.dev.: 0.0051) SingleSource/UnitTests/2002-05-02-CastTest: 166.67% (0.0120 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/15-trie/trie: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.50% (0.0960 => 0.1080, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 12.50% (0.0960 => 0.1080, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.42% (7.0400 => 7.1400, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.31% (7.0041 => 7.0961, std.dev.: 0.0331) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 7.81% (0.2560 => 0.2760, std.dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 11:44:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 13:44:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407184420.3A4422A6C045@llvm.org> http://llvm.org/perf/db_default/v4/nts/24385?compare_to=24375&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24385, Order: 205711, Start Time: 2014-04-07 14:01:38, End Time: 2014-04-07 18:50:43 To: 24375, Order: 205699, Start Time: 2014-04-07 09:07:58, End Time: 2014-04-07 13:57:54 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 1 (2 on baseline) Performance Regressions: 11 (137 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: 0.04% (71.2084 => 71.2365, std.dev.: 0.0918) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.00% (0.0800 => 0.0960, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 12.00% (0.1000 => 0.1120, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 11.76% (0.2720 => 0.3040, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.43% (0.1400 => 0.1560, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (1.7800 => 1.8160, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.9401 => 0.9561, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.03% (1.5561 => 1.5721, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sgefa/sgefa: 2.33% (0.5160 => 0.5280, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 173.86% (11.3687 => 31.1339, std.dev.: 0.0960) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0127) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0107) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.18% (0.0680 => 0.0960, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0047) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/whetstone: 11.11% (0.1440 => 0.1600, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.43% (0.3320 => 0.3600, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.83% (1.7361 => 1.8721, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: 7.49% (10.6247 => 11.4207, std.dev.: 0.1315) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.19% (1.1640 => 1.2360, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.08% (11.6440 => 12.3520, std.dev.: 0.0559) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.93% (0.4720 => 0.5000, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (6.4680 => 6.8440, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 4.86% (10.0443 => 10.5323, std.dev.: 0.0362) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.39% (9.4842 => 9.9002, std.dev.: 0.0514) MultiSource/Applications/JM/lencod/lencod: 4.24% (21.9606 => 22.8928, std.dev.: 0.0499) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5440 => 6.8160, std.dev.: 0.0468) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.5480 => 1.6120, std.dev.: 0.0246) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0236) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0090) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.83% (1.4640 => 1.5200, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (6.5080 => 6.7400, std.dev.: 0.0455) MultiSource/Applications/oggenc/oggenc: 3.55% (6.9844 => 7.2325, std.dev.: 0.0154) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.45% (50.0290 => 51.7530, std.dev.: 0.0722) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (5.3600 => 5.5360, std.dev.: 0.0316) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0304) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0230) MultiSource/Applications/SPASS/SPASS: 2.86% (18.4404 => 18.9685, std.dev.: 0.0487) MultiSource/Benchmarks/Bullet/bullet: 2.85% (38.4046 => 39.5006, std.dev.: 0.0722) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (16.3483 => 16.7803, std.dev.: 0.0577) MultiSource/Applications/treecc/treecc: 2.48% (2.5840 => 2.6480, std.dev.: 0.0189) MultiSource/Applications/ClamAV/clamscan: 2.46% (19.0444 => 19.5124, std.dev.: 0.0481) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0146) MultiSource/Applications/siod/siod: 2.06% (2.7162 => 2.7722, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 1.83% (19.6891 => 20.0491, std.dev.: 0.0498) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.09% (2.1401 => 2.4202, std.dev.: 0.0484) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0213) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.11% (3.9842 => 4.0283, std.dev.: 0.0169) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0058) MultiSource/Applications/obsequi/Obsequi: -5.35% (1.8680 => 1.7680, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.27% (91.8497 => 49.3551, std.dev.: 10.5935) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.44% (26.0616 => 17.0851, std.dev.: 0.1075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.27% (50.3031 => 33.0621, std.dev.: 0.1984) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.13% (42.1466 => 29.0258, std.dev.: 0.2701) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.94% (3.1122 => 2.3361, std.dev.: 0.1201) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.76% (0.3400 => 0.3000, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.58% (4.8083 => 4.6363, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -1.34% (4.7883 => 4.7243, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0168) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 11:49:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 13:49:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140407184937.9880D2A6C045@llvm.org> http://llvm.org/perf/db_default/v4/nts/24386?compare_to=24376&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24386, Order: 205711, Start Time: 2014-04-07 14:04:32, End Time: 2014-04-07 18:56:00 To: 24376, Order: 205699, Start Time: 2014-04-07 09:09:39, End Time: 2014-04-07 14:00:59 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 22 (135 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2008-04-20-LoopBug2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C/DuffsDevice: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 83.33% (0.0240 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 46.15% (0.0520 => 0.0760, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0025) MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.57% (0.1400 => 0.1520, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.11% (0.1480 => 0.1600, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 5.77% (0.2080 => 0.2200, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.17% (0.2320 => 0.2440, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.65% (0.3440 => 0.3600, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.4480 => 1.4960, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.52% (0.4760 => 0.4880, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (6.2400 => 6.3480, std.dev.: 0.0391) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 2.48% (1.2921 => 1.3241, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/sieve: 1.02% (2.3601 => 2.3841, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.00% (0.1200 => 0.1080, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0084) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 60.00% (0.0400 => 0.0640, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/dt: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.95% (1.6801 => 2.0321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.84% (1.8041 => 2.1801, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.40% (1.8041 => 2.1721, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.92% (1.9881 => 2.3841, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.86% (1.6721 => 2.0041, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.73% (1.7641 => 2.1121, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.72% (1.7441 => 2.0881, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.85% (1.8881 => 2.2441, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0115) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.61% (1.9761 => 2.3241, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.05% (0.3480 => 0.3760, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0184) MultiSource/Benchmarks/McCat/08-main/main: 6.90% (0.3480 => 0.3720, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.8601 => 0.9121, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (6.7200 => 7.1080, std.dev.: 0.0476) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.67% (11.7880 => 12.4560, std.dev.: 0.0699) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (1.4160 => 1.4960, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.5000 => 0.5280, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.24% (0.9920 => 1.0440, std.dev.: 0.0150) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.4600 => 0.4840, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.17% (0.2320 => 0.2440, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.7800 => 0.8200, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (9.9842 => 10.4362, std.dev.: 0.0467) SingleSource/UnitTests/Vector/constpool: 4.47% (10.9087 => 11.3967, std.dev.: 0.1413) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.27% (0.4680 => 0.4880, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (1.6481 => 1.7161, std.dev.: 0.0130) MultiSource/Applications/d/make_dparser: 4.04% (3.9641 => 4.1241, std.dev.: 0.0203) MultiSource/Applications/treecc/treecc: 3.97% (2.6200 => 2.7240, std.dev.: 0.0245) MultiSource/Applications/oggenc/oggenc: 3.70% (6.9124 => 7.1684, std.dev.: 0.0206) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0066) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0442) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (6.8321 => 7.0721, std.dev.: 0.0434) MultiSource/Applications/JM/ldecod/ldecod: 3.18% (10.3203 => 10.6483, std.dev.: 0.0330) MultiSource/Applications/JM/lencod/lencod: 3.04% (22.6287 => 23.3168, std.dev.: 0.0657) MultiSource/Applications/SPASS/SPASS: 2.83% (18.4924 => 19.0166, std.dev.: 0.0804) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 2.43% (19.7371 => 20.2171, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 2.32% (2.7562 => 2.8202, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.14% (51.1089 => 52.2009, std.dev.: 0.1543) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (16.5963 => 16.9363, std.dev.: 0.0450) MultiSource/Applications/ClamAV/clamscan: 2.00% (20.2445 => 20.6485, std.dev.: 0.0592) MultiSource/Benchmarks/Bullet/bullet: 1.95% (38.9366 => 39.6966, std.dev.: 0.0566) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 1.46% (25.1895 => 25.5576, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0244 => 6.1124, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.58% (0.9281 => 1.1841, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 9.57% (1.2121 => 1.3281, std.dev.: 0.0357) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 2.93% (6.8204 => 7.0204, std.dev.: 0.0533) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.74% (4.1323 => 4.2043, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 1.66% (21.6534 => 22.0134, std.dev.: 0.0632) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.69% (6.2884 => 1.3401, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout/nestedloop: -65.32% (2.9642 => 1.0281, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.23% (1.5881 => 0.5680, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.70% (3.1762 => 1.2481, std.dev.: 0.0127) SingleSource/UnitTests/ms_struct-bitfield-init-1: -57.14% (0.0280 => 0.0120, std.dev.: 0.0056) MultiSource/Applications/obsequi/Obsequi: -32.78% (2.6481 => 1.7800, std.dev.: 0.0209) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.79% (7.4801 => 6.2240, std.dev.: 0.0364) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.41% (7.5041 => 6.3480, std.dev.: 0.0391) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -2.93% (13.5243 => 13.1283, std.dev.: 0.0506) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -2.79% (5.1603 => 5.0163, std.dev.: 0.0249) MultiSource/Applications/JM/lencod/lencod: -1.73% (8.3085 => 8.1645, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.22% (2.6202 => 2.5882, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3401 => 2.3121, std.dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: -1.10% (11.6527 => 11.5247, std.dev.: 0.0133) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.09% (8.8486 => 8.7525, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 11:53:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 13:53:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140407185316.463BD2A6C045@llvm.org> http://llvm.org/perf/db_default/v4/nts/24387?compare_to=24377&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24387, Order: 205711, Start Time: 2014-04-07 14:06:58, End Time: 2014-04-07 18:59:38 To: 24377, Order: 205699, Start Time: 2014-04-07 09:10:32, End Time: 2014-04-07 14:03:19 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 11 (130 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (950 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.50% (0.1600 => 0.1800, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.24% (0.3400 => 0.3680, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.18% (2.0401 => 2.0641, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: 1.00% (2.7882 => 2.8162, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9802 => 4.0203, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.08% (1.7281 => 1.6921, std.dev.: 0.0129) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.66% (17.6723 => 19.5564, std.dev.: 0.0768) MultiSource/Applications/sqlite3/sqlite3: 1418.12% (1.7001 => 25.8096, std.dev.: 0.0231) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.25% (50.1010 => 51.7290, std.dev.: 0.1095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (1.0520 => 1.0680, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (11.3920 => 12.2680, std.dev.: 0.0827) SingleSource/Benchmarks/Misc/oourafft: 175.06% (11.3407 => 31.1939, std.dev.: 0.0638) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0443, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0102) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0093) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 30.56% (0.1440 => 0.1880, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.69% (1.8361 => 2.1241, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.71% (1.8761 => 2.1521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.59% (2.0281 => 2.3241, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.30% (1.9241 => 2.1801, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.93% (1.8441 => 2.0641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.88% (1.9481 => 2.1601, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: 10.11% (10.4007 => 11.4527, std.dev.: 0.1021) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.67% (2.0681 => 2.2681, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0049) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.57% (0.7400 => 0.7960, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4920 => 0.5280, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.43% (6.4800 => 6.8320, std.dev.: 0.0429) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0178) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0078) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (5.8281 => 6.1041, std.dev.: 0.0277) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (6.5320 => 6.8160, std.dev.: 0.0357) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.27% (0.4680 => 0.4880, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0056) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.75% (9.6042 => 9.9642, std.dev.: 0.0542) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (2.1600 => 2.2320, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.30% (6.5360 => 6.7520, std.dev.: 0.0334) MultiSource/Applications/lua/lua: 3.01% (4.7920 => 4.9360, std.dev.: 0.0382) MultiSource/Applications/JM/lencod/lencod: 2.92% (22.2206 => 22.8688, std.dev.: 0.0406) MultiSource/Benchmarks/MallocBench/gs/gs: 2.89% (5.3960 => 5.5520, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 2.67% (7.0524 => 7.2405, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (16.3003 => 16.7243, std.dev.: 0.0487) MultiSource/Applications/SPASS/SPASS: 2.50% (18.5284 => 18.9925, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0165) MultiSource/Benchmarks/Bullet/bullet: 2.30% (38.6366 => 39.5246, std.dev.: 0.0601) MultiSource/Applications/d/make_dparser: 2.21% (3.9761 => 4.0641, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0134) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (10.2283 => 10.4003, std.dev.: 0.0395) MultiSource/Applications/kimwitu++/kc: 1.45% (19.8291 => 20.1171, std.dev.: 0.0467) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.78% (2.1201 => 2.4122, std.dev.: 0.0419) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0362) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.17% (1.6561 => 1.6921, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: 2.12% (6.5964 => 6.7364, std.dev.: 0.0285) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.93% (3.9442 => 4.0203, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.55% (5.4163 => 5.5003, std.dev.: 0.0301) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -77.00% (2.9562 => 0.6800, std.dev.: 0.0156) SingleSource/UnitTests/2002-08-19-CodegenBug: -66.67% (0.0240 => 0.0080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: -6.40% (1.8760 => 1.7560, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.26% (94.8339 => 49.0671, std.dev.: 10.2065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.18% (49.9431 => 32.8701, std.dev.: 0.1884) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.49% (25.7136 => 17.1011, std.dev.: 0.0709) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.70% (3.0722 => 2.3441, std.dev.: 0.1141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.32% (37.0863 => 28.4378, std.dev.: 0.5299) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.83% (2.8442 => 2.7922, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0159) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 11:55:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 13:55:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140407185514.691502A6C045@llvm.org> http://llvm.org/perf/db_default/v4/nts/24388?compare_to=24378&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24388, Order: 205711, Start Time: 2014-04-07 14:08:22, End Time: 2014-04-07 19:01:36 To: 24378, Order: 205699, Start Time: 2014-04-07 09:11:40, End Time: 2014-04-07 14:04:44 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 15 (156 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Regression/C++/EH/class_hierarchy: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Regression/C/bigstack: 23.53% (0.0680 => 0.0840, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/rem: 9.38% (0.1280 => 0.1400, std.dev.: 0.0031) SingleSource/Benchmarks/SmallPT/smallpt: 8.82% (0.1360 => 0.1480, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.88% (0.2040 => 0.2160, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.13% (0.3120 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.05% (1.3641 => 1.3921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.47% (1.3601 => 1.3801, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.46% (1.3681 => 1.3881, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.98% (3.8562 => 4.0483, std.dev.: 0.0536) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.3121 => 1.3321, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0081) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0116) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 390.52% (0.2520 => 1.2361, std.dev.: 0.0165) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0052) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0067) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0060) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0059) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0139) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.55% (1.1321 => 1.3761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: 21.26% (1.3920 => 1.6880, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.18% (1.1521 => 1.3961, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.39% (1.1761 => 1.4041, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 18.98% (8.5802 => 10.2083, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.57% (1.2521 => 1.4721, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.82% (1.2841 => 1.5001, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 15.52% (19.5406 => 22.5727, std.dev.: 0.0499) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.87% (5.3360 => 6.0761, std.dev.: 0.0317) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0119) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/oourafft: 9.33% (0.3000 => 0.3280, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 8.85% (11.3843 => 12.3923, std.dev.: 0.0434) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0148) SingleSource/Benchmarks/SmallPT/smallpt: 8.82% (0.1360 => 0.1480, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 8.78% (6.2844 => 6.8364, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/health/health: 8.51% (0.1880 => 0.2040, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.6680 => 6.1480, std.dev.: 0.0319) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.7280 => 6.1960, std.dev.: 0.0419) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.00% (11.4440 => 12.3600, std.dev.: 0.0442) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.68% (9.5802 => 10.2202, std.dev.: 0.0392) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.98% (0.7360 => 0.7800, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0112) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0503) SingleSource/UnitTests/Vector/constpool: 3.96% (11.0207 => 11.4567, std.dev.: 0.0907) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.4120 => 0.4280, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 3.79% (5.3840 => 5.5880, std.dev.: 0.0478) MultiSource/Applications/lua/lua: 3.69% (4.7720 => 4.9480, std.dev.: 0.0316) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.6961 => 1.7561, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0090) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.17% (49.1529 => 50.7129, std.dev.: 0.0705) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (2.0920 => 2.1520, std.dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.2243 => 19.7124, std.dev.: 0.0858) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 2.47% (24.7575 => 25.3695, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0089) MultiSource/Benchmarks/Bullet/bullet: 1.37% (39.0726 => 39.6086, std.dev.: 0.0592) MultiSource/Applications/kimwitu++/kc: 1.28% (19.7491 => 20.0011, std.dev.: 0.0612) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.74% (1.2401 => 1.4601, std.dev.: 0.0417) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.12% (1.6521 => 1.7201, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.24% (0.9881 => 1.0201, std.dev.: 0.0104) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0471) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -9.33% (3.4722 => 3.1482, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0320) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.84% (4.9963 => 4.9043, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.0963 => 5.0323, std.dev.: 0.0221) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 13:26:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 15:26:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407202615.45A452A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24389?compare_to=24382&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24389, Order: 205715, Start Time: 2014-04-07 15:47:45, End Time: 2014-04-07 20:32:35 To: 24382, Order: 205708, Start Time: 2014-04-07 13:27:20, End Time: 2014-04-07 18:12:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (96 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (1000 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/class_hierarchy: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/misr: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.00% (0.1000 => 0.1120, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.11% (0.1080 => 0.1200, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 19.35% (0.1240 => 0.1480, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 29.63% (0.1080 => 0.1400, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0481) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0197) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0428) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: 4.81% (10.8967 => 11.4207, std.dev.: 0.0987) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0421) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0208) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0279) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0249) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.90% (5.8000 => 5.9680, std.dev.: 0.0468) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0323) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0225) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0364) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.71% (48.1088 => 48.9328, std.dev.: 0.0852) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0156) MultiSource/Benchmarks/Bullet/bullet: 1.69% (37.0925 => 37.7205, std.dev.: 0.0600) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0127) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0187) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0211) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0457) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0233) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0340) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0344) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/health/health: -6.86% (0.4080 => 0.3800, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: -2.15% (0.7440 => 0.7280, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 15:34:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 17:34:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407223441.1522C2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24390?compare_to=24389&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24390, Order: 205726, Start Time: 2014-04-07 17:55:20, End Time: 2014-04-07 22:41:02 To: 24389, Order: 205715, Start Time: 2014-04-07 15:47:45, End Time: 2014-04-07 20:32:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (107 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0022) SingleSource/UnitTests/2002-05-02-CastTest: 133.33% (0.0120 => 0.0280, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.14% (0.2240 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.02% (1.7240 => 1.7760, std.dev.: 0.0136) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.99% (0.5360 => 0.5520, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.4560 => 0.4680, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 1.86% (2.5762 => 2.6242, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.53% (0.3040 => 0.3360, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/health/health: 5.26% (0.3800 => 0.4000, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.14% (0.2240 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0626) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0452) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0127) SingleSource/UnitTests/Vector/constpool: 5.29% (10.8967 => 11.4727, std.dev.: 0.0817) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0219) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0160) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0500) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0388) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0305) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0401) MultiSource/Applications/JM/lencod/lencod: 3.36% (17.6165 => 18.2085, std.dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0333) MultiSource/Benchmarks/Bullet/bullet: 2.26% (37.0925 => 37.9326, std.dev.: 0.0772) MultiSource/Applications/sqlite3/sqlite3: 2.24% (23.7574 => 24.2895, std.dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0054) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0249, std.dev.: 0.0707) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0140) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0360) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0368) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0067) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (0.6000 => 0.6160, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.69% (4.5043 => 4.5803, std.dev.: 0.0244) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.10% (21.1533 => 21.3853, std.dev.: 0.0459) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.08% (4.0643 => 4.1083, std.dev.: 0.0154) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0520) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 16:03:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 18:03:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407230323.18E1F2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24391?compare_to=24390&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24391, Order: 205727, Start Time: 2014-04-07 18:24:18, End Time: 2014-04-07 23:09:44 To: 24390, Order: 205726, Start Time: 2014-04-07 17:55:20, End Time: 2014-04-07 22:41:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (107 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/global_ctor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C/bigstack: 57.14% (0.0280 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/IntMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.14% (0.1680 => 0.1800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.49% (1.3441 => 1.3641, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.21% (1.3241 => 1.3401, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.18% (1.3521 => 1.3681, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.08% (0.1560 => 0.1920, std.dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 14.29% (0.1120 => 0.1280, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.12% (1.2361 => 1.3241, std.dev.: 0.0270) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.30% (3.9082 => 4.0763, std.dev.: 0.0278) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.27% (1.0561 => 1.0801, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/bh/bh: 7.06% (0.3400 => 0.3640, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0507) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (10.6960 => 11.3640, std.dev.: 0.0802) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: 4.99% (10.8967 => 11.4407, std.dev.: 0.1255) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0413) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0394) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0206) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.49% (1.3760 => 1.4240, std.dev.: 0.0185) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0702) MultiSource/Applications/lua/lua: 3.01% (4.5200 => 4.6560, std.dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0362) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0327) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0287) MultiSource/Benchmarks/Bullet/bullet: 2.32% (37.0925 => 37.9525, std.dev.: 0.0751) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.95% (48.1088 => 49.0449, std.dev.: 0.0972) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.70% (23.7574 => 24.1615, std.dev.: 0.0637) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0158) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0140) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0449) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0565) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0342) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0075) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.41% (1.6601 => 1.7001, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0325) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0501) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -28.57% (0.0560 => 0.0400, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.48% (1.3481 => 1.3281, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 16:12:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 18:12:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140407231206.E86FD2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24392?compare_to=24391&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24392, Order: 205728, Start Time: 2014-04-07 18:30:23, End Time: 2014-04-07 23:18:26 To: 24391, Order: 205727, Start Time: 2014-04-07 18:24:18, End Time: 2014-04-07 23:09:44 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (101 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.73% (1.1560 => 1.1760, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.41% (1.7001 => 1.7241, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.5442 => 3.4962, std.dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary3: 9.86% (0.2840 => 0.3120, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0499) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.29% (1.2721 => 1.3521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0327) SingleSource/UnitTests/Vector/constpool: 4.22% (10.8967 => 11.3567, std.dev.: 0.1321) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0192) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0343) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0269) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0295) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0389) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0470) MultiSource/Benchmarks/Bullet/bullet: 2.37% (37.0925 => 37.9726, std.dev.: 0.0573) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 2.09% (23.7574 => 24.2535, std.dev.: 0.0278) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.84% (48.1088 => 48.9929, std.dev.: 0.0844) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0171) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0461) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0119) MultiSource/Applications/siod/siod: 1.24% (2.5721 => 2.6041, std.dev.: 0.0121) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0335) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0385) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (3.4842 => 3.5562, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -1.58% (3.5522 => 3.4962, std.dev.: 0.0132) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 16:37:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 18:37:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407233753.8F73E2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24393?compare_to=24384&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24393, Order: 205728, Start Time: 2014-04-07 18:55:26, End Time: 2014-04-07 23:44:14 To: 24384, Order: 205711, Start Time: 2014-04-07 13:59:48, End Time: 2014-04-07 18:48:32 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/five11/five11: 30.77% (0.0520 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3080 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.52% (0.7960 => 0.8320, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.64% (1.7121 => 1.7401, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.43% (1.6801 => 1.7041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.40% (1.7121 => 1.7361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.12% (1.7881 => 1.8081, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 16:40:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 18:40:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140407234032.5A4EB2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24394?compare_to=24385&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24394, Order: 205728, Start Time: 2014-04-07 18:57:16, End Time: 2014-04-07 23:46:53 To: 24385, Order: 205711, Start Time: 2014-04-07 14:01:38, End Time: 2014-04-07 18:50:43 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (143 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C/sumarraymalloc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-6: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.69% (0.1160 => 0.1400, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 19.05% (0.0840 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.47% (0.2360 => 0.2560, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.89% (1.0640 => 1.1160, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.69% (0.2560 => 0.2680, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 4.23% (0.2840 => 0.2960, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.49% (1.6081 => 1.6321, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.33% (9.9002 => 10.0322, std.dev.: 0.0358) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0085) MultiSource/Benchmarks/BitBench/five11/five11: 1.56% (2.3041 => 2.3401, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.49% (11.3687 => 31.2060, std.dev.: 0.0730) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0106) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0052) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0070) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.69% (0.1160 => 0.1400, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 20.00% (0.1200 => 0.1440, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.36% (1.0240 => 1.2120, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.65% (0.2040 => 0.2400, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.56% (0.1800 => 0.2080, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0139) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.89% (0.3640 => 0.4000, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.74% (1.5601 => 1.7121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.44% (1.6521 => 1.8081, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (1.0240 => 1.1160, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0130) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 7.25% (0.2760 => 0.2960, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0125) SingleSource/UnitTests/Vector/constpool: 7.12% (10.6247 => 11.3807, std.dev.: 0.0754) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.08% (11.6440 => 12.3520, std.dev.: 0.0675) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (6.4680 => 6.8520, std.dev.: 0.0443) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (9.4842 => 10.0322, std.dev.: 0.0358) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.64% (1.5600 => 1.6480, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.45% (1.5401 => 1.6241, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0191) MultiSource/Applications/JM/ldecod/ldecod: 5.30% (10.0443 => 10.5764, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (2.0440 => 2.1520, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.92% (0.2440 => 0.2560, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (5.8121 => 6.0841, std.dev.: 0.0376) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.40% (6.5440 => 6.8320, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 4.19% (21.9606 => 22.8808, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0159) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0149) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.76% (50.0290 => 51.9090, std.dev.: 0.0957) MultiSource/Benchmarks/Bullet/bullet: 3.72% (38.4046 => 39.8326, std.dev.: 0.0544) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.8440 => 1.9120, std.dev.: 0.0261) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.39% (0.4720 => 0.4880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0187) MultiSource/Applications/SPASS/SPASS: 3.38% (18.4404 => 19.0645, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (3.0282 => 3.1282, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.26% (6.5080 => 6.7200, std.dev.: 0.0436) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 3.10% (2.5840 => 2.6640, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (5.3600 => 5.5080, std.dev.: 0.0484) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (16.3483 => 16.7883, std.dev.: 0.0515) MultiSource/Applications/lua/lua: 2.51% (4.7880 => 4.9080, std.dev.: 0.0456) MultiSource/Applications/siod/siod: 2.50% (2.7162 => 2.7842, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: 2.35% (19.0444 => 19.4924, std.dev.: 0.0513) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0229) MultiSource/Applications/kimwitu++/kc: 2.17% (19.6891 => 20.1171, std.dev.: 0.0520) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.44% (6.1044 => 6.1924, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0295) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0359) MultiSource/Applications/obsequi/Obsequi: 2.53% (2.0521 => 2.1041, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0075) MultiSource/Applications/minisat/minisat: 1.38% (6.6684 => 6.7604, std.dev.: 0.0356) MultiSource/Applications/sqlite3/sqlite3: 1.11% (3.9842 => 4.0283, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: -5.14% (1.8680 => 1.7720, std.dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.06% (91.8497 => 49.5431, std.dev.: 10.3577) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.51% (50.3031 => 32.9421, std.dev.: 0.1713) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.00% (26.0616 => 17.2011, std.dev.: 0.0678) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.19% (42.1466 => 28.5778, std.dev.: 0.4182) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1085) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.66% (4.8083 => 4.6323, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0144) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.17% (2.7442 => 2.7122, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.09% (4.0283 => 3.9842, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0165) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 16:47:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 18:47:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140407234746.0E31C2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24395?compare_to=24386&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24395, Order: 205728, Start Time: 2014-04-07 19:02:45, End Time: 2014-04-07 23:54:06 To: 24386, Order: 205711, Start Time: 2014-04-07 14:04:32, End Time: 2014-04-07 18:56:00 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (145 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.7520 => 0.7880, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.56% (0.7800 => 0.8000, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (0.9121 => 0.9321, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -7.50% (0.1600 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.48% (1.4960 => 1.4440, std.dev.: 0.0198) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0072) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0030) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C++/EH/function_try_block: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.40% (1.6961 => 2.0761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.28% (1.6921 => 2.0521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.28% (1.6921 => 2.0521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.13% (1.8081 => 2.1721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.76% (1.7481 => 2.0761, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.18% (1.9801 => 2.3401, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.16% (1.8281 => 2.1601, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0061) MultiSource/Applications/viterbi/viterbi: 13.21% (0.2120 => 0.2400, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.86% (0.2360 => 0.2640, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 10.00% (0.2000 => 0.2200, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 8.63% (1.0200 => 1.1080, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (6.7200 => 7.1480, std.dev.: 0.0340) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.82% (0.7560 => 0.8000, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.67% (11.7880 => 12.4560, std.dev.: 0.0625) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.35% (0.7480 => 0.7880, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0124) SingleSource/UnitTests/Vector/constpool: 4.69% (10.9087 => 11.4207, std.dev.: 0.1919) MultiSource/Applications/lua/lua: 4.51% (4.7920 => 5.0080, std.dev.: 0.0332) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.10% (0.7800 => 0.8120, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (2.0680 => 2.1520, std.dev.: 0.0251) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (9.9842 => 10.3842, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout-C++/ary3: 4.00% (0.3000 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0064) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.86% (1.3480 => 1.4000, std.dev.: 0.0183) MultiSource/Applications/oggenc/oggenc: 3.65% (6.9124 => 7.1644, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.1440 => 1.1840, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.16% (6.8321 => 7.0481, std.dev.: 0.0495) MultiSource/Applications/SPASS/SPASS: 3.12% (18.4924 => 19.0685, std.dev.: 0.0708) MultiSource/Applications/JM/lencod/lencod: 3.08% (22.6287 => 23.3247, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (10.3203 => 10.5843, std.dev.: 0.0420) MultiSource/Applications/ClamAV/clamscan: 2.43% (20.2445 => 20.7365, std.dev.: 0.0496) MultiSource/Benchmarks/Bullet/bullet: 2.42% (38.9366 => 39.8806, std.dev.: 0.0619) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 2.35% (19.7371 => 20.2011, std.dev.: 0.0230) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (51.1089 => 52.3049, std.dev.: 0.1176) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (5.5480 => 5.6720, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (16.5963 => 16.9083, std.dev.: 0.0462) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0186) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0212) MultiSource/Applications/sqlite3/sqlite3: 1.25% (25.1895 => 25.5055, std.dev.: 0.0565) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (2.2721 => 2.3001, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.87% (1.2121 => 1.3681, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0088) MultiSource/Applications/minisat/minisat: 2.93% (6.8204 => 7.0204, std.dev.: 0.0602) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 1.48% (21.6534 => 21.9734, std.dev.: 0.0852) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.75% (1.5881 => 0.5440, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.83% (3.1762 => 1.2441, std.dev.: 0.0099) MultiSource/Applications/obsequi/Obsequi: -32.18% (2.6481 => 1.7960, std.dev.: 0.0153) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.74% (7.4801 => 6.2280, std.dev.: 0.0395) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.99% (7.5041 => 6.3040, std.dev.: 0.0507) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0093) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -2.99% (13.5243 => 13.1203, std.dev.: 0.0237) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0054) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (0.9281 => 0.8561, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 16:52:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 18:52:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140407235244.ED0E12A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24396?compare_to=24387&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24396, Order: 205728, Start Time: 2014-04-07 19:06:23, End Time: 2014-04-07 23:59:06 To: 24387, Order: 205711, Start Time: 2014-04-07 14:06:58, End Time: 2014-04-07 18:59:38 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 8 (135 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/pi: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.29% (0.1120 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (1.0680 => 1.1240, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/05-eks/eks: 3.30% (0.7280 => 0.7520, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.7600 => 0.7840, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.02% (17.6723 => 19.6203, std.dev.: 0.0669) MultiSource/Applications/sqlite3/sqlite3: 1419.53% (1.7001 => 25.8336, std.dev.: 0.0228) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.55% (50.1010 => 51.8810, std.dev.: 0.0897) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (1.0520 => 1.1240, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.29% (11.3920 => 12.3360, std.dev.: 0.0473) SingleSource/Benchmarks/Misc/oourafft: 175.49% (11.3407 => 31.2420, std.dev.: 0.0762) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0403, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 321.32% (0.4320 => 1.8201, std.dev.: 0.0086) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0051) SingleSource/UnitTests/2002-05-02-ManyArguments: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.90% (1.9601 => 2.2521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.59% (2.0281 => 2.3241, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.58% (0.1920 => 0.2200, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.07% (1.8201 => 2.0761, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.01% (1.8561 => 2.1161, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.98% (1.8601 => 2.1201, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.11% (2.1361 => 2.4162, std.dev.: 0.0179) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.00% (1.9001 => 2.1281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/05-eks/eks: 10.59% (0.6800 => 0.7520, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.42% (1.9201 => 2.1201, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.06% (2.0681 => 2.2761, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: 9.61% (10.4007 => 11.4007, std.dev.: 0.1313) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.24% (0.3400 => 0.3680, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.69% (0.7280 => 0.7840, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 6.30% (1.0160 => 1.0800, std.dev.: 0.0219) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (6.4800 => 6.8800, std.dev.: 0.0552) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.93% (2.9721 => 3.1482, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (5.8281 => 6.0921, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 4.31% (0.4640 => 0.4840, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0161) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (9.6042 => 10.0082, std.dev.: 0.0291) MultiSource/Applications/Burg/burg: 3.93% (1.5280 => 1.5880, std.dev.: 0.0228) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (6.5320 => 6.7880, std.dev.: 0.0615) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.7480 => 1.8160, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0204) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0082) MultiSource/Applications/treecc/treecc: 3.25% (2.5880 => 2.6720, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0234) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3960 => 5.5680, std.dev.: 0.0282) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.08% (1.3000 => 1.3400, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0371) MultiSource/Applications/JM/lencod/lencod: 2.88% (22.2206 => 22.8608, std.dev.: 0.0521) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0177) MultiSource/Applications/lua/lua: 2.75% (4.7920 => 4.9240, std.dev.: 0.0421) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 2.70% (38.6366 => 39.6806, std.dev.: 0.0960) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (16.3003 => 16.7403, std.dev.: 0.0526) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2243 => 4.3203, std.dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 2.27% (18.5284 => 18.9485, std.dev.: 0.0505) MultiSource/Applications/d/make_dparser: 2.21% (3.9761 => 4.0641, std.dev.: 0.0186) MultiSource/Applications/JM/ldecod/ldecod: 1.80% (10.2283 => 10.4123, std.dev.: 0.0455) MultiSource/Applications/kimwitu++/kc: 1.55% (19.8291 => 20.1371, std.dev.: 0.0378) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7842 => 2.8242, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 1.31% (2.7522 => 2.7882, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.17% (1.0241 => 1.0361, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.72% (2.1201 => 2.4322, std.dev.: 0.0604) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.14% (1.6561 => 1.7081, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: 2.54% (2.0441 => 2.0961, std.dev.: 0.0181) MultiSource/Applications/minisat/minisat: 2.24% (6.5964 => 6.7444, std.dev.: 0.0217) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (4.0003 => 4.0683, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9684 => 6.0644, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.46% (2.9562 => 0.6960, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: -5.33% (1.8760 => 1.7760, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.16% (94.8339 => 49.1631, std.dev.: 10.0579) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.82% (49.9431 => 33.0501, std.dev.: 0.1885) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.65% (25.7136 => 17.0611, std.dev.: 0.1129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.99% (37.0863 => 28.1898, std.dev.: 0.7384) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1100) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3521 => 2.3041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0225) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 16:55:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 18:55:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140407235557.A20622A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24397?compare_to=24388&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24397, Order: 205728, Start Time: 2014-04-07 19:08:51, End Time: 2014-04-08 00:02:18 To: 24388, Order: 205711, Start Time: 2014-04-07 14:08:22, End Time: 2014-04-07 19:01:36 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (159 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ConditionalExpr: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 4.11% (0.2920 => 0.3040, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.50% (0.6400 => 0.6560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.99% (1.4041 => 1.4321, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.33% (4.4683 => 4.5723, std.dev.: 0.0237) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1950.00% (0.0320 => 0.6560, std.dev.: 0.0090) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0084) SingleSource/Regression/C/sumarray2d: 1033.33% (0.0360 => 0.4080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 763.16% (0.0760 => 0.6560, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 392.10% (0.2520 => 1.2401, std.dev.: 0.0144) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 277.63% (0.2320 => 0.8761, std.dev.: 0.0082) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0058) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0095) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0054) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0093) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0048) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 49.43% (0.7040 => 1.0520, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.13% (1.2401 => 1.5641, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.00% (1.2321 => 1.5401, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.45% (1.1401 => 1.3961, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: 21.84% (1.3920 => 1.6960, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.77% (1.1761 => 1.4321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.94% (1.2881 => 1.5321, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 18.84% (8.5802 => 10.1963, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.27% (1.1601 => 1.3721, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.05% (1.1521 => 1.3601, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.86% (1.2321 => 1.4521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 15.58% (19.5406 => 22.5847, std.dev.: 0.0533) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (5.3360 => 6.0961, std.dev.: 0.0282) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0151) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 9.45% (11.3843 => 12.4603, std.dev.: 0.0271) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.01% (0.4440 => 0.4840, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0181) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.96% (5.7280 => 6.1840, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.55% (5.6680 => 6.0960, std.dev.: 0.0512) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.27% (11.4440 => 12.2760, std.dev.: 0.0541) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.47% (9.5802 => 10.2002, std.dev.: 0.0551) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0245) MultiSource/Applications/spiff/spiff: 5.34% (1.0480 => 1.1040, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (1.6240 => 1.6920, std.dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.13% (0.8721 => 0.9081, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.94% (4.7720 => 4.9600, std.dev.: 0.0380) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (6.8280 => 7.0640, std.dev.: 0.0429) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0418) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: 3.19% (11.0207 => 11.3727, std.dev.: 0.1037) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.14% (49.1529 => 50.6969, std.dev.: 0.0563) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 2.85% (19.2243 => 19.7724, std.dev.: 0.0414) MultiSource/Applications/sqlite3/sqlite3: 2.52% (24.7575 => 25.3815, std.dev.: 0.0425) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: 1.92% (39.0726 => 39.8246, std.dev.: 0.0637) MultiSource/Applications/kimwitu++/kc: 1.56% (19.7491 => 20.0571, std.dev.: 0.0600) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0124 => 6.0884, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (16.7083 => 16.8843, std.dev.: 0.0343) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (29.3298 => 29.6259, std.dev.: 0.0428) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 18.18% (0.9241 => 1.0921, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0092) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -9.33% (3.4722 => 3.1482, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0624) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0310) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.85% (4.7643 => 4.6763, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.84% (4.1243 => 4.0483, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0173) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3401 => 2.3121, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 17:20:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 19:20:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408002055.B6AD32A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24398?compare_to=24392&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24398, Order: 205729, Start Time: 2014-04-07 19:44:32, End Time: 2014-04-08 00:27:15 To: 24392, Order: 205728, Start Time: 2014-04-07 18:30:23, End Time: 2014-04-07 23:18:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (95 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 11.54% (0.1040 => 0.1160, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.99% (0.7440 => 0.7960, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 2.44% (0.4920 => 0.5040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.12% (1.3201 => 1.3481, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.07% (1.3521 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (2.0160 => 2.0520, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.21% (1.3241 => 1.3401, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 4.96% (0.9681 => 1.0161, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/ary3: 1.14% (3.4962 => 3.5362, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0187) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0529) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (10.6960 => 11.3200, std.dev.: 0.0751) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: 5.51% (10.8967 => 11.4967, std.dev.: 0.1366) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0330) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (5.8000 => 6.0640, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0122) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (10.4082 => 10.8162, std.dev.: 0.0291) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 3.16% (17.6165 => 18.1725, std.dev.: 0.0527) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0416) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0350) MultiSource/Benchmarks/Bullet/bullet: 2.63% (37.0925 => 38.0686, std.dev.: 0.0813) SingleSource/Benchmarks/Shootout-C++/hash2: 2.44% (0.4920 => 0.5040, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 2.07% (23.7574 => 24.2495, std.dev.: 0.0586) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.00% (48.1088 => 49.0690, std.dev.: 0.0694) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0136) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 1.49% (18.8170 => 19.0970, std.dev.: 0.0556) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0396) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0223) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0373) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0088) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.00% (21.1533 => 21.3653, std.dev.: 0.0717) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0030) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: -20.45% (0.1760 => 0.1400, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -16.67% (0.1200 => 0.1000, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 18:15:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Apr 2014 20:15:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408011558.A6D152A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24399?compare_to=24398&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24399, Order: 205733, Start Time: 2014-04-07 20:37:04, End Time: 2014-04-08 01:22:19 To: 24398, Order: 205729, Start Time: 2014-04-07 19:44:32, End Time: 2014-04-08 00:27:15 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (98 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/build2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 27.78% (0.0720 => 0.0920, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.2880 => 0.3040, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 4.11% (0.2920 => 0.3040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.92% (1.2481 => 1.2721, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.17% (1.3681 => 1.3841, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0056) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0064) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.19% (1.1441 => 1.2721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0660) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0783) SingleSource/UnitTests/Vector/constpool: 4.07% (10.8967 => 11.3407, std.dev.: 0.1490) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0305) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (10.4082 => 10.8162, std.dev.: 0.0299) MultiSource/Applications/JM/lencod/lencod: 3.47% (17.6165 => 18.2285, std.dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0549) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0432) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0342) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0492) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0410) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9086, std.dev.: 0.0938) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.16% (48.1088 => 49.1490, std.dev.: 0.0971) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0221) MultiSource/Applications/kimwitu++/kc: 1.72% (18.8170 => 19.1411, std.dev.: 0.0359) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0534) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.89% (0.9321 => 1.1921, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0311) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0298) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.18% (0.1760 => 0.1440, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 23:43:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 01:43:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408064312.BB0A12A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24400?compare_to=24399&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24400, Order: 205751, Start Time: 2014-04-08 02:04:25, End Time: 2014-04-08 06:49:30 To: 24399, Order: 205733, Start Time: 2014-04-07 20:37:04, End Time: 2014-04-08 01:22:19 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (94 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/Threads/tls: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-6: 57.14% (0.0280 => 0.0440, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Towers: 30.00% (0.0400 => 0.0520, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.17% (0.2360 => 0.2600, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.38% (0.1280 => 0.1400, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.09% (0.2640 => 0.2880, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3080 => 0.3320, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists1: 7.14% (0.3360 => 0.3600, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2400 => 0.2520, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (7.9882 => 8.0802, std.dev.: 0.0283) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.59% (0.2920 => 0.3200, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.03% (0.9841 => 1.0041, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -8.08% (11.3407 => 10.4247, std.dev.: 0.0998) MultiSource/Applications/siod/siod: -1.37% (2.6321 => 2.5961, std.dev.: 0.0128) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0102) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.61% (1.2081 => 1.3121, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0629) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0307) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0360) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0133) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0321) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0397) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0203) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0522) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0211) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (7.8562 => 8.0802, std.dev.: 0.0283) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0657) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0527) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 2.05% (23.7574 => 24.2455, std.dev.: 0.0736) MultiSource/Benchmarks/Bullet/bullet: 1.89% (37.0925 => 37.7926, std.dev.: 0.0900) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.86% (48.1088 => 49.0049, std.dev.: 0.0740) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0148) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1130, std.dev.: 0.0343) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0194) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 17.39% (0.0920 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0420) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.58% (0.9601 => 1.0041, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0067) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.9443 => 5.0003, std.dev.: 0.0165) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -4.33% (10.8967 => 10.4247, std.dev.: 0.0998) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/health/health: -9.80% (0.4080 => 0.3680, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0163) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (1.3481 => 1.3321, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 23:46:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 01:46:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140408064657.909B52A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24401?compare_to=24393&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24401, Order: 205751, Start Time: 2014-04-08 02:04:25, End Time: 2014-04-08 06:53:20 To: 24393, Order: 205728, Start Time: 2014-04-07 18:55:26, End Time: 2014-04-07 23:44:14 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 25.00% (0.1280 => 0.1600, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/tsp/tsp: 14.29% (0.1400 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.64% (0.1880 => 0.2080, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.33% (0.1440 => 0.1560, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.17% (0.2320 => 0.2440, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 2.04% (0.5880 => 0.6000, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.91% (0.6280 => 0.6400, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.51% (1.8601 => 1.8881, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.35% (1.7841 => 1.8081, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.14% (2.1081 => 2.1321, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -8.99% (11.4287 => 10.4007, std.dev.: 0.1514) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -21.43% (0.0560 => 0.0440, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.73% (0.7280 => 0.5480, std.dev.: 0.0123) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 23:47:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 01:47:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140408064707.A145B2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24402?compare_to=24394&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24402, Order: 205751, Start Time: 2014-04-08 02:04:25, End Time: 2014-04-08 06:53:28 To: 24394, Order: 205728, Start Time: 2014-04-07 18:57:16, End Time: 2014-04-07 23:46:53 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 6 (138 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 33.33% (0.0360 => 0.0480, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 11.11% (0.1800 => 0.2000, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2640 => 0.2880, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: 5.26% (0.3040 => 0.3200, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -9.56% (11.3807 => 10.2926, std.dev.: 0.1532) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.10% (11.3687 => 31.1619, std.dev.: 0.0948) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0050) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0030) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 33.33% (0.0360 => 0.0480, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.00% (0.0960 => 0.1200, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0193) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 13.46% (0.2080 => 0.2360, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0038) SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (1.0240 => 1.1160, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.89% (1.4841 => 1.6161, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0180) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.19% (1.6121 => 1.7441, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (1.1640 => 1.2560, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0110) SingleSource/Regression/C/bigstack: 6.52% (0.1840 => 0.1960, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (11.6440 => 12.3880, std.dev.: 0.0458) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0179) MultiSource/Applications/Burg/burg: 6.10% (1.5080 => 1.6000, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (6.4680 => 6.8520, std.dev.: 0.0513) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.48% (9.4842 => 10.0042, std.dev.: 0.0379) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0217) MultiSource/Applications/JM/ldecod/ldecod: 5.42% (10.0443 => 10.5883, std.dev.: 0.0239) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (1.7921 => 1.8841, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (5.8121 => 6.1081, std.dev.: 0.0417) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (2.0440 => 2.1480, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 4.34% (21.9606 => 22.9128, std.dev.: 0.0562) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 3.95% (6.9844 => 7.2605, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (6.5080 => 6.7640, std.dev.: 0.0432) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (6.5440 => 6.8000, std.dev.: 0.0483) SingleSource/Benchmarks/Shootout-C++/lists: 3.90% (0.3080 => 0.3200, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0066) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.79% (50.0290 => 51.9250, std.dev.: 0.0704) MultiSource/Applications/lua/lua: 3.51% (4.7880 => 4.9560, std.dev.: 0.0282) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (5.3600 => 5.5480, std.dev.: 0.0339) MultiSource/Benchmarks/Bullet/bullet: 3.39% (38.4046 => 39.7046, std.dev.: 0.0605) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (2.3281 => 2.4042, std.dev.: 0.0134) MultiSource/Applications/hbd/hbd: 3.23% (1.7360 => 1.7920, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0161) MultiSource/Applications/SPASS/SPASS: 2.95% (18.4404 => 18.9846, std.dev.: 0.0640) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 2.63% (19.0444 => 19.5444, std.dev.: 0.0608) MultiSource/Applications/d/make_dparser: 2.52% (3.9681 => 4.0681, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/flops: 2.50% (0.4800 => 0.4920, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (16.3483 => 16.7563, std.dev.: 0.0423) MultiSource/Applications/kimwitu++/kc: 2.21% (19.6891 => 20.1251, std.dev.: 0.0496) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7922 => 2.8282, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (13.0563 => 13.2083, std.dev.: 0.0323) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.96% (2.1401 => 2.4602, std.dev.: 0.0461) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 5.17% (2.8602 => 3.0082, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.21% (3.9842 => 4.0323, std.dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.36% (2.9442 => 0.6960, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0065) MultiSource/Applications/obsequi/Obsequi: -5.35% (1.8680 => 1.7680, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.47% (91.8497 => 49.1631, std.dev.: 10.3804) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.80% (26.0616 => 16.9931, std.dev.: 0.1891) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.42% (50.3031 => 32.9901, std.dev.: 0.2022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.58% (42.1466 => 28.8378, std.dev.: 0.2647) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1424) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.21% (7.7845 => 6.7564, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.34% (0.1160 => 0.1040, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: -1.09% (4.7883 => 4.7363, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.1563 => 5.1043, std.dev.: 0.0200) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 23:49:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 01:49:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140408064924.5E6782A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24403?compare_to=24395&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24403, Order: 205751, Start Time: 2014-04-08 02:04:26, End Time: 2014-04-08 06:55:47 To: 24395, Order: 205728, Start Time: 2014-04-07 19:02:45, End Time: 2014-04-07 23:54:06 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (126 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (949 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/factor: 125.00% (0.0160 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Regression/C/sumarraymalloc: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.43% (0.1400 => 0.1560, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: 5.66% (0.2120 => 0.2240, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.88% (0.3280 => 0.3440, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (0.3400 => 0.3520, std.dev.: 0.0044) SingleSource/Regression/C/sumarray2d: 2.48% (0.6440 => 0.6600, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -8.86% (11.4207 => 10.4086, std.dev.: 0.1108) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0095) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0045) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.48% (1.7321 => 2.1041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.31% (1.7641 => 2.1401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.95% (1.6801 => 2.0321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.84% (1.8041 => 2.1801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.61% (1.9801 => 2.3881, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.53% (1.7921 => 2.1601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.08% (1.9081 => 2.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.76% (1.7481 => 2.0761, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.74% (1.9641 => 2.3321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0124) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.18% (0.1320 => 0.1560, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0124) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: 12.00% (0.2000 => 0.2240, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.5560 => 0.6000, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.9920 => 1.0560, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (11.7880 => 12.4760, std.dev.: 0.0570) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.71% (6.7200 => 7.1040, std.dev.: 0.0515) SingleSource/Benchmarks/Shootout-C++/strcat: 5.00% (0.2400 => 0.2520, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0222) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (2.0680 => 2.1640, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0192) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.7480 => 0.7800, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (9.9842 => 10.4082, std.dev.: 0.0609) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.11% (2.0440 => 2.1280, std.dev.: 0.0162) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0388) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.8201 => 1.8921, std.dev.: 0.0179) MultiSource/Applications/oggenc/oggenc: 3.93% (6.9124 => 7.1844, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (6.8321 => 7.0921, std.dev.: 0.0275) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (0.3400 => 0.3520, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 3.41% (10.3203 => 10.6723, std.dev.: 0.0281) MultiSource/Applications/d/make_dparser: 3.33% (3.9641 => 4.0961, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 3.18% (22.6287 => 23.3487, std.dev.: 0.0607) MultiSource/Applications/SPASS/SPASS: 3.14% (18.4924 => 19.0726, std.dev.: 0.0528) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (5.5480 => 5.6840, std.dev.: 0.0376) MultiSource/Applications/ClamAV/clamscan: 2.41% (20.2445 => 20.7325, std.dev.: 0.0489) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0065) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.38% (51.1089 => 52.3249, std.dev.: 0.1480) MultiSource/Benchmarks/Bullet/bullet: 2.37% (38.9366 => 39.8606, std.dev.: 0.0721) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (4.2203 => 4.3083, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 1.99% (19.7371 => 20.1291, std.dev.: 0.0484) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (16.5963 => 16.8723, std.dev.: 0.0598) MultiSource/Applications/sqlite3/sqlite3: 1.52% (25.1895 => 25.5736, std.dev.: 0.0372) MultiSource/Applications/siod/siod: 1.45% (2.7562 => 2.7962, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0244 => 6.0884, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.74% (6.6644 => 17.1771, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 25.86% (0.9281 => 1.1681, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.51% (1.2681 => 1.4521, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0216) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0325) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.44% (3.4402 => 3.5242, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 1.42% (21.6534 => 21.9614, std.dev.: 0.0428) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.88% (6.2884 => 1.3281, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.20% (3.1762 => 1.2641, std.dev.: 0.0080) SingleSource/Regression/C/PR10189: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -32.48% (2.6481 => 1.7880, std.dev.: 0.0154) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.90% (7.4801 => 6.2160, std.dev.: 0.0330) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.83% (7.5041 => 6.3160, std.dev.: 0.0259) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0065) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -4.58% (10.9087 => 10.4086, std.dev.: 0.1108) MultiSource/Benchmarks/mafft/pairlocalalign: -2.69% (13.5243 => 13.1603, std.dev.: 0.0295) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (0.9281 => 0.8561, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: -3.01% (2.1281 => 2.0641, std.dev.: 0.0247) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0264) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0421) MultiSource/Benchmarks/sim/sim: -1.76% (4.9883 => 4.9003, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 23:51:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 01:51:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140408065109.E914B2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24404?compare_to=24396&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24404, Order: 205751, Start Time: 2014-04-08 02:04:22, End Time: 2014-04-08 06:57:31 To: 24396, Order: 205728, Start Time: 2014-04-07 19:06:23, End Time: 2014-04-07 23:59:06 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (136 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C++/EH/class_hierarchy: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.52% (0.1680 => 0.1840, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.26% (0.2160 => 0.2360, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 8.77% (0.2280 => 0.2480, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.16% (0.1960 => 0.2120, std.dev.: 0.0039) SingleSource/Regression/C/bigstack: 6.52% (0.1840 => 0.1960, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0037) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.72% (1.2920 => 1.3400, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.49% (2.4162 => 2.4522, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.13% (2.1161 => 2.1401, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 16.00% (0.1000 => 0.1160, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -9.23% (11.4007 => 10.3486, std.dev.: 0.1045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.29% (17.6723 => 19.6683, std.dev.: 0.0396) MultiSource/Applications/sqlite3/sqlite3: 1416.95% (1.7001 => 25.7896, std.dev.: 0.0531) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.58% (50.1010 => 51.8970, std.dev.: 0.1212) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.02% (11.3920 => 12.1920, std.dev.: 0.0709) SingleSource/Benchmarks/Misc/oourafft: 174.46% (11.3407 => 31.1259, std.dev.: 0.0986) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0563, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0148) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 321.32% (0.4320 => 1.8201, std.dev.: 0.0113) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0055) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-6: 44.44% (0.0360 => 0.0520, std.dev.: 0.0040) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/ary3: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.22% (0.1840 => 0.2120, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.14% (1.8761 => 2.1601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.93% (1.9521 => 2.2241, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.60% (2.1041 => 2.3481, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.13% (1.9761 => 2.1961, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0177) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0103) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0080) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (2.9721 => 3.1562, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (6.4800 => 6.8520, std.dev.: 0.0424) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0083) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.19% (0.6160 => 0.6480, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (1.6641 => 1.7481, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.72% (6.5320 => 6.8400, std.dev.: 0.0416) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0284) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (9.6042 => 10.0242, std.dev.: 0.0500) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.29% (1.2120 => 1.2640, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (5.8281 => 6.0681, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (6.5360 => 6.7720, std.dev.: 0.0339) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0402) MultiSource/Applications/oggenc/oggenc: 3.57% (7.0524 => 7.3045, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (5.3960 => 5.5720, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (16.3003 => 16.7883, std.dev.: 0.0318) MultiSource/Applications/JM/lencod/lencod: 2.86% (22.2206 => 22.8567, std.dev.: 0.0583) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0196) MultiSource/Benchmarks/Bullet/bullet: 2.67% (38.6366 => 39.6686, std.dev.: 0.0919) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0094) MultiSource/Applications/SPASS/SPASS: 2.57% (18.5284 => 19.0045, std.dev.: 0.0349) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.34% (1.0241 => 1.0481, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: 2.27% (10.2283 => 10.4603, std.dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0181) MultiSource/Applications/kimwitu++/kc: 1.80% (19.8291 => 20.1851, std.dev.: 0.0508) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0403) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.53% (7.3725 => 7.6325, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 2.48% (1.2881 => 1.3201, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 2.43% (6.5964 => 6.7564, std.dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (4.0003 => 4.0563, std.dev.: 0.0211) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0160) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.32% (2.9562 => 0.7000, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0074) MultiSource/Applications/obsequi/Obsequi: -6.82% (1.8760 => 1.7480, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.02% (94.8339 => 49.2991, std.dev.: 10.1557) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.28% (49.9431 => 32.8221, std.dev.: 0.2093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.39% (25.7136 => 17.1291, std.dev.: 0.1485) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.01% (37.0863 => 28.5538, std.dev.: 0.5861) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.46% (2.7482 => 2.4882, std.dev.: 0.0972) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/five11/five11: -1.36% (2.3521 => 2.3201, std.dev.: 0.0087) MultiSource/Benchmarks/sim/sim: -1.34% (4.7883 => 4.7243, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 7 23:51:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 01:51:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140408065151.5CAE62A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24405?compare_to=24397&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24405, Order: 205751, Start Time: 2014-04-08 02:04:24, End Time: 2014-04-08 06:58:11 To: 24397, Order: 205728, Start Time: 2014-04-07 19:08:51, End Time: 2014-04-08 00:02:18 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 14 (151 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.95% (0.3520 => 0.3800, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (0.9081 => 0.9281, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.76% (1.3601 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.46% (1.3721 => 1.3921, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 18.75% (0.0640 => 0.0760, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 10.34% (0.3480 => 0.3840, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.03% (0.9921 => 1.0321, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (1.3081 => 1.3361, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -8.27% (11.3727 => 10.4327, std.dev.: 0.1396) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1962.50% (0.0320 => 0.6600, std.dev.: 0.0092) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0113) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 396.87% (0.2520 => 1.2521, std.dev.: 0.0128) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 282.80% (0.2320 => 0.8881, std.dev.: 0.0066) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0065) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0059) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.98% (0.7040 => 1.0840, std.dev.: 0.0152) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 34.62% (0.1040 => 0.1400, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.68% (1.2481 => 1.5561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.49% (1.1561 => 1.4161, std.dev.: 0.0070) MultiSource/Applications/obsequi/Obsequi: 22.41% (1.3920 => 1.7040, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.45% (1.2321 => 1.4841, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.13% (1.2321 => 1.4801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 18.51% (8.5802 => 10.1683, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 15.52% (19.5406 => 22.5727, std.dev.: 0.0427) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.81% (0.1080 => 0.1240, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.79% (5.3360 => 6.0721, std.dev.: 0.0576) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1760 => 0.2000, std.dev.: 0.0072) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0163) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 9.49% (11.3843 => 12.4643, std.dev.: 0.0340) MultiSource/Applications/oggenc/oggenc: 9.04% (6.2844 => 6.8524, std.dev.: 0.0189) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.03% (5.7280 => 6.1880, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (5.6680 => 6.1000, std.dev.: 0.0365) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.51% (11.4440 => 12.3040, std.dev.: 0.0681) MultiSource/Benchmarks/McCat/08-main/main: 7.14% (0.3360 => 0.3600, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.42% (0.8721 => 0.9281, std.dev.: 0.0071) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.30% (9.5802 => 10.1842, std.dev.: 0.0664) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.16% (1.6240 => 1.7240, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0209) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.53% (1.3240 => 1.3840, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 4.27% (4.7720 => 4.9760, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0182) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (6.8280 => 7.0880, std.dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7600 => 1.8240, std.dev.: 0.0206) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.7680 => 0.7920, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0203) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.03% (49.1529 => 50.6409, std.dev.: 0.0982) MultiSource/Applications/ClamAV/clamscan: 2.81% (19.2243 => 19.7644, std.dev.: 0.0520) MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (2.7282 => 2.8002, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.31% (24.7575 => 25.3295, std.dev.: 0.0444) MultiSource/Benchmarks/Bullet/bullet: 1.69% (39.0726 => 39.7326, std.dev.: 0.0573) MultiSource/Applications/kimwitu++/kc: 1.66% (19.7491 => 20.0771, std.dev.: 0.0327) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0028) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.83% (3.9842 => 4.2963, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.45% (0.9881 => 1.0321, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0404) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.3085 => 7.4845, std.dev.: 0.0382) MultiSource/Applications/sqlite3/sqlite3: 2.07% (4.0563 => 4.1403, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -5.34% (11.0207 => 10.4327, std.dev.: 0.1396) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -15.62% (7.8605 => 6.6324, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0808) MultiSource/Applications/siod/siod: -6.57% (2.9842 => 2.7882, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -1.84% (4.9963 => 4.9043, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0258) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 00:13:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 02:13:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408071351.BCED32A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24406?compare_to=24400&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24406, Order: 205752, Start Time: 2014-04-08 02:31:49, End Time: 2014-04-08 07:20:12 To: 24400, Order: 205751, Start Time: 2014-04-08 02:04:25, End Time: 2014-04-08 06:49:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (102 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-03-02-VaCopy: 400.00% (0.0040 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2003-09-18-BitFieldTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/Vector/simple: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.41% (0.0680 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 23.08% (0.0520 => 0.0640, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/SmallPT/smallpt: 15.62% (0.1280 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.00% (0.2400 => 0.2640, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 8.57% (0.2800 => 0.3040, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: 6.02% (0.3320 => 0.3520, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.76% (1.3641 => 1.3881, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.29% (0.7000 => 0.7440, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.00% (0.2400 => 0.2520, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 2.35% (0.6800 => 0.6960, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.85% (1.7281 => 1.6961, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0030) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 62.50% (0.0320 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0480 => 0.0640, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0118) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0508) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (1.5200 => 1.6200, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0369) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0183) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0384) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (10.4082 => 10.8122, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0163) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0361) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0518) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.44% (1.1480 => 1.1760, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0154) MultiSource/Applications/Burg/burg: 2.19% (1.4600 => 1.4920, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 2.11% (37.0925 => 37.8765, std.dev.: 0.0466) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0417) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.75% (48.1088 => 48.9489, std.dev.: 0.0922) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0094) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0114) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0157) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0437) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0740) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0037) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0340) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 2.68% (5.8164 => 5.9724, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.17% (1.6601 => 1.6961, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -5.10% (10.8967 => 10.3406, std.dev.: 0.1064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 01:39:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 03:39:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408083902.F2DF72A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24407?compare_to=24406&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24407, Order: 205753, Start Time: 2014-04-08 03:55:53, End Time: 2014-04-08 08:45:22 To: 24406, Order: 205752, Start Time: 2014-04-08 02:31:49, End Time: 2014-04-08 07:20:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (98 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Regression/C/bigstack: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.6960 => 0.7440, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.68% (1.3680 => 1.4320, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.48% (1.3521 => 1.3721, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.27% (1.2561 => 1.2721, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 44.44% (0.0360 => 0.0520, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/mst/mst: 15.38% (0.1040 => 0.1200, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.42% (1.6961 => 1.7201, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/ary3: 1.03% (3.5042 => 3.5402, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: -23.08% (0.0520 => 0.0400, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0057) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.00% (1.2361 => 1.3721, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (10.6960 => 11.3840, std.dev.: 0.0740) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0439) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0344) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (10.4082 => 10.8162, std.dev.: 0.0349) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0215) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0156) MultiSource/Applications/JM/lencod/lencod: 3.29% (17.6165 => 18.1965, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0348) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0382) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8885, std.dev.: 0.0654) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0413) MultiSource/Applications/sqlite3/sqlite3: 2.07% (23.7574 => 24.2495, std.dev.: 0.0551) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0119) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0122) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.73% (48.1088 => 48.9409, std.dev.: 0.0919) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0609) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0484) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0191) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 5.17% (6.6564 => 7.0004, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0321) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.96% (10.8967 => 10.4647, std.dev.: 0.1106) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/d/make_dparser: -42.86% (0.0280 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 04:37:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 06:37:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140408113744.AF1B52A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24408?compare_to=24401&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24408, Order: 205753, Start Time: 2014-04-08 06:56:32, End Time: 2014-04-08 11:44:03 To: 24401, Order: 205751, Start Time: 2014-04-08 02:04:25, End Time: 2014-04-08 06:53:20 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1103 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/matrixTranspose: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.51% (0.1480 => 0.1680, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/exptree: 12.00% (0.1000 => 0.1120, std.dev.: 0.0042) SingleSource/Regression/C/test_indvars: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.2520 => 0.2720, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -26.37% (0.7280 => 0.5360, std.dev.: 0.0158) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 04:38:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 06:38:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140408113847.7964F2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24409?compare_to=24402&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24409, Order: 205753, Start Time: 2014-04-08 06:56:39, End Time: 2014-04-08 11:45:05 To: 24402, Order: 205751, Start Time: 2014-04-08 02:04:25, End Time: 2014-04-08 06:53:28 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 14 (146 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 100.00% (0.0200 => 0.0400, std.dev.: 0.0072) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/UnitTests/Vector/sumarray-dbl: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.23% (0.1040 => 0.1240, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.86% (0.1120 => 0.1320, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.90% (0.3480 => 0.3720, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3080 => 0.3280, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: 5.66% (0.2120 => 0.2240, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (1.9000 => 1.9640, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.99% (2.1440 => 2.2080, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.80% (1.1721 => 1.2401, std.dev.: 0.0142) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 173.75% (11.3687 => 31.1219, std.dev.: 0.1561) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7484, std.dev.: 0.0075) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4600 => 1.8401, std.dev.: 0.0070) SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0048) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/15-trie/trie: 21.43% (0.0560 => 0.0680, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.23% (0.1040 => 0.1240, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0183) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.68% (1.6121 => 1.7521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0173) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (0.2200 => 0.2360, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.90% (0.3480 => 0.3720, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0085) SingleSource/Regression/C/bigstack: 6.52% (0.1840 => 0.1960, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.8440 => 1.9640, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0401) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.77% (1.4561 => 1.5401, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.70% (11.6440 => 12.3080, std.dev.: 0.0391) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (9.4842 => 9.9922, std.dev.: 0.0490) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0202) MultiSource/Applications/JM/ldecod/ldecod: 5.18% (10.0443 => 10.5644, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (5.8121 => 6.1041, std.dev.: 0.0314) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0077) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.57% (1.3120 => 1.3720, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.52% (6.5440 => 6.8400, std.dev.: 0.0365) MultiSource/Applications/Burg/burg: 4.51% (1.5080 => 1.5760, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (6.5080 => 6.7760, std.dev.: 0.0367) MultiSource/Applications/JM/lencod/lencod: 4.10% (21.9606 => 22.8608, std.dev.: 0.0627) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.95% (2.1240 => 2.2080, std.dev.: 0.0109) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0163) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0075) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.56% (50.0290 => 51.8090, std.dev.: 0.0705) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0161) MultiSource/Benchmarks/Bullet/bullet: 3.07% (38.4046 => 39.5846, std.dev.: 0.0926) MultiSource/Applications/SPASS/SPASS: 3.06% (18.4404 => 19.0045, std.dev.: 0.0339) MultiSource/Applications/lua/lua: 2.84% (4.7880 => 4.9240, std.dev.: 0.0342) MultiSource/Applications/d/make_dparser: 2.82% (3.9681 => 4.0801, std.dev.: 0.0149) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0126) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 2.52% (19.0444 => 19.5244, std.dev.: 0.0750) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (16.3483 => 16.7403, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 2.21% (19.6891 => 20.1251, std.dev.: 0.0484) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.40% (2.1401 => 2.4482, std.dev.: 0.0465) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 5.59% (2.8602 => 3.0202, std.dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.87% (1.6521 => 1.7161, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0342) MultiSource/Applications/obsequi/Obsequi: 2.53% (2.0521 => 2.1041, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4205 => 7.5845, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.63% (2.9442 => 0.6880, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.10% (1.5641 => 0.6240, std.dev.: 0.0087) MultiSource/Applications/obsequi/Obsequi: -5.35% (1.8680 => 1.7680, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.16% (91.8497 => 49.4551, std.dev.: 9.3717) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.40% (26.0616 => 17.0971, std.dev.: 0.2239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.39% (50.3031 => 33.0061, std.dev.: 0.2879) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.92% (42.1466 => 28.6938, std.dev.: 0.6307) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1020) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.58% (4.8083 => 4.6363, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 04:43:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 06:43:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140408114315.D1DE32A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24410?compare_to=24403&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24410, Order: 205753, Start Time: 2014-04-08 06:58:58, End Time: 2014-04-08 11:49:38 To: 24403, Order: 205751, Start Time: 2014-04-08 02:04:26, End Time: 2014-04-08 06:55:47 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (134 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 14.00% (0.2000 => 0.2280, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.00% (0.1000 => 0.1120, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0072) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0030) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.11% (1.7241 => 2.0881, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.93% (1.7201 => 2.0801, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.89% (1.8001 => 2.1761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.88% (1.7241 => 2.0841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.53% (1.7921 => 2.1601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.38% (1.6921 => 2.0201, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.33% (1.6761 => 2.0001, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0140) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.03% (0.6120 => 0.7040, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0072) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.66% (3.5002 => 3.7682, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (11.7880 => 12.5280, std.dev.: 0.0340) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.07% (6.7200 => 7.1280, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0253) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.84% (0.2480 => 0.2600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.61% (9.9842 => 10.4442, std.dev.: 0.0571) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.1440 => 1.1920, std.dev.: 0.0110) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (6.8321 => 7.1121, std.dev.: 0.0299) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.8201 => 1.8921, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0182) MultiSource/Applications/d/make_dparser: 3.83% (3.9641 => 4.1161, std.dev.: 0.0249) MultiSource/Applications/oggenc/oggenc: 3.76% (6.9124 => 7.1724, std.dev.: 0.0211) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0077) MultiSource/Applications/SPASS/SPASS: 3.22% (18.4924 => 19.0885, std.dev.: 0.0492) MultiSource/Applications/JM/lencod/lencod: 2.86% (22.6287 => 23.2767, std.dev.: 0.0472) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (10.3203 => 10.6083, std.dev.: 0.0487) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0093) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.30% (51.1089 => 52.2849, std.dev.: 0.1041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (16.5963 => 16.9603, std.dev.: 0.0286) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 2.08% (38.9366 => 39.7446, std.dev.: 0.0838) MultiSource/Applications/kimwitu++/kc: 2.05% (19.7371 => 20.1411, std.dev.: 0.0406) MultiSource/Applications/ClamAV/clamscan: 2.02% (20.2445 => 20.6525, std.dev.: 0.0908) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0244 => 6.1124, std.dev.: 0.0210) MultiSource/Applications/sqlite3/sqlite3: 1.41% (25.1895 => 25.5455, std.dev.: 0.0417) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 28.01% (0.9281 => 1.1881, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 16.92% (0.2600 => 0.3040, std.dev.: 0.0123) MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.30% (0.3720 => 0.3880, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.49% (0.3440 => 0.3560, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0456) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.33% (3.4842 => 3.6002, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.43% (5.0963 => 5.2203, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (4.2443 => 4.3403, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (4.2403 => 4.3163, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0156) MultiSource/Applications/lua/lua: 1.63% (21.6534 => 22.0054, std.dev.: 0.0553) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.7563 => 4.8203, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.82% (6.2884 => 1.3321, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.23% (1.5881 => 0.5680, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.33% (3.1762 => 1.2601, std.dev.: 0.0084) SingleSource/Regression/C++/EH/dead_try_block: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -33.39% (2.6481 => 1.7640, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.58% (7.4801 => 6.2400, std.dev.: 0.0535) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.78% (7.5041 => 6.3200, std.dev.: 0.0502) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0087) SingleSource/UnitTests/Vector/constpool: -4.40% (10.9087 => 10.4287, std.dev.: 0.0953) MultiSource/Benchmarks/mafft/pairlocalalign: -2.75% (13.5243 => 13.1523, std.dev.: 0.0549) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0053) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0288) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: -1.44% (4.9883 => 4.9163, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: -1.02% (25.7976 => 25.5336, std.dev.: 0.0225) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 04:45:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 06:45:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140408114555.18A3B2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24411?compare_to=24404&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24411, Order: 205753, Start Time: 2014-04-08 07:00:42, End Time: 2014-04-08 11:52:17 To: 24404, Order: 205751, Start Time: 2014-04-08 02:04:22, End Time: 2014-04-08 06:57:31 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (134 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 40.00% (0.0400 => 0.0560, std.dev.: 0.0061) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 10.20% (0.1960 => 0.2160, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.84% (0.2440 => 0.2680, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 3.17% (0.7560 => 0.7800, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.64% (12.1920 => 12.3920, std.dev.: 0.0505) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 18.75% (0.0640 => 0.0760, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.89% (1.0601 => 1.0801, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.17% (32.8221 => 33.2061, std.dev.: 0.1150) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.36% (17.6723 => 19.6804, std.dev.: 0.0225) MultiSource/Applications/sqlite3/sqlite3: 1418.12% (1.7001 => 25.8096, std.dev.: 0.0447) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (50.1010 => 51.8130, std.dev.: 0.0943) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (1.0520 => 1.1240, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.78% (11.3920 => 12.3920, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/oourafft: 175.38% (11.3407 => 31.2300, std.dev.: 0.0983) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0483, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0068) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0108) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0031) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_shift: 40.00% (0.0400 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0073) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.92% (1.8761 => 2.1561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.36% (1.9161 => 2.1721, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0154) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.50% (0.4160 => 0.4680, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0122) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.68% (0.3720 => 0.4080, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.59% (1.8361 => 2.0121, std.dev.: 0.0189) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (1.0880 => 1.1760, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.57% (0.7400 => 0.7960, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0136) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (6.4800 => 6.8800, std.dev.: 0.0356) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 5.61% (1.7841 => 1.8841, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.49% (1.7480 => 1.8440, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.12% (2.9721 => 3.1242, std.dev.: 0.0219) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (1.6641 => 1.7481, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.6960 => 1.7760, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.39% (5.8281 => 6.0841, std.dev.: 0.0287) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.16% (9.6042 => 10.0042, std.dev.: 0.0357) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (6.5320 => 6.7840, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (5.3960 => 5.5720, std.dev.: 0.0502) MultiSource/Applications/oggenc/oggenc: 3.23% (7.0524 => 7.2805, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (6.5360 => 6.7440, std.dev.: 0.0334) MultiSource/Applications/lua/lua: 3.01% (4.7920 => 4.9360, std.dev.: 0.0412) MultiSource/Applications/treecc/treecc: 2.94% (2.5880 => 2.6640, std.dev.: 0.0177) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (16.3003 => 16.7563, std.dev.: 0.0422) MultiSource/Applications/JM/lencod/lencod: 2.67% (22.2206 => 22.8128, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 2.58% (38.6366 => 39.6326, std.dev.: 0.0551) MultiSource/Applications/SPASS/SPASS: 2.48% (18.5284 => 18.9885, std.dev.: 0.0386) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2243 => 4.3203, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 2.07% (10.2283 => 10.4403, std.dev.: 0.0247) MultiSource/Applications/kimwitu++/kc: 1.53% (19.8291 => 20.1331, std.dev.: 0.0230) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (13.0363 => 13.1843, std.dev.: 0.0350) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.61% (2.1201 => 2.4722, std.dev.: 0.0357) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.13% (3.5642 => 3.6402, std.dev.: 0.0290) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0111) MultiSource/Applications/minisat/minisat: 1.88% (6.5964 => 6.7204, std.dev.: 0.0356) SingleSource/Benchmarks/Dhrystone/dry: 1.76% (0.6800 => 0.6920, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (3.7442 => 3.7962, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (3.9442 => 3.9882, std.dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.46% (2.9562 => 0.6960, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: -5.12% (1.8760 => 1.7800, std.dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.00% (94.8339 => 49.3111, std.dev.: 9.0684) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.63% (25.7136 => 17.0651, std.dev.: 0.1020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.51% (49.9431 => 33.2061, std.dev.: 0.1150) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.76% (37.0863 => 28.6458, std.dev.: 0.4011) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 04:47:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 06:47:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140408114708.0D52F2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24412?compare_to=24405&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24412, Order: 205753, Start Time: 2014-04-08 07:01:26, End Time: 2014-04-08 11:53:28 To: 24405, Order: 205751, Start Time: 2014-04-08 02:04:24, End Time: 2014-04-08 06:58:11 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (145 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray-dbl: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Regression/C/test_indvars: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.49% (1.0680 => 1.1800, std.dev.: 0.0431) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 9.68% (0.1240 => 0.1360, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.37% (0.3840 => 0.4200, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/09-vor/vor: 5.10% (0.3920 => 0.4120, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.22% (0.4600 => 0.4840, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: 3.03% (0.3960 => 0.4080, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0070) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0113) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0066) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 393.69% (0.2520 => 1.2441, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/nestedloop: 281.08% (0.2320 => 0.8841, std.dev.: 0.0078) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0062) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0074) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0069) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0067) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0054) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0082) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 22.70% (1.3920 => 1.7080, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.84% (1.1721 => 1.4281, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.55% (1.1321 => 1.3761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.54% (1.3001 => 1.5801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.07% (1.1761 => 1.4121, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.81% (1.2521 => 1.5001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.73% (1.1761 => 1.4081, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (1.3681 => 1.6361, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.33% (1.2001 => 1.4321, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 18.70% (8.5802 => 10.1843, std.dev.: 0.0404) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 15.72% (19.5406 => 22.6127, std.dev.: 0.0392) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.62% (5.3360 => 6.1161, std.dev.: 0.0239) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 13.31% (1.3521 => 1.5321, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0185) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 9.21% (11.3843 => 12.4323, std.dev.: 0.0338) MultiSource/Applications/oggenc/oggenc: 9.10% (6.2844 => 6.8564, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.12% (5.6680 => 6.1280, std.dev.: 0.0492) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.7640 => 0.8240, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.72% (11.4440 => 12.3280, std.dev.: 0.0468) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.54% (5.7280 => 6.1600, std.dev.: 0.0609) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.51% (9.5802 => 10.2042, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 4.44% (4.7720 => 4.9840, std.dev.: 0.0233) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.39% (6.8280 => 7.1280, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0081) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.88% (1.3400 => 1.3920, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.7440 => 0.7720, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (5.3840 => 5.5800, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.4520 => 0.4680, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 3.25% (19.2243 => 19.8484, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.7600 => 1.8160, std.dev.: 0.0167) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.17% (49.1529 => 50.7089, std.dev.: 0.0820) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.49% (24.7575 => 25.3735, std.dev.: 0.0591) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 1.62% (39.0726 => 39.7046, std.dev.: 0.0528) MultiSource/Applications/kimwitu++/kc: 1.54% (19.7491 => 20.0531, std.dev.: 0.0504) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.82% (0.3320 => 0.3480, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0351) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (1.2961 => 1.3161, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0225) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.43% (1.4001 => 1.4201, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -6.24% (11.0207 => 10.3326, std.dev.: 0.0806) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -15.73% (7.8605 => 6.6244, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.66% (3.4442 => 3.0082, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0923) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 05:20:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 07:20:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408122032.E79FE2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24413?compare_to=24407&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24413, Order: 205754, Start Time: 2014-04-08 07:42:50, End Time: 2014-04-08 12:26:54 To: 24407, Order: 205753, Start Time: 2014-04-08 03:55:53, End Time: 2014-04-08 08:45:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (102 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 200.00% (0.0080 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.3200 => 0.3440, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.63% (0.4320 => 0.4520, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.85% (0.3120 => 0.3240, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.45% (0.6960 => 0.7200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.53% (1.3041 => 1.3241, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 16.13% (0.1240 => 0.1440, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 1.19% (2.3481 => 2.3761, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.37% (1.1961 => 1.3201, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0093) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.3200 => 0.3440, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (10.6960 => 11.3960, std.dev.: 0.0845) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0398) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0273) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0273) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0354) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0090) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: 3.09% (17.6165 => 18.1605, std.dev.: 0.0651) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0372) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0496) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0409) MultiSource/Applications/sqlite3/sqlite3: 2.17% (23.7574 => 24.2735, std.dev.: 0.0502) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.17% (48.1088 => 49.1529, std.dev.: 0.0808) MultiSource/Benchmarks/Bullet/bullet: 2.14% (37.0925 => 37.8846, std.dev.: 0.0985) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 2.00% (5.7964 => 5.9124, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1250, std.dev.: 0.0238) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0440) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0365) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0087) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0048) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (0.6000 => 0.6160, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.21% (4.9443 => 5.0043, std.dev.: 0.0183) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -5.07% (10.8967 => 10.3446, std.dev.: 0.1373) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0078) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 08:41:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 10:41:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408154142.925432A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24414?compare_to=24413&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24414, Order: 205755, Start Time: 2014-04-08 11:02:35, End Time: 2014-04-08 15:48:02 To: 24413, Order: 205754, Start Time: 2014-04-08 07:42:50, End Time: 2014-04-08 12:26:54 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (98 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/hash: 30.77% (0.0520 => 0.0680, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 27.78% (0.0720 => 0.0920, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/misr: 26.67% (0.0600 => 0.0760, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.05% (0.0840 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.32% (2.4282 => 2.4602, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0055) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0113) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.50% (0.1600 => 0.1720, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0234) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0717) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0401) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.6840 => 0.7160, std.dev.: 0.0106) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0238) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0151) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0247) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0317) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0440) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0548) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0363) MultiSource/Applications/sqlite3/sqlite3: 2.34% (23.7574 => 24.3135, std.dev.: 0.0173) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0347) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9125, std.dev.: 0.0911) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0136) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.08% (48.1088 => 49.1090, std.dev.: 0.0852) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0373) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1250, std.dev.: 0.0252) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0210) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0330) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0067) SingleSource/Benchmarks/SmallPT/smallpt: 1.26% (14.0009 => 14.1769, std.dev.: 0.0637) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.15% (10.8967 => 10.4447, std.dev.: 0.0976) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0225) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 09:30:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 11:30:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140408163013.37B2F2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24415?compare_to=24408&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24415, Order: 205755, Start Time: 2014-04-08 11:47:41, End Time: 2014-04-08 16:36:37 To: 24408, Order: 205753, Start Time: 2014-04-08 06:56:32, End Time: 2014-04-08 11:44:03 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/short_circuit_dtor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/UnitTests/2003-07-09-SignedArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 6.67% (0.3600 => 0.3840, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2000 => 0.2120, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.44% (1.8041 => 1.8481, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (2.1000 => 2.1400, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.63% (1.7161 => 1.7441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.60% (1.7481 => 1.7761, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0106) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 09:31:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 11:31:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140408163146.345112A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24416?compare_to=24409&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24416, Order: 205755, Start Time: 2014-04-08 11:48:45, End Time: 2014-04-08 16:38:10 To: 24409, Order: 205753, Start Time: 2014-04-08 06:56:39, End Time: 2014-04-08 11:45:05 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 11 (147 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 250.00% (0.0080 => 0.0280, std.dev.: 0.0028) SingleSource/UnitTests/2002-05-02-ManyArguments: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.77% (0.2600 => 0.2880, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2120 => 0.2280, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 6.00% (0.2000 => 0.2120, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.7400 => 0.7760, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (0.6520 => 0.6720, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 16.28% (0.1720 => 0.2000, std.dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 5.88% (17.3411 => 18.3611, std.dev.: 0.2482) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.03% (11.3687 => 31.1539, std.dev.: 0.0766) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0083) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/Vector/divides: 100.00% (0.0120 => 0.0240, std.dev.: 0.0016) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 20.45% (0.1760 => 0.2120, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 17.65% (0.1360 => 0.1600, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.19% (0.3640 => 0.4120, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.81% (1.4561 => 1.6281, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.36% (0.1760 => 0.1960, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.32% (0.6200 => 0.6840, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.23% (0.7040 => 0.7760, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.08% (1.5481 => 1.7041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.76% (0.1640 => 0.1800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.56% (0.8881 => 0.9641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.02% (1.4961 => 1.6161, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.22% (1.1640 => 1.2480, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Regression/C/bigstack: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.4680 => 6.8720, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.23% (1.5401 => 1.6361, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (11.6440 => 12.3360, std.dev.: 0.0530) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0128) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.57% (9.4842 => 10.0122, std.dev.: 0.0419) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2160 => 0.2280, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (2.0440 => 2.1520, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0185) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (10.0443 => 10.5603, std.dev.: 0.0243) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (1.7921 => 1.8841, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/bh/bh: 4.96% (0.4840 => 0.5080, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (5.8121 => 6.0961, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.5480 => 1.6200, std.dev.: 0.0172) MultiSource/Applications/JM/lencod/lencod: 4.63% (21.9606 => 22.9768, std.dev.: 0.0526) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5440 => 6.8160, std.dev.: 0.0523) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0106) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (6.5080 => 6.7480, std.dev.: 0.0507) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.68% (50.0290 => 51.8690, std.dev.: 0.0769) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0168) MultiSource/Applications/treecc/treecc: 3.25% (2.5840 => 2.6680, std.dev.: 0.0210) MultiSource/Benchmarks/Bullet/bullet: 3.19% (38.4046 => 39.6286, std.dev.: 0.0884) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (4.1843 => 4.3163, std.dev.: 0.0156) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0345) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (5.3600 => 5.5120, std.dev.: 0.0449) MultiSource/Applications/d/make_dparser: 2.82% (3.9681 => 4.0801, std.dev.: 0.0182) MultiSource/Applications/SPASS/SPASS: 2.82% (18.4404 => 18.9605, std.dev.: 0.0483) MultiSource/Applications/ClamAV/clamscan: 2.81% (19.0444 => 19.5804, std.dev.: 0.0658) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (16.3483 => 16.6963, std.dev.: 0.0548) MultiSource/Applications/kimwitu++/kc: 2.03% (19.6891 => 20.0891, std.dev.: 0.0293) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0563 => 13.1963, std.dev.: 0.0338) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0303) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.45% (2.1401 => 2.4922, std.dev.: 0.0395) MultiSource/Applications/siod/siod: 5.73% (2.8602 => 3.0242, std.dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: 4.91% (17.5011 => 18.3611, std.dev.: 0.2482) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.44% (0.7200 => 0.7520, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.8481 => 0.8641, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.81% (3.9922 => 4.0643, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 1.11% (3.9842 => 4.0283, std.dev.: 0.0149) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.36% (2.9442 => 0.6960, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.62% (1.5641 => 0.6160, std.dev.: 0.0100) MultiSource/Applications/obsequi/Obsequi: -5.35% (1.8680 => 1.7680, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.40% (91.8497 => 49.2311, std.dev.: 10.1637) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -35.15% (26.0616 => 16.9011, std.dev.: 0.1312) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.43% (50.3031 => 32.9861, std.dev.: 0.2269) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.30% (42.1466 => 28.9538, std.dev.: 0.5440) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1022) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0182) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 09:38:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 11:38:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140408163817.56F862A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24417?compare_to=24410&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24417, Order: 205755, Start Time: 2014-04-08 11:53:10, End Time: 2014-04-08 16:44:39 To: 24410, Order: 205753, Start Time: 2014-04-08 06:58:58, End Time: 2014-04-08 11:49:38 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (127 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/globalrefs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/UnitTests/2003-08-05-CastFPToUint: 60.00% (0.0200 => 0.0320, std.dev.: 0.0018) SingleSource/Regression/C++/EH/class_hierarchy: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 36.36% (0.0880 => 0.1200, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/puzzle: 17.65% (0.0680 => 0.0800, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/exptree: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (0.1760 => 0.1960, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.17% (0.2360 => 0.2600, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 8.57% (0.2800 => 0.3040, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.21% (0.7600 => 0.7920, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.18% (2.0201 => 2.0641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.00% (2.0041 => 2.0441, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 1.84% (0.8680 => 0.8840, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 1.81% (1.7640 => 1.7960, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.56% (2.0561 => 2.0881, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.42% (2.2561 => 2.2881, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0084) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2005-05-13-SDivTwo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2003-08-05-CastFPToUint: 60.00% (0.0200 => 0.0320, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 22.54% (1.6681 => 2.0441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.40% (1.6961 => 2.0761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 22.25% (1.7081 => 2.0881, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.98% (1.6921 => 2.0641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.94% (1.7321 => 2.1121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.80% (1.6881 => 2.0561, std.dev.: 0.0142) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.63% (1.7201 => 2.0921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.53% (1.6721 => 2.0321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.43% (1.7921 => 2.1761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.39% (1.7201 => 2.0881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.33% (1.8001 => 2.1841, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.27% (1.7681 => 2.1441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.23% (1.6961 => 2.0561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.19% (1.8881 => 2.2881, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.88% (1.7241 => 2.0841, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.65% (1.7241 => 2.0801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.61% (1.9801 => 2.3881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.35% (1.8281 => 2.2001, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.22% (1.8201 => 2.1881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.82% (1.8361 => 2.2001, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.03% (1.9761 => 2.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.98% (1.9601 => 2.3321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.53% (1.9641 => 2.3281, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/puzzle: 17.65% (0.0680 => 0.0800, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.69% (0.6120 => 0.7080, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0270) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.04% (11.7880 => 12.5000, std.dev.: 0.0728) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.88% (0.7480 => 0.7920, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.7800 => 0.8240, std.dev.: 0.0154) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0080) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0305) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (9.9842 => 10.4242, std.dev.: 0.0705) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0133) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0165) MultiSource/Applications/oggenc/oggenc: 3.82% (6.9124 => 7.1764, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (6.8321 => 7.0721, std.dev.: 0.0304) MultiSource/Applications/treecc/treecc: 3.51% (2.6200 => 2.7120, std.dev.: 0.0183) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.39% (1.4160 => 1.4640, std.dev.: 0.0176) MultiSource/Applications/d/make_dparser: 3.33% (3.9641 => 4.0961, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: 3.27% (0.8560 => 0.8840, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 3.12% (18.4924 => 19.0686, std.dev.: 0.0479) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (10.3203 => 10.6363, std.dev.: 0.0361) MultiSource/Applications/JM/lencod/lencod: 2.97% (22.6287 => 23.3008, std.dev.: 0.0586) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: 2.59% (20.2445 => 20.7685, std.dev.: 0.0598) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.31% (51.1089 => 52.2889, std.dev.: 0.1194) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 2.14% (38.9366 => 39.7686, std.dev.: 0.0901) MultiSource/Applications/kimwitu++/kc: 2.01% (19.7371 => 20.1331, std.dev.: 0.0597) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (16.5963 => 16.9243, std.dev.: 0.0444) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (3.0122 => 3.0682, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 1.75% (25.1895 => 25.6296, std.dev.: 0.0323) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0151) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7722 => 2.8002, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.74% (6.6644 => 17.1771, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.90% (3.4842 => 3.6202, std.dev.: 0.0327) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (4.2443 => 4.3403, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 1.64% (21.6534 => 22.0094, std.dev.: 0.0647) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.43% (6.2884 => 1.3561, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/nestedloop: -65.86% (2.9642 => 1.0121, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0070) MultiSource/Applications/obsequi/Obsequi: -32.18% (2.6481 => 1.7960, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.17% (7.4801 => 6.1960, std.dev.: 0.0476) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.21% (7.5041 => 6.2880, std.dev.: 0.0350) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0060) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: -4.84% (10.9087 => 10.3806, std.dev.: 0.1076) MultiSource/Benchmarks/mafft/pairlocalalign: -2.84% (13.5243 => 13.1403, std.dev.: 0.0505) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -40.00% (0.0600 => 0.0360, std.dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (5.1603 => 5.0403, std.dev.: 0.0180) MultiSource/Applications/JM/lencod/lencod: -1.73% (8.3085 => 8.1645, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0154) MultiSource/Benchmarks/sim/sim: -1.60% (4.9883 => 4.9083, std.dev.: 0.0106) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -1.17% (11.6527 => 11.5167, std.dev.: 0.0130) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 09:42:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 11:42:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140408164213.C77B82A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24418?compare_to=24411&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24418, Order: 205755, Start Time: 2014-04-08 11:55:53, End Time: 2014-04-08 16:48:35 To: 24411, Order: 205753, Start Time: 2014-04-08 07:00:42, End Time: 2014-04-08 11:52:17 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (123 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (959 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2003-05-26-Shorts: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 25.00% (0.0640 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 12.00% (0.1000 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.39% (2.1721 => 2.2241, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (1.7760 => 1.8160, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.71% (2.1081 => 2.1441, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.60% (1.9961 => 2.0281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.59% (2.2641 => 2.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.31% (2.1441 => 2.1721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.14% (2.1081 => 2.1321, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.66% (17.6723 => 19.7324, std.dev.: 0.0426) MultiSource/Applications/sqlite3/sqlite3: 1421.89% (1.7001 => 25.8736, std.dev.: 0.0333) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.48% (50.1010 => 51.8450, std.dev.: 0.0740) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.53% (11.3920 => 12.3640, std.dev.: 0.0540) SingleSource/Benchmarks/Misc/oourafft: 175.38% (11.3407 => 31.2300, std.dev.: 0.0709) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0243, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0138) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0137) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0049) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: 26.09% (0.0920 => 0.1160, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 17.29% (1.8281 => 2.1441, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 16.13% (1.8601 => 2.1601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 16.12% (1.8361 => 2.1321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 16.07% (1.9161 => 2.2241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.73% (2.1361 => 2.4722, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.56% (1.8761 => 2.1681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.38% (2.0281 => 2.3401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.22% (1.8921 => 2.1801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.01% (1.9721 => 2.2681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.96% (1.9521 => 2.2441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.43% (1.9121 => 2.1881, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.95% (0.1720 => 0.1960, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.72% (1.9241 => 2.1881, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.64% (2.1121 => 2.4001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.62% (2.1441 => 2.4362, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.09% (1.7721 => 2.0041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.05% (1.8081 => 2.0441, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.92% (1.7961 => 2.0281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.58% (1.8441 => 2.0761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.31% (1.8201 => 2.0441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 12.09% (2.0521 => 2.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.89% (0.7400 => 0.8280, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.80% (2.0681 => 2.3121, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.79% (2.1041 => 2.3521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.50% (1.9481 => 2.1721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.40% (1.8601 => 2.0721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.43% (0.6360 => 0.6960, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.6960 => 1.8160, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.72% (1.8440 => 1.9680, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (6.4800 => 6.8760, std.dev.: 0.0366) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 5.61% (1.7841 => 1.8841, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0220) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.1320 => 1.1920, std.dev.: 0.0136) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0224) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.47% (6.5320 => 6.8240, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.19% (5.8281 => 6.0721, std.dev.: 0.0319) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (9.6042 => 10.0002, std.dev.: 0.0425) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0096) MultiSource/Applications/hbd/hbd: 3.70% (1.7280 => 1.7920, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (6.5360 => 6.7560, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0127) MultiSource/Benchmarks/sim/sim: 3.19% (0.3760 => 0.3880, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3960 => 5.5680, std.dev.: 0.0340) MultiSource/Applications/oggenc/oggenc: 3.18% (7.0524 => 7.2765, std.dev.: 0.0228) MultiSource/Applications/lua/lua: 3.17% (4.7920 => 4.9440, std.dev.: 0.0414) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.04% (1.3160 => 1.3560, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0209) MultiSource/Applications/JM/lencod/lencod: 2.84% (22.2206 => 22.8527, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (16.3003 => 16.7483, std.dev.: 0.0344) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 2.65% (38.6366 => 39.6606, std.dev.: 0.0567) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (10.2283 => 10.4763, std.dev.: 0.0207) MultiSource/Applications/SPASS/SPASS: 2.31% (18.5284 => 18.9565, std.dev.: 0.0526) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 1.35% (19.8291 => 20.0971, std.dev.: 0.0435) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (13.0363 => 13.1883, std.dev.: 0.0350) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.91% (2.1201 => 2.4362, std.dev.: 0.0442) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.94% (6.5964 => 6.7244, std.dev.: 0.0301) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.72% (3.9442 => 4.0122, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9684 => 6.0684, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.28% (3.7442 => 3.7922, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.73% (2.9562 => 0.6880, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: -4.90% (1.8760 => 1.7840, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.81% (94.8339 => 49.4951, std.dev.: 10.2402) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.50% (49.9431 => 33.2141, std.dev.: 0.1290) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.42% (25.7136 => 17.1211, std.dev.: 0.1044) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.1083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.74% (37.0863 => 28.6538, std.dev.: 0.3764) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 09:43:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 11:43:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140408164346.95A542A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24419?compare_to=24412&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24419, Order: 205755, Start Time: 2014-04-08 11:57:03, End Time: 2014-04-08 16:50:08 To: 24412, Order: 205753, Start Time: 2014-04-08 07:01:26, End Time: 2014-04-08 11:53:28 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (158 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/casts: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.88% (1.6680 => 1.7160, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.50% (1.0641 => 1.0801, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0084) MultiSource/Applications/obsequi/Obsequi: 1.73% (2.0841 => 2.1201, std.dev.: 0.0128) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1950.00% (0.0320 => 0.6560, std.dev.: 0.0104) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0112) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 395.28% (0.2520 => 1.2481, std.dev.: 0.0109) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 277.63% (0.2320 => 0.8761, std.dev.: 0.0090) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0072) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0066) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0057) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0031) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0063) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/ary3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 25.32% (1.2481 => 1.5641, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: 22.99% (1.3920 => 1.7120, std.dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.00% (1.2841 => 1.5281, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.53% (1.1441 => 1.3561, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0137) MultiSource/Applications/JM/ldecod/ldecod: 18.51% (8.5802 => 10.1683, std.dev.: 0.0400) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 16.07% (0.4480 => 0.5200, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 16.00% (0.1000 => 0.1160, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 15.68% (19.5406 => 22.6047, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (5.3360 => 6.0961, std.dev.: 0.0335) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.26% (1.7400 => 1.9360, std.dev.: 0.0232) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: 9.87% (11.3843 => 12.5083, std.dev.: 0.0237) MultiSource/Applications/oggenc/oggenc: 9.17% (6.2844 => 6.8604, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.52% (5.7280 => 6.2160, std.dev.: 0.0285) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.6680 => 6.1480, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.02% (0.6480 => 0.7000, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (11.4440 => 12.3400, std.dev.: 0.0631) MultiSource/Applications/viterbi/viterbi: 7.55% (0.2120 => 0.2280, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0074) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.88% (0.8721 => 0.9321, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.51% (9.5802 => 10.2042, std.dev.: 0.0378) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.7640 => 0.8120, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.23% (1.4760 => 1.5680, std.dev.: 0.0205) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 5.24% (1.0680 => 1.1240, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (6.8280 => 7.1400, std.dev.: 0.0177) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.22% (1.2320 => 1.2840, std.dev.: 0.0163) MultiSource/Applications/lua/lua: 3.52% (4.7720 => 4.9400, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (2.2081 => 2.2841, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists1: 3.30% (0.3640 => 0.3760, std.dev.: 0.0045) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (1.3400 => 1.3840, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3840 => 5.5560, std.dev.: 0.0471) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.13% (49.1529 => 50.6929, std.dev.: 0.1279) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: 2.96% (19.2243 => 19.7924, std.dev.: 0.0639) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.66% (1.0521 => 1.0801, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 2.62% (24.7575 => 25.4055, std.dev.: 0.0289) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.51% (1.4320 => 1.4680, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.7600 => 1.8040, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: 1.71% (39.0726 => 39.7406, std.dev.: 0.0554) MultiSource/Applications/kimwitu++/kc: 1.62% (19.7491 => 20.0691, std.dev.: 0.0422) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.15% (29.3298 => 29.6659, std.dev.: 0.0588) MultiSource/Applications/SPASS/SPASS: 1.04% (18.7966 => 18.9926, std.dev.: 0.0410) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 => 0.3200, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.08% (0.5920 => 0.6280, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 2.76% (6.8204 => 7.0084, std.dev.: 0.0304) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.3085 => 7.4685, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.87% (4.0563 => 4.1323, std.dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (1.2961 => 1.3161, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -5.74% (11.0207 => 10.3886, std.dev.: 0.1023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.60% (5.2763 => 4.9283, std.dev.: 0.0920) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -2.00% (4.9963 => 4.8963, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0294) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 10:14:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 12:14:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408171441.CDF7D2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24420?compare_to=24414&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24420, Order: 205757, Start Time: 2014-04-08 12:35:57, End Time: 2014-04-08 17:21:03 To: 24414, Order: 205755, Start Time: 2014-04-08 11:02:35, End Time: 2014-04-08 15:48:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (103 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 42.86% (0.0560 => 0.0800, std.dev.: 0.0050) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 19.35% (0.1240 => 0.1480, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 4.82% (0.3320 => 0.3480, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.85% (1.5440 => 1.5880, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.13% (1.3161 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.27% (1.2561 => 1.2721, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 12.50% (0.0960 => 0.1080, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.89% (0.3040 => 0.3280, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists1: 7.69% (0.2600 => 0.2800, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0069) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.98% (0.3280 => 0.3640, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0402) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (10.6960 => 11.3360, std.dev.: 0.0589) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.7080 => 1.7840, std.dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (10.4082 => 10.8282, std.dev.: 0.0265) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0380) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/football/football: 3.80% (0.9480 => 0.9840, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0379) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0336) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0345) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9245, std.dev.: 0.0617) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0504) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0284) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.97% (48.1088 => 49.0570, std.dev.: 0.0719) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0166) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0112) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0368) MultiSource/Applications/kimwitu++/kc: 1.21% (18.8170 => 19.0450, std.dev.: 0.0594) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 5.35% (6.6564 => 7.0124, std.dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0090) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0196) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0026) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -15.91% (0.1760 => 0.1480, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -6.20% (10.8967 => 10.2206, std.dev.: 0.1357) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.05% (3.3482 => 3.1122, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 10:25:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 12:25:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408172534.4299F2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24421?compare_to=24420&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24421, Order: 205758, Start Time: 2014-04-08 12:42:38, End Time: 2014-04-08 17:31:54 To: 24420, Order: 205757, Start Time: 2014-04-08 12:35:57, End Time: 2014-04-08 17:21:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (96 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (1002 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2006-02-04-DivRem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/factor: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 4.90% (0.4080 => 0.4280, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 4.20% (1.6200 => 1.6880, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.45% (0.4640 => 0.4800, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 2.51% (0.7960 => 0.8160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.52% (1.3121 => 1.3321, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.05% (0.1680 => 0.2000, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -41.67% (0.0480 => 0.0280, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.50% (0.1600 => 0.1880, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.62% (1.1601 => 1.2601, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0688) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0447) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0244) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0246) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0265) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.4120 => 0.4280, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0260) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0377) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0201) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0488) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.7360 => 1.7880, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0419) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0304) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 2.02% (37.0925 => 37.8406, std.dev.: 0.0860) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0121) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.95% (48.1088 => 49.0450, std.dev.: 0.0807) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0628) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0810, std.dev.: 0.0447) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (0.9561 => 0.9681, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0474) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0083) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -4.52% (10.8967 => 10.4047, std.dev.: 0.1053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 10:42:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 12:42:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408174220.040202A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24422?compare_to=24421&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24422, Order: 205760, Start Time: 2014-04-08 13:03:08, End Time: 2014-04-08 17:48:42 To: 24421, Order: 205758, Start Time: 2014-04-08 12:42:38, End Time: 2014-04-08 17:31:54 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (88 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (1007 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_member: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.76% (0.2720 => 0.3040, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3400 => 0.3560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.86% (1.2601 => 1.2961, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.77% (4.9840 => 5.0720, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.55% (1.2881 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.09% (1.4681 => 1.4841, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 57.14% (0.0280 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 11.11% (0.1800 => 0.2000, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0455) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.3160 => 0.3360, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0773) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0225) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (10.4082 => 10.8362, std.dev.: 0.0340) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.05% (0.9880 => 1.0280, std.dev.: 0.0147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (8.1441 => 8.4641, std.dev.: 0.0508) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (4.9000 => 5.0720, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0535) MultiSource/Applications/JM/lencod/lencod: 2.97% (17.6165 => 18.1405, std.dev.: 0.0529) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (7.8562 => 8.0842, std.dev.: 0.0374) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0475) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.4400 => 1.4720, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9086, std.dev.: 0.0606) MultiSource/Applications/sqlite3/sqlite3: 2.02% (23.7574 => 24.2375, std.dev.: 0.0668) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0158) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.84% (48.1088 => 48.9929, std.dev.: 0.0934) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 1.36% (18.8170 => 19.0730, std.dev.: 0.0472) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 11.11% (0.1800 => 0.2000, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 4.63% (6.6564 => 6.9644, std.dev.: 0.0356) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.26% (3.5322 => 3.6122, std.dev.: 0.0238) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (4.0643 => 4.1123, std.dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -4.70% (10.8967 => 10.3846, std.dev.: 0.1406) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 11:04:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 13:04:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408180415.BDDAB2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24423?compare_to=24422&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24423, Order: 205761, Start Time: 2014-04-08 13:23:10, End Time: 2014-04-08 18:10:35 To: 24422, Order: 205760, Start Time: 2014-04-08 13:03:08, End Time: 2014-04-08 17:48:42 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (107 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-07-17-INT-To-FP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-31-CastToBool: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 60.00% (0.0200 => 0.0320, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.43% (0.2120 => 0.2320, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.2880 => 0.3040, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 3.49% (0.3440 => 0.3560, std.dev.: 0.0036) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.98% (1.2080 => 1.2440, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.65% (0.9041 => 0.9281, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 7.08% (3.9002 => 4.1763, std.dev.: 0.0797) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 6.45% (1.2401 => 1.3201, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.40% (4.4923 => 4.6003, std.dev.: 0.0309) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0158) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.41% (0.8561 => 0.9281, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.47% (10.6960 => 11.3880, std.dev.: 0.0811) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0157) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0112) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0351) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (10.4082 => 10.8162, std.dev.: 0.0423) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 3.16% (17.6165 => 18.1725, std.dev.: 0.0381) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0446) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0407) MultiSource/Benchmarks/Bullet/bullet: 2.18% (37.0925 => 37.9005, std.dev.: 0.0777) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 1.97% (23.7574 => 24.2255, std.dev.: 0.0509) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0209, std.dev.: 0.0693) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0810, std.dev.: 0.0321) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0594) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0165) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.13% (4.5043 => 4.6003, std.dev.: 0.0309) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.83% (1.0921 => 1.1121, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -4.92% (10.8967 => 10.3606, std.dev.: 0.0514) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 13:35:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 15:35:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408203508.58E952A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24424?compare_to=24423&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24424, Order: 205772, Start Time: 2014-04-08 15:56:24, End Time: 2014-04-08 20:41:29 To: 24423, Order: 205761, Start Time: 2014-04-08 13:23:10, End Time: 2014-04-08 18:10:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (93 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Bubblesort: 66.67% (0.0240 => 0.0400, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.28% (0.6760 => 0.7320, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.98% (0.7040 => 0.7320, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.81% (1.3241 => 1.3481, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.94% (0.2560 => 0.2840, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.14% (3.9522 => 4.0763, std.dev.: 0.0341) MultiSource/Benchmarks/Olden/bisort/bisort: 1.65% (0.7280 => 0.7400, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -80.00% (0.0200 => 0.0040, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.00% (0.4400 => 0.4840, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (10.6960 => 11.3640, std.dev.: 0.0675) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0080) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.39% (1.1880 => 1.2520, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0198) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0583) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0382) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0188) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0424) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 3.32% (17.6165 => 18.2005, std.dev.: 0.0426) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0533) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0329) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0313) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0339) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9085, std.dev.: 0.0411) MultiSource/Applications/sqlite3/sqlite3: 2.02% (23.7574 => 24.2375, std.dev.: 0.0485) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0115) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.89% (48.1088 => 49.0169, std.dev.: 0.1130) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0850, std.dev.: 0.0382) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0340) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 4.63% (6.6564 => 6.9644, std.dev.: 0.0482) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0107) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -4.26% (10.8967 => 10.4327, std.dev.: 0.0594) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 14:27:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 16:27:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140408212752.921D52A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24425?compare_to=24415&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24425, Order: 205773, Start Time: 2014-04-08 16:45:11, End Time: 2014-04-08 21:34:14 To: 24415, Order: 205755, Start Time: 2014-04-08 11:47:41, End Time: 2014-04-08 16:36:37 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 42.86% (0.0560 => 0.0800, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0039) MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.54% (0.3280 => 0.3560, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3600 => 0.3720, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.03% (0.3960 => 0.4080, std.dev.: 0.0040) MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.71% (1.4040 => 1.4280, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.83% (1.7441 => 1.7121, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.38% (0.5040 => 0.4920, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 14:29:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 16:29:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140408212941.47C612A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24426?compare_to=24416&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24426, Order: 205773, Start Time: 2014-04-08 16:46:34, End Time: 2014-04-08 21:36:05 To: 24416, Order: 205755, Start Time: 2014-04-08 11:48:45, End Time: 2014-04-08 16:38:10 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 18 (149 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/2007-04-10-BitfieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/stmtexpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/rem: 17.24% (0.1160 => 0.1360, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 9.38% (0.1280 => 0.1400, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3600 => 0.3760, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.60% (0.6160 => 0.6320, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.48% (1.6161 => 1.6561, std.dev.: 0.0085) MultiSource/Applications/siod/siod: 1.30% (2.7642 => 2.8002, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.18% (1.6881 => 1.7081, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.42% (1.1241 => 1.1401, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.63% (11.3687 => 31.2220, std.dev.: 0.1089) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0072) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0111) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0024) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2002-05-02-CastTest2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.36% (1.0240 => 1.2120, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 13.51% (0.1480 => 0.1680, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.45% (1.8161 => 2.0241, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.84% (0.3320 => 0.3680, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.69% (1.4961 => 1.6561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.05% (1.5521 => 1.7081, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.95% (1.6081 => 1.7681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.92% (1.6121 => 1.7721, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.42% (1.5281 => 1.6721, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/distray/distray: 9.38% (0.1280 => 0.1400, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.20% (1.6521 => 1.8041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.03% (0.6200 => 0.6760, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.68% (1.6121 => 1.7521, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.64% (0.3240 => 0.3520, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (1.0240 => 1.1120, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.34% (1.5801 => 1.6961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (6.4680 => 6.9160, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.90% (0.3480 => 0.3720, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0141) SingleSource/Regression/C/bigstack: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 6.38% (1.1280 => 1.2000, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.09% (1.1160 => 1.1840, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (11.6440 => 12.3360, std.dev.: 0.0534) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.8881 => 0.9361, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (2.0440 => 2.1520, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (9.4842 => 9.9842, std.dev.: 0.0414) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0308) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0281) MultiSource/Applications/spiff/spiff: 5.16% (1.0080 => 1.0600, std.dev.: 0.0195) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (1.7921 => 1.8841, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 5.06% (10.0443 => 10.5523, std.dev.: 0.0436) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.7400 => 1.8280, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (5.8121 => 6.0961, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.80% (1.5841 => 1.6601, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 4.54% (21.9606 => 22.9568, std.dev.: 0.0547) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (6.5080 => 6.7680, std.dev.: 0.0323) MultiSource/Applications/oggenc/oggenc: 3.78% (6.9844 => 7.2485, std.dev.: 0.0143) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.65% (50.0290 => 51.8570, std.dev.: 0.1138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (6.5440 => 6.7720, std.dev.: 0.0547) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (5.3600 => 5.5440, std.dev.: 0.0522) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0221) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0155) MultiSource/Applications/SPASS/SPASS: 3.30% (18.4404 => 19.0484, std.dev.: 0.0345) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.30% (0.3640 => 0.3760, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 3.27% (38.4046 => 39.6606, std.dev.: 0.0765) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0081) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0379) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 2.98% (19.0444 => 19.6124, std.dev.: 0.0280) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 2.50% (0.4800 => 0.4920, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 2.40% (19.6891 => 20.1611, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (16.3483 => 16.7203, std.dev.: 0.0596) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.1200 => 0.1400, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.65% (2.1401 => 2.4322, std.dev.: 0.0557) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0377) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.54% (4.5603 => 4.6763, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.11% (3.9842 => 4.0283, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: -5.35% (1.8680 => 1.7680, std.dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.20% (91.8497 => 49.4151, std.dev.: 10.4327) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.17% (26.0616 => 17.1571, std.dev.: 0.1689) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.11% (50.3031 => 33.1461, std.dev.: 0.1624) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.73% (42.1466 => 28.7738, std.dev.: 0.5040) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1113) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (1.3761 => 1.3521, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0124) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 14:38:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 16:38:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140408213811.0BEF82A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24427?compare_to=24417&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24427, Order: 205773, Start Time: 2014-04-08 16:53:07, End Time: 2014-04-08 21:44:34 To: 24417, Order: 205755, Start Time: 2014-04-08 11:53:10, End Time: 2014-04-08 16:44:39 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (138 on baseline) Performance Improvements: 4 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-31-CastToBool: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.58% (0.1920 => 0.2200, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.38% (0.1280 => 0.1400, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/nestedloop: 3.16% (1.0121 => 1.0441, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3840 => 0.3960, std.dev.: 0.0044) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.60% (1.3840 => 1.4200, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/treeadd/treeadd: 20.00% (0.2000 => 0.2400, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.23% (0.3320 => 0.3560, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 4.29% (2.6122 => 2.7242, std.dev.: 0.0257) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) SingleSource/UnitTests/2003-08-05-CastFPToUint: -37.50% (0.0320 => 0.0200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.53% (2.0921 => 2.0601, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.5482 => 3.5042, std.dev.: 0.0151) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0106) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/exptree: 26.09% (0.0920 => 0.1160, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.04% (1.6881 => 2.0601, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.63% (1.7201 => 2.0921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.33% (1.7441 => 2.1161, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.29% (1.6721 => 2.0281, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.11% (1.8001 => 2.1801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.99% (1.6961 => 2.0521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.76% (1.7921 => 2.1641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.71% (1.6801 => 2.0281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.62% (1.8041 => 2.1761, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.34% (1.8881 => 2.2721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.69% (1.8281 => 2.1881, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.57% (0.1840 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.08% (1.9081 => 2.2721, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.03% (1.9761 => 2.3521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0129) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.67% (0.1200 => 0.1400, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: 8.63% (1.0200 => 1.1080, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.95% (0.7480 => 0.8000, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.7800 => 0.8320, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.63% (0.7840 => 0.8360, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.19% (6.7200 => 7.1360, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (11.7880 => 12.4840, std.dev.: 0.0776) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.42% (2.0680 => 2.1800, std.dev.: 0.0158) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.61% (9.9842 => 10.4442, std.dev.: 0.0299) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.44% (0.7200 => 0.7520, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 4.34% (4.7920 => 5.0000, std.dev.: 0.0234) MultiSource/Applications/d/make_dparser: 4.14% (3.9641 => 4.1281, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 3.99% (6.9124 => 7.1884, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.86% (1.0361 => 1.0761, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.1440 => 1.1880, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 3.41% (10.3203 => 10.6723, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (6.8321 => 7.0641, std.dev.: 0.0487) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (2.0440 => 2.1120, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 3.20% (18.4924 => 19.0846, std.dev.: 0.0718) MultiSource/Applications/JM/lencod/lencod: 3.18% (22.6287 => 23.3488, std.dev.: 0.0540) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.89% (1.1080 => 1.1400, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (4.2203 => 4.3363, std.dev.: 0.0102) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.65% (51.1089 => 52.4649, std.dev.: 0.0554) MultiSource/Benchmarks/Bullet/bullet: 2.48% (38.9366 => 39.9006, std.dev.: 0.0876) MultiSource/Applications/kimwitu++/kc: 2.39% (19.7371 => 20.2091, std.dev.: 0.0488) MultiSource/Applications/minisat/minisat: 2.34% (0.8560 => 0.8760, std.dev.: 0.0074) MultiSource/Applications/ClamAV/clamscan: 2.31% (20.2445 => 20.7125, std.dev.: 0.0691) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.5963 => 16.9523, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.93% (6.0244 => 6.1404, std.dev.: 0.0201) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0099) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (29.4578 => 29.8499, std.dev.: 0.0490) MultiSource/Applications/sqlite3/sqlite3: 1.30% (25.1895 => 25.5175, std.dev.: 0.0376) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.56% (3.4842 => 3.6082, std.dev.: 0.0392) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.49% (0.3440 => 0.3560, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 2.87% (6.8204 => 7.0164, std.dev.: 0.0433) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.85% (4.7563 => 4.8443, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0199) MultiSource/Applications/lua/lua: 1.63% (21.6534 => 22.0054, std.dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 1.22% (7.5485 => 7.6405, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.69% (6.2884 => 1.3401, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/nestedloop: -64.78% (2.9642 => 1.0441, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0089) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0187) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.38% (7.4801 => 6.1800, std.dev.: 0.0537) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.26% (7.5041 => 6.2840, std.dev.: 0.0412) SingleSource/Regression/C/sumarray2d: -11.17% (0.7160 => 0.6360, std.dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: -3.37% (10.9087 => 10.5407, std.dev.: 0.1005) MultiSource/Benchmarks/mafft/pairlocalalign: -2.43% (13.5243 => 13.1963, std.dev.: 0.0268) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -28.57% (0.0560 => 0.0400, std.dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.39% (5.8884 => 5.5123, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -2.40% (5.1603 => 5.0363, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: -1.64% (8.3085 => 8.1725, std.dev.: 0.0513) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.5522 => 3.5042, std.dev.: 0.0151) MultiSource/Applications/hexxagon/hexxagon: -1.10% (11.6527 => 11.5247, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 14:43:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 16:43:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140408214331.3FCDE2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24428?compare_to=24418&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24428, Order: 205773, Start Time: 2014-04-08 16:57:08, End Time: 2014-04-08 21:49:54 To: 24418, Order: 205755, Start Time: 2014-04-08 11:55:53, End Time: 2014-04-08 16:48:35 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 23 (138 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1088 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-09-18-BitFieldTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 200.00% (0.0080 => 0.0240, std.dev.: 0.0049) SingleSource/Regression/C/testtrace: 100.00% (0.0160 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/nestedloop: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 29.17% (0.0960 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.90% (0.3480 => 0.3720, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.08% (0.2360 => 0.2480, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.48% (0.8040 => 0.8400, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.02% (1.5880 => 1.6200, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 1.96% (1.8401 => 1.8761, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.00% (2.7962 => 2.8242, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.33% (0.3000 => 0.3280, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.73% (1.1001 => 1.1961, std.dev.: 0.0183) MultiSource/Benchmarks/nbench/nbench: 5.72% (17.3291 => 18.3211, std.dev.: 0.3216) MultiSource/Benchmarks/llubenchmark/llu: 4.29% (5.1283 => 5.3483, std.dev.: 0.0850) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.79% (2.4362 => 2.5042, std.dev.: 0.0192) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.04% (2.3001 => 2.2761, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.57% (17.6723 => 19.7163, std.dev.: 0.0497) MultiSource/Applications/sqlite3/sqlite3: 1417.89% (1.7001 => 25.8056, std.dev.: 0.0476) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.70% (50.1010 => 51.9530, std.dev.: 0.1151) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (11.3920 => 12.3080, std.dev.: 0.0727) SingleSource/Benchmarks/Misc/oourafft: 175.45% (11.3407 => 31.2380, std.dev.: 0.0965) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0563, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0107) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0160 => 0.0480, std.dev.: 0.0031) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 200.00% (0.0080 => 0.0240, std.dev.: 0.0049) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C/testtrace: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 55.56% (0.0360 => 0.0560, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/ary3: 31.25% (0.0640 => 0.0840, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.36% (2.1361 => 2.4642, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.19% (2.0281 => 2.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.01% (1.8921 => 2.1761, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.97% (1.9241 => 2.2121, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.87% (1.7721 => 2.0001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.08% (1.9201 => 2.1521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.09% (1.9481 => 2.1641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0144) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.71% (0.3360 => 0.3720, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0053) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (1.0880 => 1.1760, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 7.09% (1.0160 => 1.0880, std.dev.: 0.0213) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.78% (0.2360 => 0.2520, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.60% (0.7880 => 0.8400, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (6.4800 => 6.8800, std.dev.: 0.0401) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0211) MultiSource/Benchmarks/nbench/nbench: 5.87% (1.7721 => 1.8761, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.84% (0.6160 => 0.6520, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.68% (0.7040 => 0.7440, std.dev.: 0.0143) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.28% (1.2120 => 1.2760, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.6960 => 1.7840, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.78% (6.5320 => 6.8440, std.dev.: 0.0361) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0266) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (9.6042 => 10.0482, std.dev.: 0.0353) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0157) MultiSource/Applications/minisat/minisat: 4.25% (0.8480 => 0.8840, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.19% (5.8281 => 6.0721, std.dev.: 0.0426) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (6.5360 => 6.7720, std.dev.: 0.0399) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (2.1240 => 2.2000, std.dev.: 0.0160) MultiSource/Applications/lua/lua: 3.42% (4.7920 => 4.9560, std.dev.: 0.0359) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.31% (0.4840 => 0.5000, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: 3.24% (1.7280 => 1.7840, std.dev.: 0.0206) MultiSource/Applications/oggenc/oggenc: 3.23% (7.0524 => 7.2805, std.dev.: 0.0190) MultiSource/Applications/JM/lencod/lencod: 2.90% (22.2206 => 22.8648, std.dev.: 0.0581) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.79% (1.5760 => 1.6200, std.dev.: 0.0116) MultiSource/Applications/treecc/treecc: 2.78% (2.5880 => 2.6600, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (16.3003 => 16.7483, std.dev.: 0.0498) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.3960 => 5.5440, std.dev.: 0.0512) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 2.58% (38.6366 => 39.6326, std.dev.: 0.0763) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2243 => 4.3243, std.dev.: 0.0124) MultiSource/Applications/SPASS/SPASS: 2.27% (18.5284 => 18.9485, std.dev.: 0.0532) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0127) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (10.2283 => 10.4483, std.dev.: 0.0363) MultiSource/Applications/kimwitu++/kc: 1.47% (19.8291 => 20.1211, std.dev.: 0.0567) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7842 => 2.8242, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.12% (2.1201 => 2.5042, std.dev.: 0.0192) MultiSource/Benchmarks/llubenchmark/llu: 5.69% (5.0603 => 5.3483, std.dev.: 0.0850) MultiSource/Applications/siod/siod: 5.03% (2.8642 => 3.0082, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.62% (1.6561 => 1.7161, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.18% (6.5964 => 6.7404, std.dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0012) MultiSource/Applications/obsequi/Obsequi: 1.76% (2.0441 => 2.0801, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.32% (2.9562 => 0.7000, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0084) MultiSource/Applications/obsequi/Obsequi: -6.18% (1.8760 => 1.7600, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.19% (94.8339 => 49.1351, std.dev.: 10.3015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.14% (49.9431 => 32.8901, std.dev.: 0.2041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.62% (25.7136 => 17.0691, std.dev.: 0.1549) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.79% (37.0863 => 28.2618, std.dev.: 0.4796) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.66% (3.0722 => 2.3761, std.dev.: 0.1032) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.68% (1.2681 => 1.1961, std.dev.: 0.0183) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 14:45:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 16:45:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140408214534.C06662A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24429?compare_to=24419&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24429, Order: 205773, Start Time: 2014-04-08 16:58:34, End Time: 2014-04-08 21:51:57 To: 24419, Order: 205755, Start Time: 2014-04-08 11:57:03, End Time: 2014-04-08 16:50:08 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 12 (153 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 57.14% (0.0280 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/misr: 16.67% (0.0720 => 0.0840, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 8.62% (0.2320 => 0.2520, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.06% (0.2640 => 0.2800, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (1.4081 => 1.4241, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.83% (0.0960 => 0.1160, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0094) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 395.28% (0.2520 => 1.2481, std.dev.: 0.0132) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 277.63% (0.2320 => 0.8761, std.dev.: 0.0092) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0061) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Regression/C/matrixTranspose: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 34.62% (0.1040 => 0.1400, std.dev.: 0.0088) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/misr: 31.25% (0.0640 => 0.0840, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0124) MultiSource/Applications/obsequi/Obsequi: 21.55% (1.3920 => 1.6920, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.12% (1.1361 => 1.3761, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.45% (1.2521 => 1.5081, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (1.3681 => 1.6361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.00% (1.2841 => 1.5281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 18.79% (8.5802 => 10.1923, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.51% (1.1881 => 1.3961, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 16.00% (0.1000 => 0.1160, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 15.96% (0.3760 => 0.4360, std.dev.: 0.0173) MultiSource/Applications/JM/lencod/lencod: 15.66% (19.5406 => 22.6007, std.dev.: 0.0401) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0102) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.47% (5.3360 => 6.1081, std.dev.: 0.0286) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0176) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 10.53% (0.2280 => 0.2520, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (11.3843 => 12.4803, std.dev.: 0.0306) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 9.04% (6.2844 => 6.8524, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 8.50% (0.6120 => 0.6640, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.21% (11.4440 => 12.3840, std.dev.: 0.0483) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0050) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.41% (5.6680 => 6.0880, std.dev.: 0.0492) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.98% (5.7280 => 6.1280, std.dev.: 0.0542) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (9.5802 => 10.2442, std.dev.: 0.0442) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 4.96% (1.0480 => 1.1000, std.dev.: 0.0157) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.53% (1.3240 => 1.3840, std.dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 4.44% (4.7720 => 4.9840, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/lists1: 4.40% (0.3640 => 0.3800, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.1480 => 1.1960, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7600 => 1.8240, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (6.8280 => 7.0680, std.dev.: 0.0358) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0078) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.22% (49.1529 => 50.7369, std.dev.: 0.0898) MultiSource/Applications/ClamAV/clamscan: 3.06% (19.2243 => 19.8124, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.7320 => 1.7840, std.dev.: 0.0183) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (5.3840 => 5.5360, std.dev.: 0.0508) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: 2.47% (24.7575 => 25.3695, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.28% (1.0521 => 1.0761, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 1.76% (39.0726 => 39.7606, std.dev.: 0.0582) MultiSource/Applications/kimwitu++/kc: 1.60% (19.7491 => 20.0651, std.dev.: 0.0575) MultiSource/Applications/siod/siod: 1.31% (2.7562 => 2.7922, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0124 => 6.0884, std.dev.: 0.0216) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (29.3298 => 29.6259, std.dev.: 0.0519) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.81% (1.2401 => 1.4361, std.dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 2.87% (6.8204 => 7.0164, std.dev.: 0.0310) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.3085 => 7.4725, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4041 => 1.4241, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -4.97% (11.0207 => 10.4727, std.dev.: 0.1329) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0813) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: -1.76% (4.9963 => 4.9083, std.dev.: 0.0125) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0213) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 15:10:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 17:10:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408221055.5FEC82A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24430?compare_to=24424&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24430, Order: 205777, Start Time: 2014-04-08 17:32:45, End Time: 2014-04-08 22:17:16 To: 24424, Order: 205772, Start Time: 2014-04-08 15:56:24, End Time: 2014-04-08 20:41:29 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (90 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/EH/exception_spec_test: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.63% (0.1640 => 0.1880, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.94% (0.3240 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.23% (1.2961 => 1.3121, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.2680 => 0.2840, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.83% (1.2520 => 1.2040, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.83% (0.7320 => 0.7040, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.50% (0.1600 => 0.1880, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.2161 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.78% (0.3680 => 0.4040, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.82% (1.2281 => 1.3241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0314) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.10% (10.6960 => 11.3480, std.dev.: 0.0705) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0154) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0506) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0454) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0246) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (10.4082 => 10.7242, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0477) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0370) MultiSource/Benchmarks/Bullet/bullet: 2.55% (37.0925 => 38.0366, std.dev.: 0.0507) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0310) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (5.8400 => 5.9600, std.dev.: 0.0436) MultiSource/Applications/sqlite3/sqlite3: 1.99% (23.7574 => 24.2295, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0074) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.70% (48.1088 => 48.9249, std.dev.: 0.0977) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0385) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 5.23% (6.6564 => 7.0044, std.dev.: 0.0324) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.26% (3.5322 => 3.6122, std.dev.: 0.0233) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/mason/mason: -21.05% (0.0760 => 0.0600, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -3.82% (10.8967 => 10.4807, std.dev.: 0.1224) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0074) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 15:51:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 17:51:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408225151.C865F2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24431?compare_to=24430&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24431, Order: 205778, Start Time: 2014-04-08 18:14:01, End Time: 2014-04-08 22:58:11 To: 24430, Order: 205777, Start Time: 2014-04-08 17:32:45, End Time: 2014-04-08 22:17:16 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 19 (93 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (1000 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) MultiSource/Applications/aha/aha: 18.52% (0.1080 => 0.1280, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 7.35% (0.2720 => 0.2920, std.dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.93% (0.4040 => 0.4320, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 5.88% (0.4080 => 0.4320, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4360 => 0.4560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 4.23% (0.2840 => 0.2960, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 1.59% (3.7801 => 3.8401, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.28% (1.2521 => 1.2681, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.04% (1.1560 => 1.1680, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.1200 => 0.1400, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 13.51% (0.2960 => 0.3360, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4681 => 1.4841, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0362) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0671) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0232) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0342) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0181) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0216) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0337) MultiSource/Applications/JM/lencod/lencod: 3.11% (17.6165 => 18.1645, std.dev.: 0.0393) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (4.9200 => 5.0360, std.dev.: 0.0421) MultiSource/Benchmarks/Bullet/bullet: 2.33% (37.0925 => 37.9565, std.dev.: 0.0651) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0306) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0445) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0400) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0031) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.74% (48.1088 => 48.9449, std.dev.: 0.0935) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0152) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 1.08% (18.8170 => 19.0210, std.dev.: 0.0650) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 5.99% (1.1361 => 1.2041, std.dev.: 0.0219) MultiSource/Applications/minisat/minisat: 4.51% (6.6564 => 6.9564, std.dev.: 0.0450) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/lists: 2.68% (5.8164 => 5.9724, std.dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.08% (21.1533 => 21.3813, std.dev.: 0.0711) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0538) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -5.03% (10.8967 => 10.3486, std.dev.: 0.1288) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.89% (1.2601 => 1.1481, std.dev.: 0.0199) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 16:05:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 18:05:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408230515.9DA4D2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24432?compare_to=24431&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24432, Order: 205779, Start Time: 2014-04-08 18:23:52, End Time: 2014-04-08 23:11:36 To: 24431, Order: 205778, Start Time: 2014-04-08 18:14:01, End Time: 2014-04-08 22:58:11 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (99 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C/matrixTranspose: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/rem: 10.00% (0.1200 => 0.1320, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.23% (0.7560 => 0.7880, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (1.1160 => 1.1520, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.57% (5.9160 => 6.0680, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.23% (1.2961 => 1.3121, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 21.74% (0.0920 => 0.1120, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/strcat: 8.82% (0.1360 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.69% (5.3483 => 5.4923, std.dev.: 0.0537) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -19.23% (0.1040 => 0.0840, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.66% (1.1481 => 1.2361, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.02% (1.1961 => 1.2801, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0648) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0403) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0217) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (5.8000 => 6.0680, std.dev.: 0.0225) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0123) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0292) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (8.1441 => 8.4521, std.dev.: 0.0526) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0547) MultiSource/Benchmarks/Bullet/bullet: 2.55% (37.0925 => 38.0366, std.dev.: 0.0573) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (4.9200 => 5.0360, std.dev.: 0.0331) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0492) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0082) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.77% (48.1088 => 48.9609, std.dev.: 0.0810) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: 1.30% (18.8170 => 19.0610, std.dev.: 0.0407) MultiSource/Applications/SPASS/SPASS: 1.25% (17.5484 => 17.7684, std.dev.: 0.0268) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0295) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.58% (0.9601 => 1.0041, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0073) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0140) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0159) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (5.0123 => 5.1243, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0390) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -55.56% (0.0360 => 0.0160, std.dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -5.54% (10.8967 => 10.2926, std.dev.: 0.1522) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.70% (2.0561 => 1.9801, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0233) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/ary3: -1.13% (3.5362 => 3.4962, std.dev.: 0.0142) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 16:19:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 18:19:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140408231913.58FA92A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24433?compare_to=24432&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24433, Order: 205780, Start Time: 2014-04-08 18:38:03, End Time: 2014-04-08 23:25:35 To: 24432, Order: 205779, Start Time: 2014-04-08 18:23:52, End Time: 2014-04-08 23:11:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (89 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (1004 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/FloatPrecision: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/ccc: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0560 => 0.0680, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 13.64% (0.1760 => 0.2000, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.73% (0.2200 => 0.2480, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash2: 4.20% (0.4760 => 0.4960, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: 2.80% (10.2926 => 10.5807, std.dev.: 0.0753) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.59% (0.4640 => 0.4760, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (8.4521 => 8.5401, std.dev.: 0.0286) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/ary3: 1.14% (3.4962 => 3.5362, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (8.0725 => 8.1605, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0045) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.11% (1.1841 => 1.2801, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2160 => 0.2320, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0628) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0343) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0183) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0495) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0347) MultiSource/Applications/lua/lua: 2.74% (4.5200 => 4.6440, std.dev.: 0.0393) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0322) MultiSource/Benchmarks/Bullet/bullet: 2.18% (37.0925 => 37.9006, std.dev.: 0.0703) MultiSource/Applications/sqlite3/sqlite3: 2.14% (23.7574 => 24.2655, std.dev.: 0.0305) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0384) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.96% (48.1088 => 49.0529, std.dev.: 0.0939) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 1.24% (2.5721 => 2.6041, std.dev.: 0.0103) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 1.23% (18.8170 => 19.0490, std.dev.: 0.0526) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.69% (6.6564 => 6.9684, std.dev.: 0.0309) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0201) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.18% (0.1760 => 0.1440, std.dev.: 0.0122) SingleSource/UnitTests/Vector/constpool: -2.90% (10.8967 => 10.5807, std.dev.: 0.0753) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: -4.90% (0.4080 => 0.3880, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 18:35:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 20:35:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409013513.57CE22A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24434?compare_to=24433&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24434, Order: 205789, Start Time: 2014-04-08 20:57:22, End Time: 2014-04-09 01:41:31 To: 24433, Order: 205780, Start Time: 2014-04-08 18:38:03, End Time: 2014-04-08 23:25:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (99 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/printargs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 40.00% (0.0800 => 0.1120, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.05% (0.0840 => 0.1000, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/health/health: 17.95% (0.1560 => 0.1840, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 6.94% (0.2880 => 0.3080, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 5.94% (0.4040 => 0.4280, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.05% (1.3681 => 1.3961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/obsequi/Obsequi: 1.92% (2.0801 => 2.1201, std.dev.: 0.0139) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.10% (1.2401 => 1.3281, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0300) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (10.6960 => 11.3000, std.dev.: 0.0847) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0401) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0314) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0509) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0193) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (10.4082 => 10.7122, std.dev.: 0.0443) MultiSource/Applications/JM/lencod/lencod: 2.88% (17.6165 => 18.1245, std.dev.: 0.0490) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0357) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0131) MultiSource/Benchmarks/Bullet/bullet: 2.41% (37.0925 => 37.9846, std.dev.: 0.0661) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0440) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0288) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0477) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.80% (48.1088 => 48.9770, std.dev.: 0.0894) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0158) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0810, std.dev.: 0.0464) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0239) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0457) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.94% (3.5322 => 3.6362, std.dev.: 0.0274) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.21% (4.9443 => 5.0043, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -4.63% (10.8967 => 10.3926, std.dev.: 0.1210) MultiSource/Applications/lemon/lemon: -1.44% (1.3841 => 1.3641, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0196) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 19:33:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 21:33:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409023332.499092A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24435?compare_to=24425&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24435, Order: 205802, Start Time: 2014-04-08 21:50:06, End Time: 2014-04-09 02:39:55 To: 24425, Order: 205773, Start Time: 2014-04-08 16:45:11, End Time: 2014-04-08 21:34:14 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 28 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1084 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 7.87% (0.3560 => 0.3840, std.dev.: 0.0099) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.66% (29.6539 => 30.7379, std.dev.: 0.0479) MultiSource/Applications/hbd/hbd: 3.42% (1.7560 => 1.8160, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3560 => 0.3680, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.16% (0.6320 => 0.6520, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.82% (1.7041 => 1.7521, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.82% (6.1084 => 6.2804, std.dev.: 0.0306) MultiSource/Applications/SPASS/SPASS: 2.70% (19.1085 => 19.6248, std.dev.: 0.0339) MultiSource/Applications/sqlite3/sqlite3: 2.50% (25.5736 => 26.2136, std.dev.: 0.0417) MultiSource/Benchmarks/Prolangs-C/football/football: 2.46% (1.1360 => 1.1640, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (16.8723 => 17.2363, std.dev.: 0.0492) MultiSource/Applications/lemon/lemon: 2.11% (1.5161 => 1.5481, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 1.83% (39.8166 => 40.5446, std.dev.: 0.0543) MultiSource/Applications/kimwitu++/kc: 1.78% (20.1731 => 20.5331, std.dev.: 0.0476) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.76% (4.3083 => 4.3843, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.76% (2.0441 => 2.0801, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (13.1043 => 13.3243, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout/nestedloop: 1.43% (1.1161 => 1.1321, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.38% (2.3161 => 2.3481, std.dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: 1.13% (20.5604 => 20.7924, std.dev.: 0.0747) MultiSource/Applications/JM/lencod/lencod: 1.09% (23.4008 => 23.6568, std.dev.: 0.0314) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 11.29% (0.2480 => 0.2760, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0118) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 19:34:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 21:34:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409023440.CBB222A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24436?compare_to=24426&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24436, Order: 205802, Start Time: 2014-04-08 21:51:55, End Time: 2014-04-09 02:41:03 To: 24426, Order: 205773, Start Time: 2014-04-08 16:46:34, End Time: 2014-04-08 21:36:05 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 11 (145 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.00% (0.1000 => 0.1160, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.52% (0.1680 => 0.1840, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (0.9361 => 0.9561, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.69% (1.6601 => 1.6881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.16% (1.7201 => 1.7401, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.1404 => 6.2044, std.dev.: 0.0191) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.00% (0.1000 => 0.1200, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/uuencode/uuencode: -26.67% (0.0600 => 0.0440, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/oggenc/oggenc: -11.11% (0.1440 => 0.1280, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.00% (11.3687 => 31.1499, std.dev.: 0.1398) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0063) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0071) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0031) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 60.00% (0.0400 => 0.0640, std.dev.: 0.0068) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.54% (1.5601 => 1.7401, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.4401 => 1.6041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.05% (1.4841 => 1.6481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.71% (0.1120 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.34% (1.5481 => 1.7081, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0074) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.82% (1.4841 => 1.6001, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.76% (0.2960 => 0.3160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0106) SingleSource/Benchmarks/Linpack/linpack-pc: 6.17% (0.3240 => 0.3440, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.97% (1.5401 => 1.6321, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (1.5480 => 1.6400, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (6.4680 => 6.8480, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (11.6440 => 12.3200, std.dev.: 0.0694) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.36% (0.2240 => 0.2360, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (9.4842 => 9.9922, std.dev.: 0.0526) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.29% (1.4361 => 1.5121, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (5.8121 => 6.1121, std.dev.: 0.0384) MultiSource/Applications/Burg/burg: 5.04% (1.5080 => 1.5840, std.dev.: 0.0292) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/bh/bh: 4.96% (0.4840 => 0.5080, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 4.94% (10.0443 => 10.5403, std.dev.: 0.0358) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 4.45% (21.9606 => 22.9368, std.dev.: 0.0542) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (2.0440 => 2.1320, std.dev.: 0.0247) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (3.0282 => 3.1482, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (6.5080 => 6.7640, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0151) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.91% (50.0290 => 51.9850, std.dev.: 0.0866) MultiSource/Applications/oggenc/oggenc: 3.90% (6.9844 => 7.2565, std.dev.: 0.0149) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (6.5440 => 6.7840, std.dev.: 0.0695) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 3.60% (38.4046 => 39.7886, std.dev.: 0.0761) MultiSource/Applications/treecc/treecc: 3.56% (2.5840 => 2.6760, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.35% (4.1843 => 4.3243, std.dev.: 0.0145) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.7921 => 1.8481, std.dev.: 0.0209) MultiSource/Applications/SPASS/SPASS: 3.10% (18.4404 => 19.0126, std.dev.: 0.0579) MultiSource/Applications/lua/lua: 3.01% (4.7880 => 4.9320, std.dev.: 0.0333) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (16.3483 => 16.7403, std.dev.: 0.0575) MultiSource/Applications/kimwitu++/kc: 2.11% (19.6891 => 20.1051, std.dev.: 0.0719) MultiSource/Applications/ClamAV/clamscan: 2.08% (19.0444 => 19.4404, std.dev.: 0.0780) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.64% (6.1044 => 6.2044, std.dev.: 0.0191) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0331) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.1200 => 0.1400, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.28% (2.1401 => 2.4242, std.dev.: 0.0389) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 5.17% (2.8602 => 3.0082, std.dev.: 0.0292) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.99% (1.0041 => 1.0241, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.56% (6.6684 => 6.7724, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.11% (3.9842 => 4.0283, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.22% (2.9442 => 0.7000, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.36% (1.5641 => 0.6200, std.dev.: 0.0105) MultiSource/Applications/obsequi/Obsequi: -6.21% (1.8680 => 1.7520, std.dev.: 0.0323) SingleSource/UnitTests/Vector/constpool: -1.92% (10.6247 => 10.4207, std.dev.: 0.0787) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.23% (91.8497 => 49.3911, std.dev.: 10.3673) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.75% (26.0616 => 17.0051, std.dev.: 0.0999) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.31% (50.3031 => 33.0421, std.dev.: 0.1961) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.51% (42.1466 => 28.4458, std.dev.: 0.4790) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1093) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.06% (0.3400 => 0.3160, std.dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.31% (2.7442 => 2.7082, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 19:45:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 21:45:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140409024550.535EC2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24437?compare_to=24427&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24437, Order: 205802, Start Time: 2014-04-08 22:01:00, End Time: 2014-04-09 02:52:14 To: 24427, Order: 205773, Start Time: 2014-04-08 16:53:07, End Time: 2014-04-08 21:44:34 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (127 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-09-ArrayResolution: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.08% (0.1040 => 0.1280, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 9.26% (0.2160 => 0.2360, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.4680 => 0.5000, std.dev.: 0.0103) SingleSource/Regression/C/sumarray2d: 3.14% (0.6360 => 0.6560, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/spiff/spiff: 4.83% (2.1521 => 2.2561, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout-C++/ary3: 1.14% (3.5042 => 3.5442, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0085) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0038) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.17% (1.7321 => 2.1161, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.04% (1.6881 => 2.0601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.51% (1.6921 => 2.0561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.99% (1.6961 => 2.0521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.05% (1.6761 => 2.0121, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.82% (1.8361 => 2.2001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.67% (1.7081 => 2.0441, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.31% (1.7401 => 2.0761, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.82% (1.9761 => 2.3481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.24% (1.8201 => 2.1521, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 11.32% (0.2120 => 0.2360, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.11% (0.6120 => 0.6800, std.dev.: 0.0193) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.66% (3.5002 => 3.7682, std.dev.: 0.0153) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3000 => 0.3200, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.19% (6.7200 => 7.1360, std.dev.: 0.0531) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (11.7880 => 12.5040, std.dev.: 0.0650) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0222) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0102) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.75% (1.3480 => 1.4120, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0192) MultiSource/Applications/d/make_dparser: 4.34% (3.9641 => 4.1361, std.dev.: 0.0208) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (9.9842 => 10.4162, std.dev.: 0.0434) MultiSource/Applications/lua/lua: 4.26% (4.7920 => 4.9960, std.dev.: 0.0322) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0172) MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 3.99% (6.9124 => 7.1884, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (1.6481 => 1.7121, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0178) MultiSource/Applications/Burg/burg: 3.33% (1.5600 => 1.6120, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 3.20% (18.4924 => 19.0845, std.dev.: 0.0652) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (6.8321 => 7.0441, std.dev.: 0.0345) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (10.3203 => 10.6363, std.dev.: 0.0383) MultiSource/Applications/JM/lencod/lencod: 3.06% (22.6287 => 23.3208, std.dev.: 0.0621) MultiSource/Applications/treecc/treecc: 2.90% (2.6200 => 2.6960, std.dev.: 0.0267) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.8440 => 0.8680, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.7400 => 0.7600, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 2.68% (38.9366 => 39.9806, std.dev.: 0.0879) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.52% (51.1089 => 52.3969, std.dev.: 0.0963) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 2.15% (19.7371 => 20.1611, std.dev.: 0.0645) MultiSource/Applications/ClamAV/clamscan: 2.05% (20.2445 => 20.6605, std.dev.: 0.0644) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (16.5963 => 16.9323, std.dev.: 0.0522) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (3.0122 => 3.0722, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.79% (6.0244 => 6.1324, std.dev.: 0.0181) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.35% (25.1895 => 25.5295, std.dev.: 0.0682) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.46% (1.2681 => 1.3881, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0488) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (4.2443 => 4.3443, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 1.72% (21.6534 => 22.0254, std.dev.: 0.0714) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0150) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4041 => 1.4201, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.56% (6.2884 => 1.3481, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0091) MultiSource/Applications/obsequi/Obsequi: -32.78% (2.6481 => 1.7800, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.69% (7.4801 => 6.2320, std.dev.: 0.0413) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.94% (7.5041 => 6.3080, std.dev.: 0.0485) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0062) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -4.44% (10.9087 => 10.4247, std.dev.: 0.0962) SingleSource/Benchmarks/Misc/flops: -4.05% (0.2960 => 0.2840, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (13.5243 => 13.1243, std.dev.: 0.0495) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (5.1603 => 5.0403, std.dev.: 0.0213) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: -1.01% (25.7976 => 25.5376, std.dev.: 0.0295) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 19:52:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 21:52:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140409025200.E504C2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24438?compare_to=24428&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24438, Order: 205804, Start Time: 2014-04-08 22:05:42, End Time: 2014-04-09 02:58:24 To: 24428, Order: 205773, Start Time: 2014-04-08 16:57:08, End Time: 2014-04-08 21:49:54 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 5 (130 on baseline) Performance Improvements: 3 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 25.00% (0.0640 => 0.0800, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.59% (0.4640 => 0.4760, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.05% (3.3242 => 3.4922, std.dev.: 0.0507) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.35% (1.1961 => 1.2481, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.00% (0.5000 => 0.4800, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.1521 => 2.1121, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.80% (2.0001 => 1.9641, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.87% (17.6723 => 19.5924, std.dev.: 0.0585) MultiSource/Applications/sqlite3/sqlite3: 1416.95% (1.7001 => 25.7896, std.dev.: 0.0630) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.58% (50.1010 => 51.8930, std.dev.: 0.0649) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.36% (11.3920 => 12.3440, std.dev.: 0.0554) SingleSource/Benchmarks/Misc/oourafft: 175.13% (11.3407 => 31.2020, std.dev.: 0.0968) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0113) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0088) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.83% (1.7721 => 1.9641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.00% (1.9201 => 2.1121, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0089) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0063) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.11% (0.7400 => 0.8000, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.67% (0.2400 => 0.2560, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (6.4800 => 6.8680, std.dev.: 0.0549) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0117) MultiSource/Applications/SIBsim4/SIBsim4: 5.83% (1.7841 => 1.8881, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0125) MultiSource/Applications/Burg/burg: 4.71% (1.5280 => 1.6000, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.5640 => 1.6360, std.dev.: 0.0201) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (5.8281 => 6.0881, std.dev.: 0.0277) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (9.6042 => 10.0322, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (6.5320 => 6.7920, std.dev.: 0.0354) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (2.1240 => 2.2000, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 3.12% (7.0524 => 7.2725, std.dev.: 0.0148) MultiSource/Applications/lua/lua: 3.09% (4.7920 => 4.9400, std.dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 3.03% (38.6366 => 39.8086, std.dev.: 0.0317) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0179) MultiSource/Applications/JM/lencod/lencod: 2.77% (22.2206 => 22.8367, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (16.3003 => 16.7443, std.dev.: 0.0590) MultiSource/Applications/SPASS/SPASS: 2.66% (18.5284 => 19.0206, std.dev.: 0.0484) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.63% (6.5360 => 6.7080, std.dev.: 0.0469) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (10.2283 => 10.4843, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.34% (1.0241 => 1.0481, std.dev.: 0.0070) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 1.19% (19.8291 => 20.0651, std.dev.: 0.0526) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.48% (2.1201 => 2.4482, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: 2.54% (2.0441 => 2.0961, std.dev.: 0.0177) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.94% (6.5964 => 6.7244, std.dev.: 0.0354) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.46% (2.9562 => 0.6960, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0058) MultiSource/Applications/obsequi/Obsequi: -6.40% (1.8760 => 1.7560, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.93% (94.8339 => 49.3791, std.dev.: 10.4992) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.86% (49.9431 => 33.0341, std.dev.: 0.1815) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.35% (25.7136 => 17.1371, std.dev.: 0.1606) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.13% (37.0863 => 28.8778, std.dev.: 0.5723) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.58% (1.2681 => 1.2481, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -1.34% (4.7883 => 4.7243, std.dev.: 0.0091) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 19:54:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 21:54:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140409025431.678C12A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24439?compare_to=24429&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24439, Order: 205804, Start Time: 2014-04-08 22:07:30, End Time: 2014-04-09 03:00:56 To: 24429, Order: 205773, Start Time: 2014-04-08 16:58:34, End Time: 2014-04-08 21:51:57 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (160 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-18-LoopBug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2002-08-19-CodegenBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2200 => 0.2360, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3080 => 0.3280, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.18% (1.3601 => 1.3761, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.49% (4.6563 => 4.7723, std.dev.: 0.0397) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1987.50% (0.0320 => 0.6680, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0118) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 396.87% (0.2520 => 1.2521, std.dev.: 0.0102) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 275.91% (0.2320 => 0.8721, std.dev.: 0.0123) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0036) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0048) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0073) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.64% (1.2160 => 1.5521, std.dev.: 0.0136) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: 23.28% (1.3920 => 1.7160, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.12% (1.1361 => 1.3761, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.52% (1.2281 => 1.4801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.43% (1.1721 => 1.3881, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 18.18% (8.5802 => 10.1403, std.dev.: 0.0407) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 15.68% (19.5406 => 22.6047, std.dev.: 0.0432) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.84% (5.3360 => 6.1281, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 9.10% (11.3843 => 12.4203, std.dev.: 0.0456) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.6680 => 6.1480, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (11.4440 => 12.3200, std.dev.: 0.0580) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2200 => 0.2360, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.63% (5.7280 => 6.1080, std.dev.: 0.0591) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.7640 => 0.8120, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0117) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (9.5802 => 10.1522, std.dev.: 0.0474) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: 5.73% (1.0480 => 1.1080, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.02% (2.0920 => 2.1760, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0226) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0170) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 3.69% (4.7720 => 4.9480, std.dev.: 0.0356) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (6.8280 => 7.0640, std.dev.: 0.0509) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.6961 => 1.7521, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0079) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.17% (49.1529 => 50.7089, std.dev.: 0.0649) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.7600 => 1.8120, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0131) MultiSource/Applications/ClamAV/clamscan: 2.85% (19.2243 => 19.7724, std.dev.: 0.0524) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.4320 => 1.4720, std.dev.: 0.0151) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.69% (1.3400 => 1.3760, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 2.59% (24.7575 => 25.3975, std.dev.: 0.0371) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0138) MultiSource/Benchmarks/Bullet/bullet: 2.28% (39.0726 => 39.9646, std.dev.: 0.0441) MultiSource/Applications/treecc/treecc: 2.27% (2.6480 => 2.7080, std.dev.: 0.0179) MultiSource/Applications/kimwitu++/kc: 1.90% (19.7491 => 20.1251, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0124 => 6.1164, std.dev.: 0.0086) MultiSource/Applications/siod/siod: 1.31% (2.7562 => 2.7922, std.dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.13% (29.3298 => 29.6619, std.dev.: 0.0438) MultiSource/Applications/SPASS/SPASS: 1.06% (18.7966 => 18.9965, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.03% (16.7083 => 16.8803, std.dev.: 0.0507) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.33% (0.0360 => 0.0480, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0337) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 2.17% (4.0563 => 4.1443, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.37% (11.0207 => 10.4287, std.dev.: 0.0999) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -15.62% (7.8605 => 6.6324, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0904) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0227) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.19% (2.9162 => 2.8522, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -1.76% (4.9963 => 4.9083, std.dev.: 0.0163) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0216) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 20:07:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 22:07:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409030752.2E0F42A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24440?compare_to=24434&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24440, Order: 205805, Start Time: 2014-04-08 22:30:41, End Time: 2014-04-09 03:14:12 To: 24434, Order: 205789, Start Time: 2014-04-08 20:57:22, End Time: 2014-04-09 01:41:31 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (98 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/badidx: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2280 => 0.2480, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 4.13% (0.4840 => 0.5040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.71% (1.3281 => 1.3641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.25% (1.2441 => 1.2721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.12% (1.3201 => 1.3481, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.94% (1.2361 => 1.2601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.92% (1.2521 => 1.2761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.59% (1.2601 => 1.2801, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.54% (1.3001 => 1.3201, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 13.64% (0.2640 => 0.3000, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/simple_throw: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.47% (1.1881 => 1.3481, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.32% (1.1361 => 1.2761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.50% (1.1481 => 1.2801, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.75% (1.2281 => 1.3601, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.37% (1.1961 => 1.3201, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2280 => 0.2480, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0373) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0590) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.42% (0.6640 => 0.7000, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0362) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0180) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0309) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0175) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0247) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0464) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0631) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0398) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout-C++/moments: 2.78% (0.4320 => 0.4440, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 2.57% (37.0925 => 38.0446, std.dev.: 0.0778) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/hash2: 2.44% (0.4920 => 0.5040, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 2.21% (23.7574 => 24.2815, std.dev.: 0.0453) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0147) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7964 => 5.9084, std.dev.: 0.0095) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.80% (48.1088 => 48.9729, std.dev.: 0.1041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0154) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0455) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0626) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0173) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -4.74% (10.8967 => 10.3806, std.dev.: 0.1115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: -15.79% (0.0760 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 20:48:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 22:48:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409034800.56D602A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24441?compare_to=24440&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24441, Order: 205811, Start Time: 2014-04-08 23:11:43, End Time: 2014-04-09 03:54:22 To: 24440, Order: 205805, Start Time: 2014-04-08 22:30:41, End Time: 2014-04-09 03:14:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (104 on baseline) Performance Improvements: 2 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.00% (0.0800 => 0.0920, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.82% (1.3161 => 1.3401, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 8.18% (0.4400 => 0.4760, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash: 3.91% (0.5120 => 0.5320, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -13.64% (0.0880 => 0.0760, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.67% (1.3481 => 1.3121, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0048) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0030) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 29.63% (0.1080 => 0.1400, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/mst/mst: 8.82% (0.1360 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0591) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.26% (0.9880 => 1.0400, std.dev.: 0.0194) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0340) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0177) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0421) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0430) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0471) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0406) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0358) MultiSource/Applications/sqlite3/sqlite3: 2.24% (23.7574 => 24.2895, std.dev.: 0.0609) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0057) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.99% (48.1088 => 49.0649, std.dev.: 0.0675) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0113) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0104) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 1.68% (37.0925 => 37.7165, std.dev.: 0.0826) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0365) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 1.11% (18.8170 => 19.0250, std.dev.: 0.0800) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.55% (10.8967 => 10.4007, std.dev.: 0.1257) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 8 21:06:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Apr 2014 23:06:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409040613.F21CD2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24442?compare_to=24441&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24442, Order: 205812, Start Time: 2014-04-08 23:25:03, End Time: 2014-04-09 04:12:33 To: 24441, Order: 205811, Start Time: 2014-04-08 23:11:43, End Time: 2014-04-09 03:54:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (107 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Regression/C/casts: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.85% (0.7520 => 0.7960, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.6600 => 0.6920, std.dev.: 0.0084) SingleSource/Benchmarks/Linpack/linpack-pc: 3.85% (0.3120 => 0.3240, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 3.57% (0.3360 => 0.3480, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.56% (0.4680 => 0.4800, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.2440 => 1.2720, std.dev.: 0.0104) MultiSource/Applications/d/make_dparser: 1.37% (3.8001 => 3.8521, std.dev.: 0.0180) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.13% (5.3723 => 5.5403, std.dev.: 0.0594) MultiSource/Applications/sgefa/sgefa: 2.33% (0.5160 => 0.5280, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0475) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.25% (0.7040 => 0.7480, std.dev.: 0.0146) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0424) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0595) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0210) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0393) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0276) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0291) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.56% (0.4680 => 0.4800, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0298) MultiSource/Applications/sqlite3/sqlite3: 2.24% (23.7574 => 24.2895, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0060) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.65% (48.1088 => 48.9009, std.dev.: 0.1285) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1210, std.dev.: 0.0322) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0145) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0203) MultiSource/Benchmarks/Bullet/bullet: 1.45% (37.0925 => 37.6286, std.dev.: 0.1071) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0095) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0194) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0518) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0110) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0053) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0315) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: -71.43% (0.0280 => 0.0080, std.dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -4.85% (10.8967 => 10.3686, std.dev.: 0.1170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 01:32:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 03:32:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409083227.1BF2C2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24443?compare_to=24442&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24443, Order: 205828, Start Time: 2014-04-09 03:55:33, End Time: 2014-04-09 08:38:47 To: 24442, Order: 205812, Start Time: 2014-04-08 23:25:03, End Time: 2014-04-09 04:12:33 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (103 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C/PR10189: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.4040 => 0.4200, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 3.63% (0.7720 => 0.8000, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (1.3281 => 1.3481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.23% (1.3001 => 1.3161, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 15.38% (0.1040 => 0.1200, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (0.4680 => 0.4800, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0048) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0026) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.15% (1.1841 => 1.3161, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.26% (0.2160 => 0.2360, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0567) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0228) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0356) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0314) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0074) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0394) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (4.9000 => 5.0640, std.dev.: 0.0249) MultiSource/Applications/JM/lencod/lencod: 3.29% (17.6165 => 18.1965, std.dev.: 0.0466) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0352) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0271) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (4.9200 => 5.0360, std.dev.: 0.0294) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1889, std.dev.: 0.0986) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 1.71% (37.0925 => 37.7285, std.dev.: 0.0881) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 1.19% (18.8170 => 19.0410, std.dev.: 0.0402) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 4.63% (6.6564 => 6.9644, std.dev.: 0.0422) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0261) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0227) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (4.0643 => 4.1283, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0026) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0416) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.67% (10.8967 => 10.4967, std.dev.: 0.0938) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 01:33:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 03:33:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409083342.AD91B2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24444?compare_to=24436&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24444, Order: 205828, Start Time: 2014-04-09 03:50:59, End Time: 2014-04-09 08:40:06 To: 24436, Order: 205802, Start Time: 2014-04-08 21:51:55, End Time: 2014-04-09 02:41:03 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (137 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (950 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C/casts: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.14% (0.7280 => 0.7800, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.3600 => 0.3840, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.2720 => 0.2880, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: 5.49% (0.3640 => 0.3840, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/oggenc/oggenc: 9.38% (0.1280 => 0.1400, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: 1.74% (2.0721 => 2.1081, std.dev.: 0.0134) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.67% (11.3687 => 31.2260, std.dev.: 0.0682) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0050) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0069) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.14% (1.0240 => 1.2200, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.13% (0.1240 => 0.1440, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0238) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.02% (1.5601 => 1.7321, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.34% (0.3480 => 0.3840, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.89% (0.3640 => 0.4000, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.01% (1.4201 => 1.5481, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.73% (1.5521 => 1.6721, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.63% (1.4681 => 1.5801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (0.2200 => 0.2360, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.95% (1.7841 => 1.9081, std.dev.: 0.0119) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0161) MultiSource/Applications/hexxagon/hexxagon: 6.74% (1.1280 => 1.2040, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0145) MultiSource/Applications/Burg/burg: 6.37% (1.5080 => 1.6040, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (11.6440 => 12.3840, std.dev.: 0.0630) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.4680 => 6.8720, std.dev.: 0.0476) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.08% (1.4481 => 1.5361, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.86% (9.4842 => 10.0402, std.dev.: 0.0418) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.77% (1.4561 => 1.5401, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (5.8121 => 6.1361, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.57% (1.4361 => 1.5161, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (1.7401 => 1.8361, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.26% (1.5201 => 1.6001, std.dev.: 0.0137) MultiSource/Applications/JM/ldecod/ldecod: 5.26% (10.0443 => 10.5723, std.dev.: 0.0310) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0156) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0202) MultiSource/Applications/JM/lencod/lencod: 4.45% (21.9606 => 22.9368, std.dev.: 0.0562) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.7400 => 1.8160, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (6.5080 => 6.7840, std.dev.: 0.0493) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5440 => 6.8160, std.dev.: 0.0560) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.08% (50.0290 => 52.0690, std.dev.: 0.0932) MultiSource/Applications/treecc/treecc: 4.02% (2.5840 => 2.6880, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0118) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.82% (0.5240 => 0.5440, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.59% (1.5600 => 1.6160, std.dev.: 0.0201) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (5.3600 => 5.5480, std.dev.: 0.0534) MultiSource/Applications/oggenc/oggenc: 3.49% (6.9844 => 7.2285, std.dev.: 0.0176) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.35% (1.3120 => 1.3560, std.dev.: 0.0155) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0338) MultiSource/Applications/d/make_dparser: 3.23% (3.9681 => 4.0961, std.dev.: 0.0154) MultiSource/Applications/SPASS/SPASS: 3.19% (18.4404 => 19.0286, std.dev.: 0.0451) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (4.1843 => 4.3163, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0233) MultiSource/Benchmarks/Bullet/bullet: 2.97% (38.4046 => 39.5446, std.dev.: 0.1077) MultiSource/Applications/ClamAV/clamscan: 2.88% (19.0444 => 19.5924, std.dev.: 0.0473) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (16.3483 => 16.8043, std.dev.: 0.0406) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.7480 => 0.7680, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 2.48% (19.6891 => 20.1771, std.dev.: 0.0631) MultiSource/Applications/siod/siod: 2.21% (2.7162 => 2.7762, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (13.0563 => 13.2043, std.dev.: 0.0455) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.77% (2.1401 => 2.4562, std.dev.: 0.0421) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0239) MultiSource/Benchmarks/llubenchmark/llu: 5.16% (5.1123 => 5.3763, std.dev.: 0.0765) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) MultiSource/Applications/obsequi/Obsequi: 2.73% (2.0521 => 2.1081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.10% (1.5641 => 0.6240, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: -5.35% (1.8680 => 1.7680, std.dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.01% (91.8497 => 49.5871, std.dev.: 9.8770) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.55% (26.0616 => 17.0571, std.dev.: 0.1031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.12% (50.3031 => 33.1381, std.dev.: 0.1302) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.15% (42.1466 => 28.5978, std.dev.: 0.5267) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1138) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.99% (1.4041 => 1.3761, std.dev.: 0.0094) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 01:34:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 03:34:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409083417.281CD2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24445?compare_to=24435&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24445, Order: 205828, Start Time: 2014-04-09 03:51:49, End Time: 2014-04-09 08:40:36 To: 24435, Order: 205802, Start Time: 2014-04-08 21:50:06, End Time: 2014-04-09 02:39:55 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (0 on baseline) Performance Improvements: 14 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1095 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-8: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.51% (1.0601 => 1.0761, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.05% (30.7379 => 29.8019, std.dev.: 0.0540) MultiSource/Applications/SPASS/SPASS: -2.61% (19.6248 => 19.1127, std.dev.: 0.0709) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.55% (6.2804 => 6.1204, std.dev.: 0.0246) MultiSource/Applications/sqlite3/sqlite3: -2.29% (26.2136 => 25.6136, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.83% (1.7521 => 1.7201, std.dev.: 0.0123) MultiSource/Applications/lemon/lemon: -1.81% (1.5481 => 1.5201, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: -1.81% (40.5446 => 39.8126, std.dev.: 0.0498) MultiSource/Applications/d/make_dparser: -1.71% (4.2001 => 4.1281, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.70% (2.3481 => 2.3081, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.64% (4.3843 => 4.3123, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: -1.52% (20.7924 => 20.4764, std.dev.: 0.0901) SingleSource/Benchmarks/Shootout/nestedloop: -1.41% (1.1321 => 1.1161, std.dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: -1.34% (20.5331 => 20.2571, std.dev.: 0.0475) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.28% (17.2363 => 17.0163, std.dev.: 0.0618) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0125) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 01:37:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 03:37:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140409083702.6C51C2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24446?compare_to=24437&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24446, Order: 205828, Start Time: 2014-04-09 03:52:00, End Time: 2014-04-09 08:43:25 To: 24437, Order: 205802, Start Time: 2014-04-08 22:01:00, End Time: 2014-04-09 02:52:14 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (132 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 25.00% (0.0640 => 0.0800, std.dev.: 0.0054) MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.36% (0.7720 => 0.8520, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.89% (0.1520 => 0.1640, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (0.4560 => 0.4840, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 5.00% (0.2400 => 0.2520, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.04% (0.7920 => 0.8240, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.40% (0.5000 => 0.5120, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.8120 => 1.8480, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.11% (0.2520 => 0.2800, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.99% (0.3560 => 0.3880, std.dev.: 0.0104) MultiSource/Applications/lemon/lemon: 4.56% (0.9641 => 1.0081, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.32% (1.3881 => 1.4481, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0122) SingleSource/UnitTests/member-function-pointers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.31% (1.7641 => 2.1401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.62% (1.8041 => 2.1761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.66% (1.6681 => 1.9961, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.56% (1.7241 => 2.0441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0224) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0062) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.7280 => 1.8480, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 6.27% (1.0200 => 1.0840, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.07% (6.7200 => 7.1280, std.dev.: 0.0404) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.88% (0.2720 => 0.2880, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.70% (11.7880 => 12.4600, std.dev.: 0.0950) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.10% (0.7840 => 0.8240, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0105) MultiSource/Applications/d/make_dparser: 4.84% (3.9641 => 4.1561, std.dev.: 0.0152) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0100) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0116) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (9.9842 => 10.4082, std.dev.: 0.0567) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.07% (0.4920 => 0.5120, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (6.8321 => 7.1001, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (2.0680 => 2.1480, std.dev.: 0.0279) MultiSource/Applications/oggenc/oggenc: 3.65% (6.9124 => 7.1644, std.dev.: 0.0210) MultiSource/Applications/Burg/burg: 3.59% (1.5600 => 1.6160, std.dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: 3.55% (22.6287 => 23.4327, std.dev.: 0.0364) MultiSource/Applications/SPASS/SPASS: 3.53% (18.4924 => 19.1446, std.dev.: 0.0336) MultiSource/Applications/JM/ldecod/ldecod: 3.45% (10.3203 => 10.6763, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0219) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.93% (51.1089 => 52.6049, std.dev.: 0.1179) MultiSource/Applications/kimwitu++/kc: 2.47% (19.7371 => 20.2251, std.dev.: 0.0588) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: 2.35% (20.2445 => 20.7205, std.dev.: 0.0500) MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (2.7722 => 2.8362, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0172) MultiSource/Benchmarks/Bullet/bullet: 2.17% (38.9366 => 39.7806, std.dev.: 0.1047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (16.5963 => 16.9363, std.dev.: 0.0792) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.99% (6.0244 => 6.1444, std.dev.: 0.0211) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 1.68% (25.1895 => 25.6136, std.dev.: 0.0394) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.29% (0.9281 => 1.1721, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.44% (3.4842 => 3.6042, std.dev.: 0.0380) MultiSource/Applications/minisat/minisat: 3.23% (6.8204 => 7.0404, std.dev.: 0.0528) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (3.4402 => 3.5322, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9604 => 6.0684, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (4.2403 => 4.3163, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 1.64% (21.6534 => 22.0094, std.dev.: 0.0898) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0227) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (4.0203 => 4.0843, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.56% (6.2884 => 1.3481, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0082) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0201) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.58% (7.4801 => 6.2400, std.dev.: 0.0425) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.51% (7.5041 => 6.3400, std.dev.: 0.0481) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -4.14% (10.9087 => 10.4567, std.dev.: 0.1018) MultiSource/Benchmarks/mafft/pairlocalalign: -2.69% (13.5243 => 13.1603, std.dev.: 0.0316) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -6.91% (0.7520 => 0.7000, std.dev.: 0.0200) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0202) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.25% (3.8442 => 3.7962, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 01:38:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 03:38:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140409083805.C93932A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24447?compare_to=24438&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24447, Order: 205828, Start Time: 2014-04-09 03:51:56, End Time: 2014-04-09 08:44:23 To: 24438, Order: 205804, Start Time: 2014-04-08 22:05:42, End Time: 2014-04-09 02:58:24 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 15 (134 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 50.00% (0.0320 => 0.0480, std.dev.: 0.0018) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 27.27% (0.0880 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Stanford/Towers: 27.27% (0.0440 => 0.0560, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.05% (0.1680 => 0.2000, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.79% (0.1160 => 0.1320, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.25% (0.3840 => 0.4080, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.16% (1.0080 => 1.0600, std.dev.: 0.0103) MultiSource/Applications/hbd/hbd: 2.97% (1.7480 => 1.8000, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.89% (2.1121 => 2.1521, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.69% (0.1560 => 0.1680, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.10% (0.3280 => 0.3480, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.05% (17.6723 => 19.6243, std.dev.: 0.0658) MultiSource/Applications/sqlite3/sqlite3: 1423.30% (1.7001 => 25.8976, std.dev.: 0.0459) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.86% (50.1010 => 52.0330, std.dev.: 0.0586) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.11% (11.3920 => 12.3160, std.dev.: 0.0767) SingleSource/Benchmarks/Misc/oourafft: 175.45% (11.3407 => 31.2380, std.dev.: 0.0961) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0570) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0089) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 321.32% (0.4320 => 1.8201, std.dev.: 0.0066) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0030) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0028) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 33.33% (0.0360 => 0.0480, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 31.25% (0.0640 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.69% (1.8361 => 2.1241, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/08-main/main: 14.63% (0.3280 => 0.3760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.61% (1.9161 => 2.1961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.60% (1.8081 => 2.0721, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.28% (1.8201 => 2.0801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.02% (1.9121 => 2.1801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0163) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.32% (1.9521 => 2.2121, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4122, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.08% (1.9201 => 2.1521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.06% (1.7721 => 1.9681, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.68% (0.3720 => 0.4080, std.dev.: 0.0092) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.6960 => 1.8160, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.43% (0.9960 => 1.0600, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (2.9721 => 3.1562, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 6.05% (1.7841 => 1.8921, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.86% (6.4800 => 6.8600, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (0.4760 => 0.5000, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0283) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.95% (1.2120 => 1.2720, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.59% (6.5320 => 6.8320, std.dev.: 0.0284) MultiSource/Applications/Burg/burg: 4.45% (1.5280 => 1.5960, std.dev.: 0.0246) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0175) MultiSource/Applications/hbd/hbd: 4.17% (1.7280 => 1.8000, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.06% (1.5760 => 1.6400, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (5.8281 => 6.0601, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.7480 => 1.8160, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.84% (1.5640 => 1.6240, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (2.1600 => 2.2400, std.dev.: 0.0213) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (9.6042 => 9.9402, std.dev.: 0.0508) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (16.3003 => 16.8563, std.dev.: 0.0447) MultiSource/Applications/lua/lua: 3.26% (4.7920 => 4.9480, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.24% (6.5360 => 6.7480, std.dev.: 0.0420) MultiSource/Applications/JM/lencod/lencod: 3.15% (22.2206 => 22.9208, std.dev.: 0.0465) MultiSource/Applications/oggenc/oggenc: 2.89% (7.0524 => 7.2565, std.dev.: 0.0216) MultiSource/Applications/SPASS/SPASS: 2.85% (18.5284 => 19.0565, std.dev.: 0.0378) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.5040 => 1.5440, std.dev.: 0.0138) MultiSource/Applications/d/make_dparser: 2.62% (3.9761 => 4.0801, std.dev.: 0.0230) MultiSource/Benchmarks/Bullet/bullet: 2.44% (38.6366 => 39.5806, std.dev.: 0.0714) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (5.3960 => 5.5240, std.dev.: 0.0358) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: 2.15% (10.2283 => 10.4483, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.95% (1.0241 => 1.0441, std.dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 1.59% (19.8291 => 20.1451, std.dev.: 0.0342) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7842 => 2.8202, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0363 => 13.1763, std.dev.: 0.0339) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0534) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 2.43% (6.5964 => 6.7564, std.dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/printargs: -80.00% (0.0200 => 0.0040, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.73% (2.9562 => 0.6880, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: -6.18% (1.8760 => 1.7600, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.23% (94.8339 => 49.0991, std.dev.: 10.8536) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.11% (49.9431 => 32.9061, std.dev.: 0.2713) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.62% (25.7136 => 17.0691, std.dev.: 0.1394) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.24% (37.0863 => 28.4658, std.dev.: 0.3012) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1099) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: -1.19% (2.3521 => 2.3241, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 01:38:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 03:38:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140409083854.5391D2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24448?compare_to=24439&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24448, Order: 205828, Start Time: 2014-04-09 03:51:58, End Time: 2014-04-09 08:45:18 To: 24439, Order: 205804, Start Time: 2014-04-08 22:07:30, End Time: 2014-04-09 03:00:56 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 18 (161 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (930 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 44.44% (0.0360 => 0.0520, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 44.44% (0.0360 => 0.0520, std.dev.: 0.0052) SingleSource/Benchmarks/Stanford/Perm: 37.50% (0.0320 => 0.0440, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.11% (0.1480 => 0.1600, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.39% (0.4560 => 0.4760, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.26% (1.2200 => 1.2720, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/bh/bh: 3.60% (0.4440 => 0.4600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.31% (1.3881 => 1.4201, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (6.1080 => 6.2160, std.dev.: 0.0386) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 29.41% (0.0680 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 10.00% (0.3600 => 0.3960, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.47% (0.6800 => 0.7240, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 6.01% (1.0641 => 1.1281, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1962.50% (0.0320 => 0.6600, std.dev.: 0.0110) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0069) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0076) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 393.69% (0.2520 => 1.2441, std.dev.: 0.0164) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0078) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0062) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0088) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0074) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0054) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 54.55% (0.7040 => 1.0880, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Perm: 37.50% (0.0320 => 0.0440, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: 21.84% (1.3920 => 1.6960, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.16% (1.1721 => 1.4201, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.86% (1.1881 => 1.4241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (1.3681 => 1.6361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 19.07% (8.5802 => 10.2163, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.05% (1.1761 => 1.4001, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.75% (1.1521 => 1.3681, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.77% (1.2881 => 1.5041, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 15.86% (19.5406 => 22.6407, std.dev.: 0.0536) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.94% (5.3360 => 6.0801, std.dev.: 0.0376) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.49% (1.7400 => 1.9400, std.dev.: 0.0208) MultiSource/Applications/sgefa/sgefa: 10.71% (0.4480 => 0.4960, std.dev.: 0.0156) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (11.3843 => 12.4803, std.dev.: 0.0248) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 8.97% (6.2844 => 6.8484, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.63% (11.4440 => 12.4320, std.dev.: 0.0426) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.52% (5.7280 => 6.2160, std.dev.: 0.0386) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.12% (5.6680 => 6.1280, std.dev.: 0.0580) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.7640 => 0.8240, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.47% (1.1240 => 1.2080, std.dev.: 0.0274) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.64% (9.5802 => 10.2162, std.dev.: 0.0545) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0180) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.4760 => 1.5440, std.dev.: 0.0243) MultiSource/Applications/lua/lua: 4.27% (4.7720 => 4.9760, std.dev.: 0.0324) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0397) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.67% (0.8721 => 0.9041, std.dev.: 0.0118) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.61% (49.1529 => 50.9249, std.dev.: 0.0858) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.6961 => 1.7561, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: 3.42% (5.3840 => 5.5680, std.dev.: 0.0434) MultiSource/Applications/ClamAV/clamscan: 2.87% (19.2243 => 19.7764, std.dev.: 0.0564) MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (2.7282 => 2.8042, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 2.73% (24.7575 => 25.4335, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (2.0920 => 2.1480, std.dev.: 0.0177) MultiSource/Applications/kimwitu++/kc: 2.21% (19.7491 => 20.1851, std.dev.: 0.0364) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0124 => 6.1004, std.dev.: 0.0166) MultiSource/Applications/SPASS/SPASS: 1.40% (18.7966 => 19.0605, std.dev.: 0.0432) MultiSource/Benchmarks/Bullet/bullet: 1.38% (39.0726 => 39.6126, std.dev.: 0.0791) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.32% (29.3298 => 29.7179, std.dev.: 0.0665) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.15% (16.7083 => 16.9003, std.dev.: 0.0521) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.08% (0.5920 => 0.6280, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.15% (1.6521 => 1.7041, std.dev.: 0.0126) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0452) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -4.72% (11.0207 => 10.5007, std.dev.: 0.1120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.90% (5.2763 => 4.9123, std.dev.: 0.0874) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0295) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.0963 => 5.0403, std.dev.: 0.0211) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 02:35:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 04:35:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409093510.8766F2A6C03D@llvm.org> http://llvm.org/perf/db_default/v4/nts/24449?compare_to=24443&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24449, Order: 205829, Start Time: 2014-04-09 04:54:41, End Time: 2014-04-09 09:41:33 To: 24443, Order: 205828, Start Time: 2014-04-09 03:55:33, End Time: 2014-04-09 08:38:47 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (108 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/test_indvars: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 27.27% (0.0440 => 0.0560, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.67% (0.1200 => 0.1400, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.68% (0.3800 => 0.4320, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/mst/mst: 12.12% (0.1320 => 0.1480, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.61% (0.3680 => 0.3960, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.08% (0.3920 => 0.4080, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.29% (1.2401 => 1.2561, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/sim/sim: -4.49% (0.3560 => 0.3400, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0062) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 29.63% (0.1080 => 0.1400, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 27.78% (0.0720 => 0.0920, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/mst/mst: 8.82% (0.1360 => 0.1480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.70% (0.1840 => 0.2000, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0515) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (6.0160 => 6.3680, std.dev.: 0.0455) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0194) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0409) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0205) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (10.4082 => 10.8122, std.dev.: 0.0452) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0173) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0166) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0375) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0327) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0317) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.14% (48.1088 => 49.1369, std.dev.: 0.1278) MultiSource/Benchmarks/Bullet/bullet: 1.91% (37.0925 => 37.8006, std.dev.: 0.0860) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0120) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0186) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0554) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0481) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0110) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -3.27% (10.8967 => 10.5407, std.dev.: 0.0991) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2403 => 4.1963, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 03:01:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 05:01:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409100102.43E6C2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24450?compare_to=24449&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24450, Order: 205830, Start Time: 2014-04-09 05:24:33, End Time: 2014-04-09 10:07:23 To: 24449, Order: 205829, Start Time: 2014-04-09 04:54:41, End Time: 2014-04-09 09:41:33 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (104 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 18.52% (0.1080 => 0.1280, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.29% (0.0840 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 4.52% (0.7080 => 0.7400, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3400 => 0.3520, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.84% (0.3040 => 0.3400, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0761 => 1.0881, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.37% (0.1960 => 0.2320, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/sieve: 10.26% (0.3120 => 0.3440, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.05% (0.6240 => 0.6680, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0381) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (1.5200 => 1.6160, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0520) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0496) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0229) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0233) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0340) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0424) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0508) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3400 => 0.3520, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0358) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0225) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.31% (48.1088 => 49.2210, std.dev.: 0.0776) MultiSource/Applications/sqlite3/sqlite3: 2.12% (23.7574 => 24.2615, std.dev.: 0.0719) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: 2.09% (37.0925 => 37.8686, std.dev.: 0.0545) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0106) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0115) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 1.72% (18.8170 => 19.1411, std.dev.: 0.0281) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0217) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0390) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.59% (0.3160 => 0.3400, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 4.69% (6.6564 => 6.9684, std.dev.: 0.0383) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0198) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.19% (21.1533 => 21.4053, std.dev.: 0.0935) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (5.8044 => 5.8684, std.dev.: 0.0227) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.15% (10.8967 => 10.4447, std.dev.: 0.1132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -3.43% (0.7000 => 0.6760, std.dev.: 0.0087) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 04:25:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 06:25:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409112530.545212A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24451?compare_to=24450&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24451, Order: 205831, Start Time: 2014-04-09 06:44:37, End Time: 2014-04-09 11:31:52 To: 24450, Order: 205830, Start Time: 2014-04-09 05:24:33, End Time: 2014-04-09 10:07:23 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (103 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2003-09-18-BitFieldTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.25% (0.0640 => 0.0840, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.50% (0.1600 => 0.1800, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.78% (0.2360 => 0.2520, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.08% (0.3920 => 0.4080, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.3560 => 0.3680, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.54% (1.2961 => 1.3161, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.24% (1.2921 => 1.3081, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bisort/bisort: 1.64% (0.7320 => 0.7440, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.86% (0.2800 => 0.3160, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.82% (1.2281 => 1.3241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (10.6960 => 11.3840, std.dev.: 0.0658) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.6840 => 0.7200, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0378) MultiSource/Applications/JM/lencod/lencod: 3.27% (17.6165 => 18.1925, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 3.01% (4.5200 => 4.6560, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0455) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0301) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0480) MultiSource/Applications/sqlite3/sqlite3: 2.14% (23.7574 => 24.2655, std.dev.: 0.0436) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1170, std.dev.: 0.1116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 1.81% (37.0925 => 37.7646, std.dev.: 0.0664) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1251, std.dev.: 0.0527) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0149) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0204) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0501) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0273) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.08% (21.1533 => 21.3813, std.dev.: 0.0733) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.04% (10.8967 => 10.4567, std.dev.: 0.0928) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 04:26:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 06:26:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409112639.CF0542A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24452?compare_to=24451&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24452, Order: 205832, Start Time: 2014-04-09 06:50:25, End Time: 2014-04-09 11:33:02 To: 24451, Order: 205831, Start Time: 2014-04-09 06:44:37, End Time: 2014-04-09 11:31:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (102 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/RealMM: 57.14% (0.0280 => 0.0440, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.71% (0.1120 => 0.1240, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.10% (0.3960 => 0.4360, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.09% (0.1320 => 0.1440, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.3360 => 0.3560, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: 4.94% (0.3240 => 0.3400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.11% (1.3241 => 1.3521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (1.3281 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.02% (11.3840 => 11.5000, std.dev.: 0.0325) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.87% (0.7240 => 0.7520, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/hash: 1.22% (4.2483 => 4.3003, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.08% (1.1121 => 1.1241, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -9.30% (0.1720 => 0.1560, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 12.66% (0.3160 => 0.3560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.61% (1.2081 => 1.3121, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.89% (1.2161 => 1.3121, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.59% (0.3640 => 0.3880, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0387) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0397) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0080) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0184) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0360) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0423) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 2.42% (23.7574 => 24.3335, std.dev.: 0.0371) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0357) MultiSource/Benchmarks/Bullet/bullet: 2.07% (37.0925 => 37.8606, std.dev.: 0.0429) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0137) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.84% (48.1088 => 48.9929, std.dev.: 0.1539) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1330, std.dev.: 0.0375) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0188) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.45% (6.6564 => 6.9524, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.60% (3.5322 => 3.6242, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0289) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -3.63% (10.8967 => 10.5007, std.dev.: 0.0738) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0012) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0193) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3361 => 2.3081, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 06:37:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 08:37:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409133714.92D802A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24453?compare_to=24452&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24453, Order: 205841, Start Time: 2014-04-09 09:00:43, End Time: 2014-04-09 13:43:37 To: 24452, Order: 205832, Start Time: 2014-04-09 06:50:25, End Time: 2014-04-09 11:33:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (109 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/health/health: 12.20% (0.1640 => 0.1840, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.59% (0.2760 => 0.3080, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ReedSolomon: 5.56% (0.2160 => 0.2280, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.24% (0.8921 => 0.9121, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.13% (1.3121 => 1.3401, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.26% (0.1560 => 0.1720, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: 1.91% (2.0921 => 2.1321, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray: -3.09% (0.3880 => 0.3760, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0033) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0064) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2280 => 0.2480, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/ReedSolomon: 7.55% (0.2120 => 0.2280, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0574) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0339) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0197) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0538) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0134) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.3640 => 0.3760, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0426) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0455) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0247) MultiSource/Applications/hbd/hbd: 2.86% (1.6800 => 1.7280, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0363) MultiSource/Applications/sqlite3/sqlite3: 2.32% (23.7574 => 24.3095, std.dev.: 0.0514) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0061) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.11% (48.1088 => 49.1249, std.dev.: 0.0750) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 1.91% (37.0925 => 37.8006, std.dev.: 0.0763) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0106) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0891, std.dev.: 0.0377) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0326) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 4.57% (6.6564 => 6.9604, std.dev.: 0.0486) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0144) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -4.81% (10.8967 => 10.3726, std.dev.: 0.0937) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 06:44:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 08:44:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409134408.E26E32A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24454?compare_to=24445&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24454, Order: 205841, Start Time: 2014-04-09 09:02:19, End Time: 2014-04-09 13:50:33 To: 24445, Order: 205828, Start Time: 2014-04-09 03:51:49, End Time: 2014-04-09 08:40:36 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2003-05-14-AtExit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-26-Shorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0025) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 9.68% (0.1240 => 0.1360, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.74% (0.5840 => 0.6000, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.64% (0.3480 => 0.3920, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/tsp/tsp: 2.16% (1.2961 => 1.3241, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/2003-05-21-UnionBitfields: -30.00% (0.0400 => 0.0280, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 06:44:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 08:44:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409134452.1068F2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24455?compare_to=24444&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24455, Order: 205841, Start Time: 2014-04-09 09:01:43, End Time: 2014-04-09 13:51:16 To: 24444, Order: 205828, Start Time: 2014-04-09 03:50:59, End Time: 2014-04-09 08:40:06 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 10 (136 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 66.67% (0.0240 => 0.0400, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: 19.05% (0.0840 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.25% (0.3200 => 0.3560, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.25% (0.1920 => 0.2040, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.94% (1.8561 => 1.8921, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.85% (1.5161 => 1.5441, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.06% (0.7120 => 0.7480, std.dev.: 0.0077) MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (2.3121 => 2.3401, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9562 => 3.9962, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -8.98% (1.0241 => 0.9321, std.dev.: 0.0328) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.70% (11.3687 => 31.2300, std.dev.: 0.0822) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0104) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0070) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0058) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0219) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.10% (0.3120 => 0.3560, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/whetstone: 11.11% (0.1440 => 0.1600, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.97% (0.6200 => 0.6880, std.dev.: 0.0148) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0138) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.80% (0.2040 => 0.2240, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.28% (1.1640 => 1.2720, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.23% (1.5601 => 1.7041, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.25% (1.5521 => 1.6801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.92% (0.4040 => 0.4360, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0086) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0171) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.64% (1.0240 => 1.0920, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.35% (1.4481 => 1.5401, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (11.6440 => 12.3800, std.dev.: 0.0671) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.73% (0.7680 => 0.8120, std.dev.: 0.0160) MultiSource/Applications/SIBsim4/SIBsim4: 5.58% (1.7921 => 1.8921, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.44% (9.4842 => 10.0002, std.dev.: 0.0492) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.38% (6.4680 => 6.8160, std.dev.: 0.0539) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0241) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0180) MultiSource/Applications/JM/ldecod/ldecod: 4.86% (10.0443 => 10.5323, std.dev.: 0.0474) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.65% (6.5440 => 6.8480, std.dev.: 0.0461) MultiSource/Applications/JM/lencod/lencod: 4.63% (21.9606 => 22.9768, std.dev.: 0.0549) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (5.8121 => 6.0801, std.dev.: 0.0357) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.55% (6.5080 => 6.8040, std.dev.: 0.0442) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.5480 => 1.6120, std.dev.: 0.0192) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0280) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.96% (50.0290 => 52.0090, std.dev.: 0.0982) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0120) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0080) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0229) MultiSource/Benchmarks/MallocBench/gs/gs: 3.73% (5.3600 => 5.5600, std.dev.: 0.0441) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.66% (1.3120 => 1.3600, std.dev.: 0.0185) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 3.49% (6.9844 => 7.2285, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (4.1843 => 4.3163, std.dev.: 0.0142) MultiSource/Applications/SPASS/SPASS: 3.08% (18.4404 => 19.0085, std.dev.: 0.0453) MultiSource/Benchmarks/Bullet/bullet: 3.07% (38.4046 => 39.5846, std.dev.: 0.0725) MultiSource/Applications/ClamAV/clamscan: 3.02% (19.0444 => 19.6204, std.dev.: 0.0456) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0192) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0301) MultiSource/Applications/kimwitu++/kc: 2.62% (19.6891 => 20.2051, std.dev.: 0.0482) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (16.3483 => 16.7523, std.dev.: 0.0544) MultiSource/Applications/lua/lua: 2.42% (4.7880 => 4.9040, std.dev.: 0.0375) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (13.0563 => 13.2123, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (6.1044 => 6.1764, std.dev.: 0.0209) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.65% (2.1401 => 2.4322, std.dev.: 0.0348) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 2.91% (7.4205 => 7.6365, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0042) MultiSource/Applications/obsequi/Obsequi: 2.53% (2.0521 => 2.1041, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.11% (3.9842 => 4.0283, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9562 => 3.9962, std.dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.10% (1.5641 => 0.6240, std.dev.: 0.0084) MultiSource/Applications/obsequi/Obsequi: -4.93% (1.8680 => 1.7760, std.dev.: 0.0137) SingleSource/UnitTests/Vector/constpool: -2.37% (10.6247 => 10.3726, std.dev.: 0.0964) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.53% (91.8497 => 49.1151, std.dev.: 10.5074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.06% (50.3031 => 33.1701, std.dev.: 0.2787) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.98% (26.0616 => 17.2051, std.dev.: 0.0986) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.25% (42.1466 => 28.9778, std.dev.: 0.3081) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1120) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0198) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 06:50:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 08:50:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140409135019.A04CB2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24456?compare_to=24446&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24456, Order: 205841, Start Time: 2014-04-09 09:05:13, End Time: 2014-04-09 13:56:43 To: 24446, Order: 205828, Start Time: 2014-04-09 03:52:00, End Time: 2014-04-09 08:43:25 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (135 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/strcat: 42.86% (0.0280 => 0.0400, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 21.43% (0.0560 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.80% (0.3160 => 0.3280, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.36% (2.0601 => 2.0881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.34% (2.0881 => 2.1161, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.17% (2.0441 => 2.0681, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 500.00% (0.0040 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0112) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/strcat: 100.00% (0.0200 => 0.0400, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.39% (0.1640 => 0.2040, std.dev.: 0.0068) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.17% (1.7321 => 2.1161, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 21.43% (0.0560 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.11% (1.7241 => 2.0881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.12% (1.9881 => 2.3881, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.69% (1.8281 => 2.1881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.98% (1.9601 => 2.3321, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.67% (0.1200 => 0.1400, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 13.21% (0.2120 => 0.2400, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0238) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0229) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3600 => 0.3840, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.63% (0.7840 => 0.8360, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (11.7880 => 12.5520, std.dev.: 0.0502) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.88% (0.2720 => 0.2880, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.7200 => 7.1000, std.dev.: 0.0451) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.54% (1.7320 => 1.8280, std.dev.: 0.0146) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.99% (1.5240 => 1.6000, std.dev.: 0.0214) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.1440 => 1.2000, std.dev.: 0.0182) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (9.9842 => 10.4722, std.dev.: 0.0389) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0242) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0191) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3040 => 0.3160, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 3.88% (6.9124 => 7.1804, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.86% (1.0361 => 1.0761, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.64% (1.6481 => 1.7081, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (0.3400 => 0.3520, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (6.8321 => 7.0641, std.dev.: 0.0321) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (10.3203 => 10.6643, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (2.0440 => 2.1120, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: 3.16% (18.4924 => 19.0767, std.dev.: 0.0479) MultiSource/Applications/JM/lencod/lencod: 2.99% (22.6287 => 23.3048, std.dev.: 0.0610) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.79% (51.1089 => 52.5329, std.dev.: 0.1018) MultiSource/Applications/kimwitu++/kc: 2.63% (19.7371 => 20.2571, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2203 => 4.3203, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 2.30% (38.9366 => 39.8326, std.dev.: 0.0731) MultiSource/Applications/ClamAV/clamscan: 2.19% (20.2445 => 20.6885, std.dev.: 0.0497) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (16.5963 => 16.9443, std.dev.: 0.0677) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (2.7722 => 2.8282, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.56% (25.1895 => 25.5816, std.dev.: 0.0403) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.18% (29.4578 => 29.8059, std.dev.: 0.0514) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.74% (6.6644 => 17.1771, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 26.29% (0.9281 => 1.1721, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.93% (1.2681 => 1.4321, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0239) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.68% (4.7563 => 4.8363, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.88% (6.2884 => 1.3281, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout/nestedloop: -65.05% (2.9642 => 1.0361, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.70% (3.1762 => 1.2481, std.dev.: 0.0130) SingleSource/UnitTests/ms_struct_pack_layout: -42.86% (0.0280 => 0.0160, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: -32.48% (2.6481 => 1.7880, std.dev.: 0.0145) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.58% (7.4801 => 6.2400, std.dev.: 0.0496) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.26% (7.5041 => 6.2840, std.dev.: 0.0609) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0065) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0089) SingleSource/UnitTests/Vector/constpool: -5.83% (10.9087 => 10.2726, std.dev.: 0.1347) MultiSource/Benchmarks/mafft/pairlocalalign: -2.84% (13.5243 => 13.1403, std.dev.: 0.0374) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0225) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.02% (25.7976 => 25.5336, std.dev.: 0.0208) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 06:52:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 08:52:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140409135210.4996F2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24457?compare_to=24447&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24457, Order: 205841, Start Time: 2014-04-09 09:06:04, End Time: 2014-04-09 13:58:33 To: 24447, Order: 205828, Start Time: 2014-04-09 03:51:56, End Time: 2014-04-09 08:44:23 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 11 (126 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (954 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.81% (0.1080 => 0.1240, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.61% (0.2640 => 0.2920, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.36% (0.4480 => 0.4720, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 2.61% (2.6080 => 2.6760, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/gs/gs: 1.30% (5.5240 => 5.5960, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.15% (2.0801 => 2.1041, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 44.44% (0.0360 => 0.0520, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.18% (17.6723 => 19.6484, std.dev.: 0.0369) MultiSource/Applications/sqlite3/sqlite3: 1421.89% (1.7001 => 25.8736, std.dev.: 0.0404) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.60% (50.1010 => 51.9050, std.dev.: 0.0943) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.08% (1.0520 => 1.1160, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (11.3920 => 12.3600, std.dev.: 0.0660) SingleSource/Benchmarks/Misc/oourafft: 174.43% (11.3407 => 31.1219, std.dev.: 0.0977) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0403, std.dev.: 0.0211) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0103) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 321.32% (0.4320 => 1.8201, std.dev.: 0.0066) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0064) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0125) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.31% (2.1441 => 2.4081, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.33% (1.8361 => 2.0441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0151) MultiSource/Applications/aha/aha: 9.68% (0.1240 => 0.1360, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4320 => 0.4720, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.21% (0.3040 => 0.3320, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 7.14% (0.2800 => 0.3000, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0397) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.03% (1.7480 => 1.8360, std.dev.: 0.0192) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.53% (6.5320 => 6.8280, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (9.6042 => 10.0002, std.dev.: 0.0569) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (5.8281 => 6.0561, std.dev.: 0.0431) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (5.3960 => 5.5960, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0111) MultiSource/Applications/lua/lua: 3.51% (4.7920 => 4.9600, std.dev.: 0.0301) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0163) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (16.3003 => 16.8483, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 3.04% (22.2206 => 22.8967, std.dev.: 0.0330) MultiSource/Applications/oggenc/oggenc: 2.95% (7.0524 => 7.2605, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (6.5360 => 6.7120, std.dev.: 0.0597) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (2.1600 => 2.2120, std.dev.: 0.0195) MultiSource/Applications/SPASS/SPASS: 2.38% (18.5284 => 18.9686, std.dev.: 0.0509) MultiSource/Benchmarks/Bullet/bullet: 2.28% (38.6366 => 39.5166, std.dev.: 0.0645) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (10.2283 => 10.4203, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (3.0562 => 3.1082, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 1.41% (19.8291 => 20.1091, std.dev.: 0.0237) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.15% (2.1201 => 2.4202, std.dev.: 0.0522) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 2.18% (6.5964 => 6.7404, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (4.0003 => 4.0643, std.dev.: 0.0207) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.73% (2.9562 => 0.6880, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: -5.33% (1.8760 => 1.7760, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.14% (94.8339 => 49.1791, std.dev.: 10.1982) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.93% (49.9431 => 32.9981, std.dev.: 0.1725) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.77% (25.7136 => 17.0291, std.dev.: 0.1325) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.92% (3.0722 => 2.3681, std.dev.: 0.1118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.21% (37.0863 => 28.8498, std.dev.: 0.4307) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.84% (1.2681 => 1.2321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -1.42% (4.7883 => 4.7203, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 06:54:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 08:54:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140409135407.4FC272A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24458?compare_to=24448&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24458, Order: 205841, Start Time: 2014-04-09 09:07:03, End Time: 2014-04-09 14:00:31 To: 24448, Order: 205828, Start Time: 2014-04-09 03:51:58, End Time: 2014-04-09 08:45:18 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 12 (152 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/test_indvars: 36.36% (0.0440 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.2960 => 0.3120, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.04% (1.0880 => 1.1320, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (0.9041 => 0.9241, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.71% (1.4001 => 1.4241, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (6.0801 => 6.1561, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.41% (1.7041 => 1.7281, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1937.50% (0.0320 => 0.6520, std.dev.: 0.0131) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0109) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 392.10% (0.2520 => 1.2401, std.dev.: 0.0178) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 274.18% (0.2320 => 0.8681, std.dev.: 0.0134) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0065) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0070) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0057) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0059) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0064) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0058) MultiSource/Applications/obsequi/Obsequi: 22.41% (1.3920 => 1.7040, std.dev.: 0.0171) MultiSource/Benchmarks/NPB-serial/is/is: 22.22% (0.0720 => 0.0880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.12% (1.2921 => 1.5521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 19.07% (8.5802 => 10.2163, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.05% (1.1521 => 1.3601, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.96% (1.1361 => 1.3401, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.57% (1.2521 => 1.4721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.57% (1.2521 => 1.4721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/bh/bh: 15.96% (0.3760 => 0.4360, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.89% (1.3841 => 1.6041, std.dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: 15.72% (19.5406 => 22.6127, std.dev.: 0.0660) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.37% (5.3360 => 6.1561, std.dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0171) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0200) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 11.43% (0.2800 => 0.3120, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (11.3843 => 12.4363, std.dev.: 0.0426) MultiSource/Applications/oggenc/oggenc: 9.17% (6.2844 => 6.8604, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.89% (5.6680 => 6.1720, std.dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.38% (5.7280 => 6.2080, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (11.4440 => 12.2960, std.dev.: 0.0687) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (9.5802 => 10.2442, std.dev.: 0.0334) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0284) MultiSource/Applications/spiff/spiff: 5.34% (1.0480 => 1.1040, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (5.3840 => 5.6280, std.dev.: 0.0441) MultiSource/Applications/lua/lua: 4.44% (4.7720 => 4.9840, std.dev.: 0.0334) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.22% (6.8280 => 7.1160, std.dev.: 0.0428) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.67% (49.1529 => 50.9569, std.dev.: 0.0885) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.63% (1.3240 => 1.3720, std.dev.: 0.0147) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.7600 => 1.8160, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 3.00% (19.2243 => 19.8004, std.dev.: 0.0352) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0172) MultiSource/Applications/sqlite3/sqlite3: 2.80% (24.7575 => 25.4495, std.dev.: 0.0447) MultiSource/Applications/kimwitu++/kc: 2.35% (19.7491 => 20.2131, std.dev.: 0.0397) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 1.85% (39.0726 => 39.7966, std.dev.: 0.0615) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0124 => 6.1124, std.dev.: 0.0228) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.28% (29.3298 => 29.7059, std.dev.: 0.0594) MultiSource/Applications/SPASS/SPASS: 1.15% (18.7966 => 19.0125, std.dev.: 0.0599) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.33% (0.0360 => 0.0480, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0302) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.05% (0.9881 => 1.0281, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 2.76% (4.0563 => 4.1683, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.70% (6.8204 => 7.0044, std.dev.: 0.0511) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-10-13-BadLoad: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -6.43% (11.0207 => 10.3126, std.dev.: 0.1064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -15.62% (7.8605 => 6.6324, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -8.52% (3.4722 => 3.1762, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0981) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.0963 => 5.0443, std.dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 07:44:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 09:44:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409144413.65EBB2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24459?compare_to=24453&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24459, Order: 205842, Start Time: 2014-04-09 10:03:46, End Time: 2014-04-09 14:50:36 To: 24453, Order: 205841, Start Time: 2014-04-09 09:00:43, End Time: 2014-04-09 13:43:37 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (103 on baseline) Performance Improvements: 2 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/2010-12-08-tls: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) MultiSource/Applications/aha/aha: 19.23% (0.1040 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: 11.11% (0.1800 => 0.2000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/EH/except: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.9481 => 0.9681, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.79% (1.0321 => 1.1641, std.dev.: 0.0477) MultiSource/Applications/spiff/spiff: 5.23% (1.9881 => 2.0921, std.dev.: 0.0290) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -9.09% (0.2640 => 0.2400, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -21.43% (0.0560 => 0.0440, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0054) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0424) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (10.6960 => 11.3040, std.dev.: 0.1109) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0354) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0257) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0475) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0617) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0172) MultiSource/Applications/JM/lencod/lencod: 3.43% (17.6165 => 18.2205, std.dev.: 0.0402) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0327) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0509) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 2.42% (23.7574 => 24.3335, std.dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0122) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.05% (48.1088 => 49.0930, std.dev.: 0.0917) MultiSource/Benchmarks/Bullet/bullet: 1.94% (37.0925 => 37.8125, std.dev.: 0.0522) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (7.8562 => 7.9962, std.dev.: 0.0539) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0181) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0508) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0445) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 4.51% (6.6564 => 6.9564, std.dev.: 0.0469) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0105) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0242) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.99% (10.8967 => 10.3526, std.dev.: 0.0781) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.52% (1.2601 => 1.1401, std.dev.: 0.0177) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 08:06:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 10:06:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409150642.EADF52A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24460?compare_to=24459&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24460, Order: 205843, Start Time: 2014-04-09 10:29:55, End Time: 2014-04-09 15:13:03 To: 24459, Order: 205842, Start Time: 2014-04-09 10:03:46, End Time: 2014-04-09 14:50:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (107 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_member: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/matrixTranspose: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 27.27% (0.0880 => 0.1120, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 15.38% (0.1040 => 0.1200, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.33% (0.2400 => 0.2600, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (11.3040 => 11.4920, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.23% (1.2961 => 1.3121, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/strcat: 8.57% (0.1400 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) MultiSource/Benchmarks/llubenchmark/llu: 5.59% (5.0843 => 5.3683, std.dev.: 0.0897) MultiSource/Benchmarks/Olden/bisort/bisort: 1.63% (0.7360 => 0.7480, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0076) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/em3d/em3d: 14.00% (0.2000 => 0.2280, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0131) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (10.6960 => 11.4920, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0407) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0435) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0214) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0105) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0415) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 3.36% (17.6165 => 18.2085, std.dev.: 0.0378) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0337) MultiSource/Applications/sqlite3/sqlite3: 2.46% (23.7574 => 24.3415, std.dev.: 0.0415) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.23% (48.1088 => 49.1809, std.dev.: 0.0722) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9086, std.dev.: 0.0607) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0469) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0100) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 1.53% (18.8170 => 19.1050, std.dev.: 0.0353) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0191) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 28.32% (0.9321 => 1.1961, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/strcat: 18.75% (0.1280 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0333) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0088) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0098) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0275) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.59% (4.5203 => 4.5923, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.28% (4.0643 => 4.1163, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0032) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0312) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -4.41% (10.8967 => 10.4167, std.dev.: 0.0880) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 09:19:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 11:19:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409161914.BBDBD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24461?compare_to=24460&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24461, Order: 205846, Start Time: 2014-04-09 11:37:47, End Time: 2014-04-09 16:25:38 To: 24460, Order: 205843, Start Time: 2014-04-09 10:29:55, End Time: 2014-04-09 15:13:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (92 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/casts: 66.67% (0.0240 => 0.0400, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/family/family: 50.00% (0.0320 => 0.0480, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.33% (0.3000 => 0.3280, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3360 => 0.3560, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3160 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.26% (1.5040 => 1.5680, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.82% (1.3201 => 1.3441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.18% (1.3521 => 1.3681, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.02% (3.5442 => 3.5082, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0576) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0334) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0212) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (10.4082 => 10.8482, std.dev.: 0.0239) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0322) MultiSource/Applications/JM/lencod/lencod: 3.61% (17.6165 => 18.2525, std.dev.: 0.0478) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0412) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (7.8562 => 8.0842, std.dev.: 0.0311) MultiSource/Applications/sqlite3/sqlite3: 2.86% (23.7574 => 24.4375, std.dev.: 0.0503) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0494) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0116) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.18% (48.1088 => 49.1569, std.dev.: 0.1249) MultiSource/Benchmarks/Bullet/bullet: 2.08% (37.0925 => 37.8646, std.dev.: 0.0794) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0114) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0198) MultiSource/Applications/SPASS/SPASS: 1.50% (17.5484 => 17.8124, std.dev.: 0.0610) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0554) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.29% (15.2282 => 15.4242, std.dev.: 0.0299) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.12% (28.1538 => 28.4698, std.dev.: 0.0683) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.76% (1.0881 => 1.2161, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0392) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0099) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.72% (4.5603 => 4.6843, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: -15.91% (0.1760 => 0.1480, std.dev.: 0.0095) SingleSource/UnitTests/Vector/constpool: -5.58% (10.8967 => 10.2886, std.dev.: 0.1168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0169) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0100) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 09:41:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 11:41:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409164145.D2FAE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24462?compare_to=24461&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24462, Order: 205847, Start Time: 2014-04-09 12:05:20, End Time: 2014-04-09 16:48:09 To: 24461, Order: 205846, Start Time: 2014-04-09 11:37:47, End Time: 2014-04-09 16:25:38 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (104 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 23.33% (0.1200 => 0.1480, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.11% (0.1440 => 0.1600, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1360 => 0.1480, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2160 => 0.2280, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.7480 => 1.8160, std.dev.: 0.0212) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.55% (1.2881 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.17% (1.3641 => 1.3801, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.53% (0.2280 => 0.2520, std.dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0364) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0419) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.3400 => 0.3600, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0391) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0442) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0321) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0144) MultiSource/Applications/JM/lencod/lencod: 3.54% (17.6165 => 18.2405, std.dev.: 0.0558) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 3.22% (23.7574 => 24.5215, std.dev.: 0.0458) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0316) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0470) MultiSource/Benchmarks/Bullet/bullet: 2.14% (37.0925 => 37.8846, std.dev.: 0.0705) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.12% (48.1088 => 49.1289, std.dev.: 0.1180) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0119) MultiSource/Applications/oggenc/oggenc: 1.86% (5.7964 => 5.9044, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0133) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1250, std.dev.: 0.0431) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (28.1538 => 28.5418, std.dev.: 0.0555) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0603) MultiSource/Applications/ClamAV/clamscan: 1.01% (17.4082 => 17.5842, std.dev.: 0.0562) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 5.29% (6.6564 => 7.0084, std.dev.: 0.0266) MultiSource/Applications/obsequi/Obsequi: 3.48% (2.0681 => 2.1401, std.dev.: 0.0115) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0122) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0293) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -4.04% (10.8967 => 10.4567, std.dev.: 0.0870) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (1.3481 => 1.3321, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 11:24:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 13:24:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409182416.8F79C2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24463?compare_to=24462&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24463, Order: 205851, Start Time: 2014-04-09 13:47:46, End Time: 2014-04-09 18:30:40 To: 24462, Order: 205847, Start Time: 2014-04-09 12:05:20, End Time: 2014-04-09 16:48:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (97 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/dt: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 17.14% (0.1400 => 0.1640, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.59% (1.0920 => 1.1640, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.2520 => 0.2680, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.09% (24.5215 => 24.2535, std.dev.: 0.0260) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.30% (1.2601 => 1.3521, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.73% (1.1881 => 1.2681, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0610) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.59% (1.0920 => 1.1640, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0550) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0388) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0553) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0443) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0449) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: 3.01% (1.4600 => 1.5040, std.dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0506) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0384) MultiSource/Applications/sqlite3/sqlite3: 2.09% (23.7574 => 24.2535, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0086) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.87% (48.1088 => 49.0089, std.dev.: 0.1016) MultiSource/Benchmarks/Bullet/bullet: 1.84% (37.0925 => 37.7766, std.dev.: 0.0520) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1290, std.dev.: 0.0297) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0197) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0213) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0586) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.07% (4.5603 => 4.7003, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -4.26% (10.8967 => 10.4327, std.dev.: 0.0833) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.13% (4.2403 => 4.1923, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 11:36:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 13:36:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409183635.48EC92A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24464?compare_to=24454&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24464, Order: 205851, Start Time: 2014-04-09 13:54:38, End Time: 2014-04-09 18:43:01 To: 24454, Order: 205841, Start Time: 2014-04-09 09:02:19, End Time: 2014-04-09 13:50:33 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1098 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Regression/C/casts: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.54% (0.3280 => 0.3560, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.4440 => 0.4760, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/bh/bh: 4.03% (0.4960 => 0.5160, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (2.1080 => 2.1760, std.dev.: 0.0198) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (4.2923 => 4.3363, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -21.98% (0.7280 => 0.5680, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 11:38:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 13:38:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409183822.166E02A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24465?compare_to=24455&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24465, Order: 205851, Start Time: 2014-04-09 13:55:25, End Time: 2014-04-09 18:44:48 To: 24455, Order: 205841, Start Time: 2014-04-09 09:01:43, End Time: 2014-04-09 13:51:16 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (141 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.50% (0.1280 => 0.1440, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.34% (0.1160 => 0.1280, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.36% (0.2240 => 0.2360, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.45% (0.4640 => 0.4800, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 250.00% (0.0080 => 0.0280, std.dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 20.00% (0.1000 => 0.1200, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.87% (0.9321 => 1.0241, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.67% (0.2400 => 0.2560, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.77% (11.3687 => 31.2380, std.dev.: 0.0623) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0148) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0105) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0044) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 20.00% (0.1200 => 0.1440, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0127) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 13.89% (0.1440 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 12.50% (0.2240 => 0.2520, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 11.54% (0.2080 => 0.2320, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.61% (1.4561 => 1.5961, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.29% (1.4961 => 1.6201, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.25% (1.5521 => 1.6801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.90% (0.3480 => 0.3720, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.35% (1.4481 => 1.5401, std.dev.: 0.0114) MultiSource/Applications/spiff/spiff: 6.35% (1.0080 => 1.0720, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0582) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (11.6440 => 12.3640, std.dev.: 0.0599) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.97% (1.5401 => 1.6321, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.57% (1.4361 => 1.5161, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0122) MultiSource/Applications/Burg/burg: 5.31% (1.5080 => 1.5880, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0322) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.23% (9.4842 => 9.9802, std.dev.: 0.0589) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.06% (1.7401 => 1.8281, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/bh/bh: 4.96% (0.4840 => 0.5080, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.5480 => 1.6200, std.dev.: 0.0278) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (10.0443 => 10.5083, std.dev.: 0.0604) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.5600 => 1.6280, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 4.32% (21.9606 => 22.9088, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (1.8440 => 1.9200, std.dev.: 0.0242) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (6.5440 => 6.8040, std.dev.: 0.0511) MultiSource/Applications/hbd/hbd: 3.92% (1.7360 => 1.8040, std.dev.: 0.0252) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0078) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.64% (50.0290 => 51.8490, std.dev.: 0.0769) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (6.5080 => 6.7240, std.dev.: 0.0623) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0091) MultiSource/Applications/SPASS/SPASS: 3.04% (18.4404 => 19.0006, std.dev.: 0.0511) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (16.3483 => 16.8363, std.dev.: 0.0383) MultiSource/Benchmarks/Bullet/bullet: 2.95% (38.4046 => 39.5366, std.dev.: 0.0644) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0143) MultiSource/Applications/oggenc/oggenc: 2.92% (6.9844 => 7.1884, std.dev.: 0.0259) MultiSource/Applications/lua/lua: 2.84% (4.7880 => 4.9240, std.dev.: 0.0302) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (5.3600 => 5.5120, std.dev.: 0.0489) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0164) MultiSource/Applications/ClamAV/clamscan: 2.48% (19.0444 => 19.5164, std.dev.: 0.0428) MultiSource/Applications/siod/siod: 2.36% (2.7162 => 2.7802, std.dev.: 0.0156) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0215) MultiSource/Applications/kimwitu++/kc: 2.17% (19.6891 => 20.1171, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0220) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.77% (2.1401 => 2.4562, std.dev.: 0.0379) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.78% (0.3600 => 0.3880, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0309) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.36% (1.5641 => 0.6200, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: -5.78% (1.8680 => 1.7600, std.dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.19% (91.8497 => 49.4271, std.dev.: 10.1107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.48% (50.3031 => 32.9581, std.dev.: 0.1667) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.40% (26.0616 => 17.0971, std.dev.: 0.1668) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.71% (42.1466 => 28.3618, std.dev.: 0.4145) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1099) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -13.21% (7.7845 => 6.7564, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0199) MultiSource/Applications/SIBsim4/SIBsim4: -1.04% (4.2123 => 4.1683, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 11:45:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 13:45:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140409184534.0533B2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24466?compare_to=24456&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24466, Order: 205851, Start Time: 2014-04-09 14:00:55, End Time: 2014-04-09 18:51:59 To: 24456, Order: 205841, Start Time: 2014-04-09 09:05:13, End Time: 2014-04-09 13:56:43 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (132 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2006-02-04-DivRem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 5.88% (0.2720 => 0.2880, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.63% (0.4560 => 0.4680, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: 2.42% (10.2726 => 10.5207, std.dev.: 0.0606) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.8000 => 1.8280, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -6.70% (0.8360 => 0.7800, std.dev.: 0.0214) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0091) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.68% (1.7681 => 2.1161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.66% (1.6681 => 1.9961, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.99% (1.9801 => 2.3561, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.38% (0.1040 => 0.1200, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0083) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.42% (0.6120 => 0.6880, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0185) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (3.5002 => 3.7562, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 6.12% (0.1960 => 0.2080, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.04% (11.7880 => 12.5000, std.dev.: 0.0780) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.79% (1.7280 => 1.8280, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.48% (6.7200 => 7.0880, std.dev.: 0.0432) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.17% (0.2320 => 0.2440, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (2.0680 => 2.1640, std.dev.: 0.0247) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0061) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0142) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.9842 => 10.4122, std.dev.: 0.0490) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3040 => 0.3160, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (1.6481 => 1.7121, std.dev.: 0.0110) MultiSource/Applications/treecc/treecc: 3.82% (2.6200 => 2.7200, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (6.8321 => 7.0921, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/oourafft: 3.75% (0.3200 => 0.3320, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 3.73% (3.9641 => 4.1121, std.dev.: 0.0319) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0183) MultiSource/Applications/oggenc/oggenc: 3.30% (6.9124 => 7.1404, std.dev.: 0.0174) MultiSource/Applications/SPASS/SPASS: 3.27% (18.4924 => 19.0965, std.dev.: 0.0521) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.5000 => 0.5160, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (10.3203 => 10.6163, std.dev.: 0.0384) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 2.63% (22.6287 => 23.2247, std.dev.: 0.0534) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.56% (0.4680 => 0.4800, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (5.5480 => 5.6840, std.dev.: 0.0222) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.35% (51.1089 => 52.3089, std.dev.: 0.1510) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (16.5963 => 16.9763, std.dev.: 0.0368) MultiSource/Applications/kimwitu++/kc: 2.27% (19.7371 => 20.1851, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 1.90% (20.2445 => 20.6285, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: 1.82% (38.9366 => 39.6446, std.dev.: 0.0894) MultiSource/Applications/sqlite3/sqlite3: 1.27% (25.1895 => 25.5095, std.dev.: 0.0440) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0244 => 6.1004, std.dev.: 0.0260) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7722 => 2.8002, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.58% (0.9281 => 1.1841, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0684) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.52% (6.8204 => 6.9924, std.dev.: 0.0539) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 1.75% (7.5485 => 7.6805, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0164) MultiSource/Applications/lua/lua: 1.63% (21.6534 => 22.0054, std.dev.: 0.0980) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -79.01% (6.2884 => 1.3201, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.23% (1.5881 => 0.5680, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0103) SingleSource/UnitTests/2008-07-13-InlineSetjmp: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -32.93% (2.6481 => 1.7760, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout/matrix: -31.25% (0.1280 => 0.0880, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.58% (7.4801 => 6.2400, std.dev.: 0.0312) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.83% (7.5041 => 6.3160, std.dev.: 0.0288) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -3.56% (10.9087 => 10.5207, std.dev.: 0.0606) MultiSource/Benchmarks/mafft/pairlocalalign: -3.08% (13.5243 => 13.1083, std.dev.: 0.0329) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0071) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.66% (3.4442 => 3.0082, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.19% (0.9281 => 0.8521, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -2.25% (5.1603 => 5.0443, std.dev.: 0.0199) MultiSource/Applications/JM/lencod/lencod: -1.73% (8.3085 => 8.1645, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3401 => 2.3121, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 11:48:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 13:48:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140409184844.DDE1E2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24467?compare_to=24457&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24467, Order: 205851, Start Time: 2014-04-09 14:02:37, End Time: 2014-04-09 18:55:07 To: 24457, Order: 205841, Start Time: 2014-04-09 09:06:04, End Time: 2014-04-09 13:58:33 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 11 (128 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (953 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-LocalTypeTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Treesort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.50% (0.3200 => 0.3600, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.43% (0.1400 => 0.1560, std.dev.: 0.0056) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.11% (0.1480 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.7520 => 0.7960, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.92% (0.2440 => 0.2560, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.43% (17.6723 => 19.5163, std.dev.: 0.0669) MultiSource/Applications/sqlite3/sqlite3: 1419.06% (1.7001 => 25.8256, std.dev.: 0.0305) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.43% (50.1010 => 51.8170, std.dev.: 0.1016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.25% (11.3920 => 12.3320, std.dev.: 0.0486) SingleSource/Benchmarks/Misc/oourafft: 175.52% (11.3407 => 31.2460, std.dev.: 0.1160) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0563, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7164, std.dev.: 0.0101) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0084) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0043) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0091) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.22% (0.1840 => 0.2120, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.93% (1.9521 => 2.2241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.72% (1.8361 => 2.0881, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.33% (1.8601 => 2.1081, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.18% (1.9721 => 2.2321, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.60% (2.1041 => 2.3481, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0100) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.38% (2.1441 => 2.3881, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.11% (0.3240 => 0.3600, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2280 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.29% (1.0880 => 1.2000, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.86% (2.0681 => 2.2721, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2440 => 0.2640, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.67% (0.2400 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (1.6960 => 1.8080, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: 6.30% (1.0160 => 1.0800, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.68% (6.4800 => 6.8480, std.dev.: 0.0407) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.9960 => 1.0520, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0216) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 4.55% (0.6160 => 0.6440, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0164) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (9.6042 => 10.0242, std.dev.: 0.0497) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (5.8281 => 6.0761, std.dev.: 0.0425) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (6.5320 => 6.8000, std.dev.: 0.0289) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0072) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 3.67% (4.7920 => 4.9680, std.dev.: 0.0323) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (6.5360 => 6.7760, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.07% (1.5640 => 1.6120, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0107) MultiSource/Applications/oggenc/oggenc: 2.78% (7.0524 => 7.2485, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (16.3003 => 16.7243, std.dev.: 0.0500) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (2.1600 => 2.2160, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (1.0840 => 1.1120, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.3960 => 5.5320, std.dev.: 0.0524) MultiSource/Applications/SPASS/SPASS: 2.50% (18.5284 => 18.9924, std.dev.: 0.0557) MultiSource/Applications/JM/lencod/lencod: 2.47% (22.2206 => 22.7687, std.dev.: 0.0557) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (2.3401 => 2.3961, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: 2.30% (38.6366 => 39.5246, std.dev.: 0.0663) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 1.96% (10.2283 => 10.4283, std.dev.: 0.0351) MultiSource/Applications/kimwitu++/kc: 1.43% (19.8291 => 20.1131, std.dev.: 0.0397) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.59% (2.1201 => 2.4082, std.dev.: 0.0516) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0315) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.64% (7.3725 => 7.6405, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.82% (6.5964 => 6.7164, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (4.0003 => 4.0723, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (3.9442 => 3.9882, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -77.13% (2.9562 => 0.6760, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0069) MultiSource/Applications/obsequi/Obsequi: -5.97% (1.8760 => 1.7640, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.85% (94.8339 => 49.4591, std.dev.: 10.1671) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.05% (49.9431 => 32.9381, std.dev.: 0.1503) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.60% (25.7136 => 17.0731, std.dev.: 0.1659) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.96% (37.0863 => 28.9418, std.dev.: 0.3264) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.78% (5.6124 => 5.5123, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 11:51:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 13:51:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140409185132.333FD2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24468?compare_to=24458&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24468, Order: 205851, Start Time: 2014-04-09 14:04:35, End Time: 2014-04-09 18:57:56 To: 24458, Order: 205841, Start Time: 2014-04-09 09:07:03, End Time: 2014-04-09 14:00:31 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (149 on baseline) Performance Improvements: 4 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init: 400.00% (0.0040 => 0.0200, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C++/EH/class_hierarchy: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: 33.33% (0.0480 => 0.0640, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) MultiSource/Benchmarks/NPB-serial/is/is: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.87% (0.1840 => 0.2040, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.51% (0.1880 => 0.2040, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/nestedloop: 3.07% (0.6520 => 0.6720, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -1.57% (2.8042 => 2.7602, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.41% (2.2761 => 2.2441, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: -1.09% (20.2131 => 19.9931, std.dev.: 0.0548) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.11% (0.1080 => 0.0960, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0070) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0106) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 757.89% (0.0760 => 0.6520, std.dev.: 0.0052) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 398.45% (0.2520 => 1.2561, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0097) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0066) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0068) SingleSource/Regression/C/test_indvars: 100.00% (0.0320 => 0.0640, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0068) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/dt: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: 20.11% (1.3920 => 1.6720, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.75% (1.1521 => 1.3681, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.60% (0.1720 => 0.2040, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 18.60% (8.5802 => 10.1763, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.31% (1.1361 => 1.3441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0116) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.90% (1.1841 => 1.3961, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.77% (1.2881 => 1.5041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.33% (1.2001 => 1.3961, std.dev.: 0.0160) MultiSource/Applications/sgefa/sgefa: 16.07% (0.4480 => 0.5200, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 15.33% (19.5406 => 22.5367, std.dev.: 0.0631) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.39% (5.3360 => 6.1041, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 13.31% (1.3521 => 1.5321, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.03% (1.7400 => 1.9320, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/ary: 10.00% (0.2800 => 0.3080, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 8.53% (6.2844 => 6.8204, std.dev.: 0.0149) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.51% (0.1880 => 0.2040, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 8.33% (11.3843 => 12.3323, std.dev.: 0.0455) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.24% (5.7280 => 6.2000, std.dev.: 0.0427) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.12% (5.6680 => 6.1280, std.dev.: 0.0485) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.76% (11.4440 => 12.3320, std.dev.: 0.0626) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (9.5802 => 10.1522, std.dev.: 0.0401) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.6240 => 1.7080, std.dev.: 0.0227) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0305) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (6.8280 => 7.0960, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0204) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0080) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.01% (49.1529 => 50.6329, std.dev.: 0.0985) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (5.3840 => 5.5440, std.dev.: 0.0356) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (2.0920 => 2.1520, std.dev.: 0.0185) MultiSource/Applications/ClamAV/clamscan: 2.60% (19.2243 => 19.7244, std.dev.: 0.0688) MultiSource/Applications/sqlite3/sqlite3: 2.39% (24.7575 => 25.3495, std.dev.: 0.0458) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (2.7282 => 2.7802, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.63% (2.2081 => 2.2441, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 1.36% (39.0726 => 39.6046, std.dev.: 0.0678) MultiSource/Applications/kimwitu++/kc: 1.24% (19.7491 => 19.9931, std.dev.: 0.0548) MultiSource/Applications/SPASS/SPASS: 1.02% (18.7966 => 18.9886, std.dev.: 0.0305) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.74% (6.6644 => 17.1771, std.dev.: 0.0038) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 18.18% (0.9241 => 1.0921, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0721) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.76% (6.8204 => 7.0084, std.dev.: 0.0421) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.3085 => 7.4725, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -5.84% (11.0207 => 10.3766, std.dev.: 0.1131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -15.73% (7.8605 => 6.6244, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0890) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -1.76% (4.9963 => 4.9083, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0213) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 12:34:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 14:34:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409193452.A782A2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24469?compare_to=24463&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24469, Order: 205855, Start Time: 2014-04-09 14:55:03, End Time: 2014-04-09 19:41:16 To: 24463, Order: 205851, Start Time: 2014-04-09 13:47:46, End Time: 2014-04-09 18:30:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (96 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.50% (0.1280 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.29% (0.2480 => 0.2760, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 10.53% (0.1520 => 0.1680, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 6.80% (0.4120 => 0.4400, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/18-imp/imp: 3.81% (0.4200 => 0.4360, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.21% (1.2681 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.48% (1.3521 => 1.3721, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.37% (15.1882 => 15.3962, std.dev.: 0.0300) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.49% (0.3480 => 0.3880, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4322 => 2.4602, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: -66.67% (0.0240 => 0.0080, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0043) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.29% (0.2480 => 0.2760, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.14% (0.2240 => 0.2400, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0769) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0316) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.78% (0.7400 => 0.7680, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (5.8400 => 6.0520, std.dev.: 0.0529) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0178) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0580) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0546) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.12% (48.1088 => 49.1289, std.dev.: 0.0923) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0394) MultiSource/Benchmarks/Bullet/bullet: 2.01% (37.0925 => 37.8366, std.dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 1.47% (18.8170 => 19.0930, std.dev.: 0.0411) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.10% (15.2282 => 15.3962, std.dev.: 0.0300) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0249) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0523) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -4.48% (10.8967 => 10.4086, std.dev.: 0.1215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 16:42:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 18:42:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409234204.D56BB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24470?compare_to=24469&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24470, Order: 205918, Start Time: 2014-04-09 19:05:29, End Time: 2014-04-09 23:48:28 To: 24469, Order: 205855, Start Time: 2014-04-09 14:55:03, End Time: 2014-04-09 19:41:16 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (110 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/pi: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.22% (0.0720 => 0.0880, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.81% (0.2160 => 0.2480, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.51% (1.3680 => 1.4160, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 10.14% (0.2760 => 0.3040, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (1.2481 => 1.2721, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0153) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2160 => 0.2320, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0498) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0391) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 5.67% (0.9880 => 1.0440, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0250) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.03% (8.1441 => 8.4721, std.dev.: 0.0320) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0445) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0618) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0386) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (10.4082 => 10.7242, std.dev.: 0.0556) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0106) MultiSource/Applications/Burg/burg: 3.01% (1.4600 => 1.5040, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.91% (1.3760 => 1.4160, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 2.32% (17.6165 => 18.0245, std.dev.: 0.0489) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0341) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.98% (48.1088 => 49.0609, std.dev.: 0.0771) MultiSource/Applications/sqlite3/sqlite3: 1.80% (23.7574 => 24.1855, std.dev.: 0.0324) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (7.8562 => 7.9962, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 1.50% (37.0925 => 37.6485, std.dev.: 0.0929) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0164) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0369) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/bigfib: 8.57% (0.2800 => 0.3040, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0352) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.58% (0.9601 => 1.0041, std.dev.: 0.0140) MultiSource/Applications/obsequi/Obsequi: 3.29% (2.0681 => 2.1361, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0278) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0261) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 1.00% (21.1533 => 21.3653, std.dev.: 0.0665) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -9.09% (0.1760 => 0.1600, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -4.85% (10.8967 => 10.3686, std.dev.: 0.1005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.05% (3.3482 => 3.1122, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 16:44:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 18:44:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409234400.9A7782A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24471?compare_to=24464&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24471, Order: 205918, Start Time: 2014-04-09 19:01:49, End Time: 2014-04-09 23:50:26 To: 24464, Order: 205851, Start Time: 2014-04-09 13:54:38, End Time: 2014-04-09 18:43:01 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1106 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_shift: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.76% (0.3360 => 0.3520, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.39% (0.0920 => 0.1080, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 9.89% (0.3640 => 0.4000, std.dev.: 0.0116) MultiSource/Benchmarks/llubenchmark/llu: 5.81% (5.0923 => 5.3883, std.dev.: 0.1086) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 16:44:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 18:44:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140409234456.308592A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24472?compare_to=24465&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24472, Order: 205918, Start Time: 2014-04-09 19:02:05, End Time: 2014-04-09 23:51:21 To: 24465, Order: 205851, Start Time: 2014-04-09 13:55:25, End Time: 2014-04-09 18:44:48 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 7 (138 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (949 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: 33.33% (0.0480 => 0.0640, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.33% (0.1440 => 0.1560, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.11% (1.5161 => 1.5481, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.09% (1.8281 => 1.8481, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.00% (11.3687 => 31.1499, std.dev.: 0.0708) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0122) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 400.00% (0.0040 => 0.0200, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0102) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.65% (0.2040 => 0.2400, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.02% (1.0240 => 1.1880, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.55% (0.6200 => 0.7040, std.dev.: 0.0180) SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.57% (1.8161 => 2.0081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0104) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0139) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.96% (1.6521 => 1.8001, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.44% (1.6121 => 1.7481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 7.94% (1.0080 => 1.0880, std.dev.: 0.0195) MultiSource/Benchmarks/McCat/05-eks/eks: 7.88% (0.6600 => 0.7120, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.80% (1.4361 => 1.5481, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.49% (1.4961 => 1.6081, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.56% (11.6440 => 12.4080, std.dev.: 0.0603) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0038) SingleSource/Regression/C/bigstack: 6.52% (0.1840 => 0.1960, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.4680 => 6.8640, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.04% (1.4561 => 1.5441, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (9.4842 => 9.9842, std.dev.: 0.0586) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.95% (0.8881 => 0.9321, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0178) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (10.0443 => 10.5283, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.82% (5.8121 => 6.0921, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/hash2: 4.76% (0.5040 => 0.5280, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0200) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0095) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: 3.97% (21.9606 => 22.8328, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (1.7400 => 1.8080, std.dev.: 0.0210) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (6.5440 => 6.7960, std.dev.: 0.0522) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.57% (50.0290 => 51.8170, std.dev.: 0.0831) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (6.5080 => 6.7400, std.dev.: 0.0501) MultiSource/Applications/oggenc/oggenc: 3.38% (6.9844 => 7.2205, std.dev.: 0.0116) MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.7921 => 1.8521, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (5.3600 => 5.5360, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0136) MultiSource/Applications/SPASS/SPASS: 2.91% (18.4404 => 18.9765, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 2.80% (38.4046 => 39.4806, std.dev.: 0.0471) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5283, std.dev.: 0.0536) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (16.3483 => 16.7363, std.dev.: 0.0472) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (1.1000 => 1.1240, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: 2.02% (3.9681 => 4.0481, std.dev.: 0.0162) MultiSource/Applications/siod/siod: 1.77% (2.7162 => 2.7642, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: 1.38% (19.6891 => 19.9611, std.dev.: 0.0751) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.40% (2.1401 => 2.4482, std.dev.: 0.0307) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0215) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0471) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.77% (2.9442 => 0.6840, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0077) MultiSource/Applications/obsequi/Obsequi: -5.35% (1.8680 => 1.7680, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.14% (91.8497 => 49.4671, std.dev.: 10.4776) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.33% (50.3031 => 33.0341, std.dev.: 0.1559) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.04% (26.0616 => 17.1891, std.dev.: 0.1097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.10% (42.1466 => 28.6178, std.dev.: 0.4621) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1074) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0054) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.58% (4.8083 => 4.6363, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3561 => 2.3081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0098) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 16:52:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 18:52:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140409235221.53EF82A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24473?compare_to=24470&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24473, Order: 205920, Start Time: 2014-04-09 19:15:52, End Time: 2014-04-09 23:58:41 To: 24470, Order: 205918, Start Time: 2014-04-09 19:05:29, End Time: 2014-04-09 23:48:28 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (96 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2008-04-20-LoopBug2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 64.29% (0.0560 => 0.0920, std.dev.: 0.0089) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.67% (0.0720 => 0.0840, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.00% (0.1000 => 0.1120, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.96% (0.2680 => 0.2920, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (1.0640 => 1.1280, std.dev.: 0.0236) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (1.1000 => 1.1600, std.dev.: 0.0188) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 12.16% (0.2960 => 0.3320, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.00% (0.1000 => 0.1120, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -1.20% (1.3361 => 1.3201, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0056) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0114) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.66% (1.1481 => 1.2361, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.57% (1.2161 => 1.3081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.14% (0.2800 => 0.3000, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0569) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (5.8000 => 6.0560, std.dev.: 0.0194) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0484) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0423) MultiSource/Applications/lua/lua: 3.10% (4.5200 => 4.6600, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0294) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 2.52% (17.6165 => 18.0605, std.dev.: 0.0476) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0365) MultiSource/Applications/sqlite3/sqlite3: 1.89% (23.7574 => 24.2055, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0107) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.72% (48.1088 => 48.9369, std.dev.: 0.0770) MultiSource/Benchmarks/Bullet/bullet: 1.71% (37.0925 => 37.7285, std.dev.: 0.0801) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 1.24% (2.5721 => 2.6041, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0145) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 1.04% (18.8170 => 19.0130, std.dev.: 0.0428) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0185) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0099) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0243) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.9443 => 5.0003, std.dev.: 0.0177) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -14.29% (0.0840 => 0.0720, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -4.77% (10.8967 => 10.3766, std.dev.: 0.1294) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 16:53:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 18:53:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140409235355.A896B2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24474?compare_to=24466&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24474, Order: 205918, Start Time: 2014-04-09 19:09:06, End Time: 2014-04-10 00:00:21 To: 24466, Order: 205851, Start Time: 2014-04-09 14:00:55, End Time: 2014-04-09 18:51:59 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (121 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (958 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.00% (0.0800 => 0.0920, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 13.33% (0.1200 => 0.1360, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.36% (0.1760 => 0.1960, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.74% (0.3560 => 0.3800, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.26% (0.2280 => 0.2400, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.61% (1.4400 => 1.4920, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.97% (3.4962 => 3.6002, std.dev.: 0.0323) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0084) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.13% (1.8881 => 2.2681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.52% (1.6801 => 2.0081, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.38% (1.6921 => 2.0201, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.30% (1.7201 => 2.0521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.79% (1.9801 => 2.3521, std.dev.: 0.0133) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.10% (1.7241 => 2.0361, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ffbench: 17.24% (0.1160 => 0.1360, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.03% (0.6120 => 0.7040, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: 8.24% (1.0200 => 1.1040, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.95% (0.3520 => 0.3800, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (11.7880 => 12.4840, std.dev.: 0.1085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.60% (6.7200 => 7.0960, std.dev.: 0.0512) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.4160 => 1.4920, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.7280 => 1.8200, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 4.71% (0.3400 => 0.3560, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0206) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (9.9842 => 10.4402, std.dev.: 0.0336) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (1.6481 => 1.7121, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 3.59% (6.9124 => 7.1604, std.dev.: 0.0120) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.6801 => 1.7401, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0190) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.41% (1.5240 => 1.5760, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (6.8321 => 7.0561, std.dev.: 0.0440) MultiSource/Applications/SPASS/SPASS: 3.16% (18.4924 => 19.0766, std.dev.: 0.0482) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.97% (1.3480 => 1.3880, std.dev.: 0.0150) MultiSource/Applications/d/make_dparser: 2.83% (3.9641 => 4.0761, std.dev.: 0.0364) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (10.3203 => 10.5763, std.dev.: 0.0505) MultiSource/Applications/JM/lencod/lencod: 2.44% (22.6287 => 23.1807, std.dev.: 0.0533) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0065) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (51.1089 => 52.2569, std.dev.: 0.1349) MultiSource/Applications/kimwitu++/kc: 1.93% (19.7371 => 20.1171, std.dev.: 0.0423) MultiSource/Applications/ClamAV/clamscan: 1.90% (20.2445 => 20.6285, std.dev.: 0.0645) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0166) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0156) MultiSource/Benchmarks/Bullet/bullet: 1.66% (38.9366 => 39.5846, std.dev.: 0.0836) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (16.5963 => 16.8723, std.dev.: 0.0616) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (3.0122 => 3.0562, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 1.30% (25.1895 => 25.5175, std.dev.: 0.0284) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 28.01% (0.9281 => 1.1881, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0445) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0219) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.33% (3.4842 => 3.6002, std.dev.: 0.0323) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.95% (1.4361 => 1.4641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.68% (4.7563 => 4.8363, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0182) MultiSource/Applications/lua/lua: 1.53% (21.6534 => 21.9854, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 1.11% (7.5485 => 7.6325, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.56% (6.2884 => 1.3481, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/nestedloop: -64.78% (2.9642 => 1.0441, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0081) MultiSource/Applications/obsequi/Obsequi: -34.29% (2.6481 => 1.7400, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.69% (7.4801 => 6.2320, std.dev.: 0.0399) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.99% (7.5041 => 6.3040, std.dev.: 0.0502) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0106) SingleSource/UnitTests/Vector/constpool: -6.05% (10.9087 => 10.2486, std.dev.: 0.1152) MultiSource/Benchmarks/McCat/05-eks/eks: -3.53% (0.6800 => 0.6560, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: -3.16% (13.5243 => 13.0963, std.dev.: 0.0412) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -2.25% (5.1603 => 5.0443, std.dev.: 0.0205) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -1.13% (11.6527 => 11.5207, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 16:57:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 18:57:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140409235753.AA7BA2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24475?compare_to=24467&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24475, Order: 205918, Start Time: 2014-04-09 19:11:50, End Time: 2014-04-10 00:04:18 To: 24467, Order: 205851, Start Time: 2014-04-09 14:02:37, End Time: 2014-04-09 18:55:07 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (124 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (956 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: 10.20% (0.1960 => 0.2160, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.19% (0.3760 => 0.3880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.43% (2.2321 => 2.2641, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/d/make_dparser: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.21% (0.3040 => 0.3320, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0129) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.89% (17.6723 => 19.5964, std.dev.: 0.0347) MultiSource/Applications/sqlite3/sqlite3: 1414.12% (1.7001 => 25.7416, std.dev.: 0.0610) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.31% (50.1010 => 51.7610, std.dev.: 0.0893) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (1.0520 => 1.0520, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.79% (11.3920 => 12.2800, std.dev.: 0.0753) SingleSource/Benchmarks/Misc/oourafft: 175.45% (11.3407 => 31.2380, std.dev.: 0.0763) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0563, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0151) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0122) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: 14.63% (0.3280 => 0.3760, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.38% (1.8081 => 2.0681, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.51% (1.8361 => 2.0841, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.97% (1.9121 => 2.1601, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0090) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.84% (1.8081 => 2.0041, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.33% (1.8201 => 2.0081, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.14% (2.0521 => 2.2601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.02% (1.8361 => 2.0201, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.68% (1.8601 => 2.0401, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3640 => 0.3880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 6.30% (1.0160 => 1.0800, std.dev.: 0.0190) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.93% (2.9721 => 3.1482, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.31% (6.4800 => 6.8240, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.08% (0.7880 => 0.8280, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.00% (0.2400 => 0.2520, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.29% (6.5320 => 6.8120, std.dev.: 0.0232) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.16% (9.6042 => 10.0042, std.dev.: 0.0471) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (5.8281 => 6.0561, std.dev.: 0.0356) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (0.3760 => 0.3880, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 3.17% (4.7920 => 4.9440, std.dev.: 0.0327) MultiSource/Applications/Burg/burg: 3.14% (1.5280 => 1.5760, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.12% (1.6641 => 1.7161, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0563) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0091) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.47% (22.2206 => 22.7688, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (16.3003 => 16.6963, std.dev.: 0.0427) MultiSource/Applications/SPASS/SPASS: 2.14% (18.5284 => 18.9245, std.dev.: 0.0705) MultiSource/Benchmarks/Bullet/bullet: 2.01% (38.6366 => 39.4126, std.dev.: 0.0669) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 1.45% (10.2283 => 10.3763, std.dev.: 0.0461) MultiSource/Applications/kimwitu++/kc: 1.15% (19.8291 => 20.0571, std.dev.: 0.0410) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0370) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0368) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.61% (6.5964 => 6.7684, std.dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.72% (3.9442 => 4.0122, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (3.7442 => 3.7962, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.46% (2.9562 => 0.6960, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0062) SingleSource/UnitTests/printargs: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -5.54% (1.8760 => 1.7720, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.92% (94.8339 => 49.3911, std.dev.: 10.3350) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.94% (49.9431 => 32.9941, std.dev.: 0.1451) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.63% (25.7136 => 17.0651, std.dev.: 0.1214) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.57% (3.0722 => 2.3481, std.dev.: 0.1128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.89% (37.0863 => 28.5978, std.dev.: 0.4813) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3521 => 2.3041, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 17:00:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 19:00:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140410000013.3686E2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24476?compare_to=24468&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24476, Order: 205918, Start Time: 2014-04-09 19:14:48, End Time: 2014-04-10 00:06:34 To: 24468, Order: 205851, Start Time: 2014-04-09 14:04:35, End Time: 2014-04-09 18:57:56 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (157 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: 26.67% (0.0600 => 0.0760, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.84% (0.2440 => 0.2680, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 7.41% (0.2160 => 0.2320, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.15% (0.2600 => 0.2760, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.4480 => 0.4720, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.56% (1.5361 => 1.5601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.30% (1.5441 => 1.5641, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0105) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0085) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 390.52% (0.2520 => 1.2361, std.dev.: 0.0127) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0062) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 85.00% (0.0800 => 0.1480, std.dev.: 0.0049) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 45.83% (0.0960 => 0.1400, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 27.27% (0.0880 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.95% (1.2321 => 1.5641, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: 26.67% (0.0600 => 0.0760, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.00% (1.2481 => 1.5601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.55% (1.2401 => 1.5321, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0053) MultiSource/Applications/obsequi/Obsequi: 22.41% (1.3920 => 1.7040, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.12% (1.2921 => 1.5521, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.73% (1.1761 => 1.4081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 18.42% (8.5802 => 10.1603, std.dev.: 0.0261) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.18% (1.1441 => 1.3521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.09% (1.1721 => 1.3841, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.89% (1.2521 => 1.4761, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 14.74% (19.5406 => 22.4207, std.dev.: 0.0687) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.39% (5.3360 => 6.1041, std.dev.: 0.0319) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0256) MultiSource/Benchmarks/nbench/nbench: 11.83% (1.3521 => 1.5121, std.dev.: 0.0210) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0053) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0137) MultiSource/Applications/viterbi/viterbi: 9.43% (0.2120 => 0.2320, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (11.3843 => 12.3963, std.dev.: 0.0418) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.31% (5.7280 => 6.2040, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.02% (0.6480 => 0.7000, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (11.4440 => 12.3440, std.dev.: 0.0301) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.48% (5.6680 => 6.0920, std.dev.: 0.0542) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.64% (9.5802 => 10.2162, std.dev.: 0.0250) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0091) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2760 => 0.2880, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0105) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/gs/gs: 3.42% (5.3840 => 5.5680, std.dev.: 0.0412) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (6.8280 => 7.0440, std.dev.: 0.0397) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.02% (49.1529 => 50.6369, std.dev.: 0.0732) MultiSource/Applications/lua/lua: 2.93% (4.7720 => 4.9120, std.dev.: 0.0457) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 2.68% (19.2243 => 19.7404, std.dev.: 0.0359) MultiSource/Applications/sqlite3/sqlite3: 2.25% (24.7575 => 25.3135, std.dev.: 0.0298) MultiSource/Benchmarks/PAQ8p/paq8p: 1.47% (2.7282 => 2.7682, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 1.29% (39.0726 => 39.5766, std.dev.: 0.0495) MultiSource/Applications/kimwitu++/kc: 1.22% (19.7491 => 19.9891, std.dev.: 0.0543) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.95% (0.1720 => 0.1960, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.54% (3.9842 => 4.3243, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0301) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.3085 => 7.4685, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.59% (11.0207 => 10.4047, std.dev.: 0.1152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -8.99% (3.4722 => 3.1602, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0922) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -1.68% (4.9963 => 4.9123, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 17:22:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 19:22:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410002231.6BFD42A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24477?compare_to=24473&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24477, Order: 205921, Start Time: 2014-04-09 19:41:32, End Time: 2014-04-10 00:28:55 To: 24473, Order: 205920, Start Time: 2014-04-09 19:15:52, End Time: 2014-04-09 23:58:41 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (95 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (1001 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 27.78% (0.0720 => 0.0920, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.38% (0.1280 => 0.1400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 8.20% (0.2440 => 0.2640, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.74% (0.6720 => 0.7240, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary2: 5.63% (0.2840 => 0.3000, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0151) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 16.00% (0.1000 => 0.1160, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 15.00% (0.0800 => 0.0920, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0715) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0293) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.68% (0.5440 => 0.5640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3480 => 0.3600, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0343) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0344) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: 2.38% (17.6165 => 18.0365, std.dev.: 0.0409) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0460) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.84% (48.1088 => 48.9929, std.dev.: 0.0704) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 1.37% (37.0925 => 37.6006, std.dev.: 0.0789) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0162) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0333) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -22.22% (0.0720 => 0.0560, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -4.22% (10.8967 => 10.4367, std.dev.: 0.0708) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 17:45:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 19:45:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410004531.D62D82A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24478?compare_to=24477&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24478, Order: 205922, Start Time: 2014-04-09 20:09:12, End Time: 2014-04-10 00:51:55 To: 24477, Order: 205921, Start Time: 2014-04-09 19:41:32, End Time: 2014-04-10 00:28:55 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (98 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 14.29% (0.0840 => 0.0960, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.86% (1.2881 => 1.3121, std.dev.: 0.0084) MultiSource/Applications/treecc/treecc: 1.80% (2.4440 => 2.4880, std.dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 30.77% (0.0520 => 0.0680, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0084) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.55% (1.2721 => 1.3681, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.27% (1.1561 => 1.2401, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0771) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0291) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0449) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0387) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0420) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0520) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0274) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0391) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (2.1201 => 2.1641, std.dev.: 0.0138) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 1.70% (23.7574 => 24.1615, std.dev.: 0.0507) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.69% (48.1088 => 48.9208, std.dev.: 0.0651) MultiSource/Benchmarks/Bullet/bullet: 1.54% (37.0925 => 37.6646, std.dev.: 0.0773) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.6321 => 1.6521, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0206) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0269) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.72% (3.5322 => 3.6282, std.dev.: 0.0225) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -6.24% (10.8967 => 10.2166, std.dev.: 0.1445) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 18:07:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 20:07:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410010757.6F16B2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24479?compare_to=24478&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24479, Order: 205923, Start Time: 2014-04-09 20:29:17, End Time: 2014-04-10 01:14:20 To: 24478, Order: 205922, Start Time: 2014-04-09 20:09:12, End Time: 2014-04-10 00:51:55 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (108 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-09-ArrayResolution: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.05% (0.0760 => 0.0920, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.61% (0.7360 => 0.7920, std.dev.: 0.0196) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0086) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: 2.31% (10.2166 => 10.4527, std.dev.: 0.0687) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.08% (1.5400 => 1.5720, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.94% (1.2401 => 1.2641, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (2.0200 => 2.0520, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (5.7444 => 5.8044, std.dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (10.6960 => 11.3440, std.dev.: 0.0827) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0471) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0122) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0207) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0376) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0456) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0443) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0307) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0366) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0424) MultiSource/Applications/JM/lencod/lencod: 2.43% (17.6165 => 18.0445, std.dev.: 0.0787) MultiSource/Benchmarks/Bullet/bullet: 2.16% (37.0925 => 37.8926, std.dev.: 0.0564) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.04% (48.1088 => 49.0889, std.dev.: 0.0952) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0321) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 1.49% (18.8170 => 19.0970, std.dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0140) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0266) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 11.11% (0.1800 => 0.2000, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 5.23% (6.6564 => 7.0044, std.dev.: 0.0444) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.85% (0.7280 => 0.7560, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0106) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -15.91% (0.1760 => 0.1480, std.dev.: 0.0100) SingleSource/UnitTests/Vector/constpool: -4.07% (10.8967 => 10.4527, std.dev.: 0.0687) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 21:29:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 23:29:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410042924.54DBF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24480?compare_to=24479&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24480, Order: 205937, Start Time: 2014-04-09 23:52:52, End Time: 2014-04-10 04:35:47 To: 24479, Order: 205923, Start Time: 2014-04-09 20:29:17, End Time: 2014-04-10 01:14:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (87 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (1007 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Perm: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 40.00% (0.0400 => 0.0560, std.dev.: 0.0045) MultiSource/Applications/aha/aha: 18.52% (0.1080 => 0.1280, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 12.50% (0.1280 => 0.1440, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 33.33% (0.0720 => 0.0960, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0603) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0246) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3800 => 1.4360, std.dev.: 0.0193) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0651) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0447) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0213) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0562) MultiSource/Applications/JM/lencod/lencod: 2.36% (17.6165 => 18.0325, std.dev.: 0.0466) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 1.82% (37.0925 => 37.7685, std.dev.: 0.0841) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (7.8562 => 7.9962, std.dev.: 0.0397) MultiSource/Applications/sqlite3/sqlite3: 1.63% (23.7574 => 24.1455, std.dev.: 0.0577) MultiSource/Applications/kimwitu++/kc: 1.59% (18.8170 => 19.1171, std.dev.: 0.0419) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.50% (48.1088 => 48.8289, std.dev.: 0.1366) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 26.32% (0.0760 => 0.0960, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0260) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.00% (0.6000 => 0.6120, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: -16.67% (0.0720 => 0.0600, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -4.52% (10.8967 => 10.4047, std.dev.: 0.1055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 21:36:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 23:36:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140410043639.DF1F72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24481?compare_to=24471&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24481, Order: 205937, Start Time: 2014-04-09 23:54:46, End Time: 2014-04-10 04:43:05 To: 24471, Order: 205918, Start Time: 2014-04-09 19:01:49, End Time: 2014-04-09 23:50:26 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1109 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.59% (0.2920 => 0.3200, std.dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 21:38:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 23:38:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140410043821.A05F72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24482?compare_to=24472&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24482, Order: 205937, Start Time: 2014-04-09 23:55:45, End Time: 2014-04-10 04:44:45 To: 24472, Order: 205918, Start Time: 2014-04-09 19:02:05, End Time: 2014-04-09 23:51:21 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 11 (140 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-31-CastToBool: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 40.00% (0.0400 => 0.0560, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.92% (0.6840 => 0.7040, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.06% (1.5041 => 1.5201, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 28.57% (0.0560 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 5.32% (0.3760 => 0.3960, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.86% (1.6801 => 1.7281, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/2003-05-14-initialize-string: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 173.15% (11.3687 => 31.0539, std.dev.: 0.0876) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0069) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0082) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0056) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 33.33% (0.0960 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 20.24% (0.3360 => 0.4040, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0201) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.32% (0.6200 => 0.6840, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.23% (0.7040 => 0.7760, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.72% (1.4401 => 1.5801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.31% (1.4601 => 1.5961, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/05-eks/eks: 9.09% (0.6600 => 0.7200, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.79% (0.3640 => 0.3960, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.78% (1.5481 => 1.6841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.62% (1.4841 => 1.6121, std.dev.: 0.0156) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.88% (1.7761 => 1.9161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/matrix: 7.25% (0.2760 => 0.2960, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.25% (1.0240 => 1.0880, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.95% (1.6121 => 1.7081, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (6.4680 => 6.8400, std.dev.: 0.0399) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.73% (0.7680 => 0.8120, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.71% (1.5401 => 1.6281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.68% (1.4801 => 1.5641, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.53% (11.6440 => 12.2880, std.dev.: 0.0713) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (1.7401 => 1.8361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.44% (1.6921 => 1.7841, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.39% (1.4841 => 1.5641, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.35% (1.4201 => 1.4961, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.19% (9.4842 => 9.9762, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.7000 => 0.7360, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.80% (1.5841 => 1.6601, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (10.0443 => 10.4883, std.dev.: 0.0343) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.20% (5.8121 => 6.0561, std.dev.: 0.0419) MultiSource/Benchmarks/MallocBench/gs/gs: 4.10% (5.3600 => 5.5800, std.dev.: 0.0364) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0157) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 3.75% (21.9606 => 22.7848, std.dev.: 0.0402) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (6.5440 => 6.7800, std.dev.: 0.0437) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.45% (1.7400 => 1.8000, std.dev.: 0.0227) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.45% (50.0290 => 51.7530, std.dev.: 0.0725) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (1.6601 => 1.7161, std.dev.: 0.0094) MultiSource/Applications/lua/lua: 3.26% (4.7880 => 4.9440, std.dev.: 0.0233) MultiSource/Applications/treecc/treecc: 3.25% (2.5840 => 2.6680, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (2.3281 => 2.4002, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 2.92% (6.9844 => 7.1884, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (3.0282 => 3.1122, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 2.77% (38.4046 => 39.4686, std.dev.: 0.0478) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.52% (6.5080 => 6.6720, std.dev.: 0.0435) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.44% (1.3120 => 1.3440, std.dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 2.28% (18.4404 => 18.8605, std.dev.: 0.0625) MultiSource/Applications/ClamAV/clamscan: 2.16% (19.0444 => 19.4564, std.dev.: 0.0445) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.1843 => 4.2723, std.dev.: 0.0160) MultiSource/Applications/kimwitu++/kc: 1.97% (19.6891 => 20.0771, std.dev.: 0.0445) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (16.3483 => 16.6603, std.dev.: 0.0637) MultiSource/Applications/d/make_dparser: 1.71% (3.9681 => 4.0361, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (6.1044 => 6.1804, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.84% (2.1401 => 2.4362, std.dev.: 0.0493) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.09% (2.9442 => 0.7040, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.10% (1.5641 => 0.6240, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: -5.78% (1.8680 => 1.7600, std.dev.: 0.0233) SingleSource/UnitTests/Vector/constpool: -4.37% (10.6247 => 10.1606, std.dev.: 0.1467) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.13% (91.8497 => 49.4791, std.dev.: 10.3902) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.20% (26.0616 => 17.1491, std.dev.: 0.0855) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.19% (50.3031 => 33.1061, std.dev.: 0.1011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.18% (42.1466 => 28.5818, std.dev.: 0.5402) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.68% (3.1122 => 2.3441, std.dev.: 0.1116) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.42% (1.4041 => 1.3841, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -1.34% (4.7883 => 4.7243, std.dev.: 0.0126) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0262) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 21:39:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 23:39:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410043933.D19AB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24483?compare_to=24480&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24483, Order: 205938, Start Time: 2014-04-10 00:03:08, End Time: 2014-04-10 04:45:54 To: 24480, Order: 205937, Start Time: 2014-04-09 23:52:52, End Time: 2014-04-10 04:35:47 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (94 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (1002 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 15.79% (0.0760 => 0.0880, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (1.5480 => 1.6080, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.64% (0.9961 => 1.0921, std.dev.: 0.0333) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0083) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (10.6960 => 11.3360, std.dev.: 0.0797) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0376) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.7080 => 1.7840, std.dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0289) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.9200 => 0.9520, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/lists1: 3.41% (0.3520 => 0.3640, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0356) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0324) MultiSource/Applications/lua/lua: 2.83% (4.5200 => 4.6480, std.dev.: 0.0403) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 2.11% (17.6165 => 17.9885, std.dev.: 0.0686) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0375) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0208) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0407) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.76% (48.1088 => 48.9569, std.dev.: 0.0965) MultiSource/Benchmarks/Bullet/bullet: 1.74% (37.0925 => 37.7365, std.dev.: 0.0812) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 1.55% (18.8170 => 19.1090, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0116) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0563) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0364) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 1.00% (21.1533 => 21.3653, std.dev.: 0.0685) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/Regression/C++/EH/function_try_block: -50.00% (0.0320 => 0.0160, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -4.77% (10.8967 => 10.3766, std.dev.: 0.1038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 21:49:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 23:49:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140410044921.684382A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24484?compare_to=24474&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24484, Order: 205938, Start Time: 2014-04-10 00:04:55, End Time: 2014-04-10 04:55:48 To: 24474, Order: 205918, Start Time: 2014-04-09 19:09:06, End Time: 2014-04-10 00:00:21 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (127 on baseline) Performance Improvements: 2 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.81% (0.1080 => 0.1240, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.34% (0.1160 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 6.42% (0.4360 => 0.4640, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (1.1520 => 1.2120, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.19% (1.2520 => 1.2920, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.46% (3.4082 => 3.5602, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout/hash: 1.42% (4.2203 => 4.2803, std.dev.: 0.0185) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.72% (2.0961 => 2.0601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.41% (2.2681 => 2.2361, std.dev.: 0.0106) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0052) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/dt: 21.43% (0.0560 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.14% (1.6881 => 2.0281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.86% (1.6721 => 2.0041, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.81% (1.6961 => 2.0321, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.68% (1.7681 => 2.1161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.55% (1.8001 => 2.1521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.76% (1.7481 => 2.0761, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.62% (1.8041 => 2.1401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.60% (1.8281 => 2.1681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.7921 => 2.1241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.43% (1.8881 => 2.2361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.39% (1.7401 => 2.0601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 18.36% (1.8081 => 2.1401, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.30% (1.8361 => 2.1721, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.18% (1.8041 => 2.1321, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.61% (1.9761 => 2.3241, std.dev.: 0.0147) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.56% (1.9801 => 2.3081, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.50% (1.9641 => 2.2881, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.81% (0.1080 => 0.1240, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0073) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (3.5002 => 3.7562, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/moments: 6.42% (0.4360 => 0.4640, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.7880 => 12.5080, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.5000 => 0.5280, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.7280 => 1.8200, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.12% (6.7200 => 7.0640, std.dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0159) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.19% (1.2400 => 1.2920, std.dev.: 0.0155) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.05% (9.9842 => 10.3882, std.dev.: 0.0716) MultiSource/Applications/lua/lua: 4.01% (4.7920 => 4.9840, std.dev.: 0.0240) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (1.6481 => 1.7121, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.41% (1.5240 => 1.5760, std.dev.: 0.0166) MultiSource/Applications/d/make_dparser: 3.33% (3.9641 => 4.0961, std.dev.: 0.0315) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 3.18% (6.9124 => 7.1324, std.dev.: 0.0133) MultiSource/Applications/SPASS/SPASS: 2.73% (18.4924 => 18.9965, std.dev.: 0.0523) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (10.3203 => 10.5843, std.dev.: 0.0327) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (6.8321 => 7.0001, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.44% (0.4920 => 0.5040, std.dev.: 0.0040) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.29% (51.1089 => 52.2809, std.dev.: 0.0850) MultiSource/Applications/JM/lencod/lencod: 2.09% (22.6287 => 23.1007, std.dev.: 0.0883) MultiSource/Applications/kimwitu++/kc: 1.88% (19.7371 => 20.1091, std.dev.: 0.0532) MultiSource/Benchmarks/Bullet/bullet: 1.88% (38.9366 => 39.6686, std.dev.: 0.0992) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (3.0122 => 3.0682, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 1.86% (20.2445 => 20.6205, std.dev.: 0.0486) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2203 => 4.2883, std.dev.: 0.0101) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (16.5963 => 16.8483, std.dev.: 0.0615) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0244 => 6.1124, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 1.31% (2.7562 => 2.7922, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 1.11% (25.1895 => 25.4695, std.dev.: 0.0578) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0150) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (3.4402 => 3.5322, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9604 => 6.0684, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 1.64% (21.6534 => 22.0094, std.dev.: 0.0429) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.75% (1.5881 => 0.5440, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0084) SingleSource/Regression/C++/EH/ConditionalExpr: -42.86% (0.0280 => 0.0160, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: -32.78% (2.6481 => 1.7800, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.85% (7.4801 => 6.2200, std.dev.: 0.0375) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.53% (7.5041 => 6.2640, std.dev.: 0.0517) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0060) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -6.05% (10.9087 => 10.2486, std.dev.: 0.1413) MultiSource/Benchmarks/mafft/pairlocalalign: -3.73% (13.5243 => 13.0203, std.dev.: 0.0553) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (0.9281 => 0.8561, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0222) MultiSource/Benchmarks/sim/sim: -1.76% (4.9883 => 4.9003, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 21:54:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 23:54:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140410045434.B69D72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24485?compare_to=24475&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24485, Order: 205938, Start Time: 2014-04-10 00:08:54, End Time: 2014-04-10 05:00:57 To: 24475, Order: 205918, Start Time: 2014-04-09 19:11:50, End Time: 2014-04-10 00:04:18 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 7 (124 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (956 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/testtrace: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 18.18% (0.0880 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.90% (0.2320 => 0.2480, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.06% (2.2601 => 2.2841, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.30% (17.6723 => 19.4923, std.dev.: 0.0617) MultiSource/Applications/sqlite3/sqlite3: 1413.89% (1.7001 => 25.7376, std.dev.: 0.0332) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.30% (50.1010 => 51.7530, std.dev.: 0.0884) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.08% (11.3920 => 12.3120, std.dev.: 0.0484) SingleSource/Benchmarks/Misc/oourafft: 175.31% (11.3407 => 31.2220, std.dev.: 0.0981) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0643, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7164, std.dev.: 0.0115) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 322.25% (0.4320 => 1.8241, std.dev.: 0.0068) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0042) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/heapsort: 36.36% (0.0440 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 30.00% (0.0800 => 0.1040, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.85% (1.8201 => 2.0721, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.78% (1.9161 => 2.1801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.47% (1.9601 => 2.2241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.41% (2.0281 => 2.3001, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.15% (1.8561 => 2.1001, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.97% (1.9121 => 2.1601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.57% (2.1441 => 2.3921, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.13% (1.9761 => 2.1961, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.06% (1.7721 => 1.9681, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.8441 => 2.0401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.40% (1.8081 => 1.9961, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.11% (1.8201 => 2.0041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.8361 => 2.0161, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.68% (1.8601 => 2.0401, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0225) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.24% (0.3400 => 0.3680, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 7.14% (0.2800 => 0.3000, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0088) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.68% (6.4800 => 6.8480, std.dev.: 0.0298) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.08% (0.2360 => 0.2480, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 4.45% (1.5280 => 1.5960, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.04% (9.6042 => 9.9922, std.dev.: 0.0505) MultiSource/Applications/hbd/hbd: 3.94% (1.7280 => 1.7960, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (5.8281 => 6.0521, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0084) MultiSource/Applications/lua/lua: 3.51% (4.7920 => 4.9600, std.dev.: 0.0358) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (6.5320 => 6.7600, std.dev.: 0.0450) SingleSource/Benchmarks/Misc/flops: 3.39% (0.4720 => 0.4880, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (2.3401 => 2.4002, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 2.53% (18.5284 => 18.9964, std.dev.: 0.0322) MultiSource/Applications/JM/lencod/lencod: 2.45% (22.2206 => 22.7647, std.dev.: 0.0380) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (5.3960 => 5.5240, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (16.3003 => 16.6643, std.dev.: 0.0554) MultiSource/Applications/oggenc/oggenc: 2.21% (7.0524 => 7.2085, std.dev.: 0.0263) MultiSource/Benchmarks/Bullet/bullet: 1.84% (38.6366 => 39.3486, std.dev.: 0.1228) MultiSource/Applications/d/make_dparser: 1.81% (3.9761 => 4.0481, std.dev.: 0.0276) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (3.0562 => 3.1082, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2243 => 4.2883, std.dev.: 0.0113) MultiSource/Applications/kimwitu++/kc: 1.33% (19.8291 => 20.0931, std.dev.: 0.0414) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (10.2283 => 10.3603, std.dev.: 0.0338) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.40% (2.1201 => 2.4042, std.dev.: 0.0543) MultiSource/Benchmarks/llubenchmark/llu: 6.64% (5.0603 => 5.3963, std.dev.: 0.0926) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0383) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 2.30% (6.5964 => 6.7484, std.dev.: 0.0407) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.50% (4.0003 => 4.0603, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.3801 => 1.4001, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.28% (3.7442 => 3.7922, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.32% (2.9562 => 0.7000, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.24% (1.5881 => 0.5520, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: -5.54% (1.8760 => 1.7720, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.17% (94.8339 => 49.1551, std.dev.: 10.2886) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.71% (49.9431 => 33.1061, std.dev.: 0.1527) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.71% (25.7136 => 17.0451, std.dev.: 0.1050) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.82% (37.0863 => 28.6218, std.dev.: 0.3871) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.05% (1.2681 => 1.2041, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: -1.09% (4.7883 => 4.7363, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 21:57:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Apr 2014 23:57:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140410045723.E57B72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24486?compare_to=24476&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24486, Order: 205938, Start Time: 2014-04-10 00:11:15, End Time: 2014-04-10 05:03:44 To: 24476, Order: 205918, Start Time: 2014-04-09 19:14:48, End Time: 2014-04-10 00:06:34 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 7 (143 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Oscar: 33.33% (0.0600 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 11.54% (0.2080 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.2560 => 0.2720, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.17% (0.3240 => 0.3440, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.83% (1.5321 => 1.5601, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 1.31% (2.7562 => 2.7922, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.73% (0.2200 => 0.2480, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1987.50% (0.0320 => 0.6680, std.dev.: 0.0058) SingleSource/Benchmarks/Stanford/Puzzle: 1206.53% (0.1240 => 1.6201, std.dev.: 0.0051) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 395.28% (0.2520 => 1.2481, std.dev.: 0.0135) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 281.08% (0.2320 => 0.8841, std.dev.: 0.0080) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0082) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0018) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0036) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 65.00% (0.0800 => 0.1320, std.dev.: 0.0066) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0031) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.00% (0.7040 => 1.0560, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0084) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.67% (1.2321 => 1.5361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.43% (1.2481 => 1.5281, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: 20.40% (1.3920 => 1.6760, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.73% (1.1761 => 1.4081, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.77% (1.1721 => 1.3921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.77% (1.1721 => 1.3921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 18.37% (8.5802 => 10.1563, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.86% (1.2321 => 1.4521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.03% (1.3841 => 1.5921, std.dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 14.55% (19.5406 => 22.3847, std.dev.: 0.0546) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.02% (5.3360 => 6.0841, std.dev.: 0.0318) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0215) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 10.34% (0.2320 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 8.40% (6.2844 => 6.8124, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.02% (0.6480 => 0.7000, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 7.87% (11.3843 => 12.2803, std.dev.: 0.0601) SingleSource/Benchmarks/Shootout-C++/wc: 7.81% (0.2560 => 0.2760, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.20% (5.6680 => 6.0760, std.dev.: 0.0502) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.17% (11.4440 => 12.2640, std.dev.: 0.0695) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.06% (0.6800 => 0.7280, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.98% (5.7280 => 6.1280, std.dev.: 0.0581) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.26% (9.5802 => 10.1802, std.dev.: 0.0378) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.17% (0.3240 => 0.3440, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.31% (1.7320 => 1.8240, std.dev.: 0.0098) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists1: 4.40% (0.3640 => 0.3800, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0106) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.05% (6.8280 => 7.0360, std.dev.: 0.0386) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.88% (49.1529 => 50.5689, std.dev.: 0.0826) MultiSource/Applications/sqlite3/sqlite3: 2.29% (24.7575 => 25.3255, std.dev.: 0.0372) MultiSource/Applications/ClamAV/clamscan: 2.27% (19.2243 => 19.6604, std.dev.: 0.0534) MultiSource/Applications/kimwitu++/kc: 1.46% (19.7491 => 20.0371, std.dev.: 0.0412) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.7282 => 2.7642, std.dev.: 0.0117) MultiSource/Applications/siod/siod: 1.31% (2.7562 => 2.7922, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0124 => 6.0844, std.dev.: 0.0129) MultiSource/Benchmarks/Bullet/bullet: 1.05% (39.0726 => 39.4846, std.dev.: 0.0819) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0728) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0295) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -5.48% (11.0207 => 10.4167, std.dev.: 0.1352) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -8.29% (3.4722 => 3.1842, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.60% (5.2763 => 4.9283, std.dev.: 0.0863) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0203) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 22:24:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 00:24:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410052410.272142A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24487?compare_to=24483&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24487, Order: 205941, Start Time: 2014-04-10 00:43:12, End Time: 2014-04-10 05:30:31 To: 24483, Order: 205938, Start Time: 2014-04-10 00:03:08, End Time: 2014-04-10 04:45:54 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (101 on baseline) Performance Improvements: 1 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray-dbl: 200.00% (0.0080 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C++/EH/function_try_block: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 12.12% (0.1320 => 0.1480, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 9.09% (0.2200 => 0.2400, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.50% (1.3321 => 1.3521, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.80% (0.7360 => 0.7640, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (1.2441 => 1.2721, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -13.64% (0.0880 => 0.0760, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/pointer_member: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1480 => 0.1680, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0696) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 6.07% (0.9880 => 1.0480, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0446) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (8.1441 => 8.4761, std.dev.: 0.0394) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0302) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0351) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0430) MultiSource/Applications/lua/lua: 2.74% (4.5200 => 4.6440, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0124) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.00% (48.1088 => 49.0729, std.dev.: 0.0707) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0359) MultiSource/Benchmarks/Bullet/bullet: 1.73% (37.0925 => 37.7326, std.dev.: 0.0712) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.95% (0.7280 => 0.7640, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0543) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0221) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.21% (4.9443 => 5.0043, std.dev.: 0.0182) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0446) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -4.99% (10.8967 => 10.3526, std.dev.: 0.1113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 22:38:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 00:38:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410053802.7E3042A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24488?compare_to=24487&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24488, Order: 205942, Start Time: 2014-04-10 01:01:50, End Time: 2014-04-10 05:44:26 To: 24487, Order: 205941, Start Time: 2014-04-10 00:43:12, End Time: 2014-04-10 05:30:31 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (88 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 27.27% (0.0440 => 0.0560, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 26.67% (0.0600 => 0.0760, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.48% (0.4600 => 0.4760, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 2.33% (4.9680 => 5.0840, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.62% (1.2361 => 1.2561, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.49% (1.3441 => 1.3641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.20% (1.3361 => 1.3521, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.09% (1.4681 => 1.4841, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0620) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (6.0160 => 6.3680, std.dev.: 0.0245) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0279) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0328) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0483) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0408) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0243) MultiSource/Benchmarks/mafft/pairlocalalign: 2.73% (10.4082 => 10.6922, std.dev.: 0.0456) MultiSource/Applications/JM/lencod/lencod: 2.50% (17.6165 => 18.0565, std.dev.: 0.0649) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0433) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.80% (48.1088 => 48.9768, std.dev.: 0.0877) MultiSource/Benchmarks/Bullet/bullet: 1.66% (37.0925 => 37.7085, std.dev.: 0.0752) MultiSource/Applications/sqlite3/sqlite3: 1.33% (23.7574 => 24.0735, std.dev.: 0.0709) MultiSource/Applications/JM/ldecod/ldecod: 1.32% (7.8562 => 7.9602, std.dev.: 0.0337) MultiSource/Applications/kimwitu++/kc: 1.11% (18.8170 => 19.0250, std.dev.: 0.0598) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 1.09% (2.5721 => 2.6001, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.11% (0.1800 => 0.2000, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0035) MultiSource/Applications/obsequi/Obsequi: 3.29% (2.0681 => 2.1361, std.dev.: 0.0177) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: -11.36% (0.1760 => 0.1560, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -4.59% (10.8967 => 10.3966, std.dev.: 0.1029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.89% (1.2601 => 1.1481, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0096) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 9 23:01:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 01:01:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410060124.7DDB82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24489?compare_to=24488&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24489, Order: 205945, Start Time: 2014-04-10 01:23:05, End Time: 2014-04-10 06:07:48 To: 24488, Order: 205942, Start Time: 2014-04-10 01:01:50, End Time: 2014-04-10 05:44:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (114 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 166.67% (0.0120 => 0.0320, std.dev.: 0.0033) SingleSource/Regression/C/badidx: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: 21.43% (0.0560 => 0.0680, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.18% (0.0880 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/rem: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 6.58% (0.3040 => 0.3240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.2880 => 0.3040, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (1.5320 => 1.5840, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.83% (1.7520 => 1.7840, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 58.33% (0.0480 => 0.0760, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.01% (0.7320 => 0.7760, std.dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0647) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.23% (1.2721 => 1.3641, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.39% (1.2521 => 1.3321, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0215) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0427) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0413) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.7080 => 1.7840, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.68% (0.5440 => 0.5640, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0302) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0348) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (5.8000 => 5.9400, std.dev.: 0.0543) MultiSource/Applications/JM/lencod/lencod: 2.16% (17.6165 => 17.9965, std.dev.: 0.0711) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.08% (48.1088 => 49.1089, std.dev.: 0.0937) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0425) MultiSource/Benchmarks/Bullet/bullet: 1.97% (37.0925 => 37.8246, std.dev.: 0.0689) MultiSource/Applications/sqlite3/sqlite3: 1.75% (23.7574 => 24.1735, std.dev.: 0.0299) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.13% (2.8322 => 2.8642, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.59% (0.7280 => 0.7760, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0394) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.07% (4.5603 => 4.7003, std.dev.: 0.0042) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 1.10% (21.1533 => 21.3853, std.dev.: 0.0782) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0464) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: -71.43% (0.0280 => 0.0080, std.dev.: 0.0074) SingleSource/UnitTests/Vector/constpool: -3.93% (10.8967 => 10.4687, std.dev.: 0.0832) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: -1.71% (2.3361 => 2.2961, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.08% (1.4881 => 1.4721, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2403 => 4.1963, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 02:21:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 04:21:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410092101.808892A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24490?compare_to=24489&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24490, Order: 205950, Start Time: 2014-04-10 04:44:59, End Time: 2014-04-10 09:27:16 To: 24489, Order: 205945, Start Time: 2014-04-10 01:23:05, End Time: 2014-04-10 06:07:48 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (91 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 133.33% (0.0120 => 0.0280, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.95% (0.1720 => 0.1960, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.2120 => 1.2600, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.00% (0.4000 => 0.4120, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.05% (1.3641 => 1.3921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.80% (1.3321 => 1.3561, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.23% (1.3041 => 1.3201, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 8.11% (0.1480 => 0.1600, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.65% (0.6040 => 0.6200, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/five11/five11: 1.22% (2.2961 => 2.3241, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: -7.94% (0.2520 => 0.2320, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -5.67% (0.7760 => 0.7320, std.dev.: 0.0170) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0654) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0388) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0124) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0267) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0324) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0309) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0408) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0276) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0380) MultiSource/Benchmarks/MallocBench/gs/gs: 2.20% (4.9200 => 5.0280, std.dev.: 0.0358) MultiSource/Applications/sqlite3/sqlite3: 2.16% (23.7574 => 24.2695, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 1.62% (37.0925 => 37.6926, std.dev.: 0.0807) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.55% (48.1088 => 48.8529, std.dev.: 0.1477) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 1.08% (18.8170 => 19.0210, std.dev.: 0.0510) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0235) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 4.63% (6.6564 => 6.9644, std.dev.: 0.0453) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.04% (4.5203 => 4.6123, std.dev.: 0.0328) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -3.96% (10.8967 => 10.4647, std.dev.: 0.0789) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 02:34:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 04:34:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140410093420.96F9A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24491?compare_to=24481&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24491, Order: 205950, Start Time: 2014-04-10 04:52:08, End Time: 2014-04-10 09:40:42 To: 24481, Order: 205937, Start Time: 2014-04-09 23:54:46, End Time: 2014-04-10 04:43:05 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 30.77% (0.0520 => 0.0680, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 2.49% (1.1240 => 1.1520, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.12% (1.7001 => 1.7361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.72% (1.8561 => 1.8881, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.56% (1.8001 => 1.8281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.51% (1.8521 => 1.8801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.37% (1.7521 => 1.7761, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7802 => 2.8162, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 23.81% (0.0840 => 0.1040, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.82% (0.9921 => 1.0201, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.55% (1.7241 => 1.6801, std.dev.: 0.0164) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 02:36:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 04:36:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140410093634.55D742A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24492?compare_to=24482&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24492, Order: 205950, Start Time: 2014-04-10 04:53:52, End Time: 2014-04-10 09:42:59 To: 24482, Order: 205937, Start Time: 2014-04-09 23:55:45, End Time: 2014-04-10 04:44:45 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 19 (127 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (961 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.95% (0.1640 => 0.2000, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0074) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 4.20% (1.0480 => 1.0920, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.17% (0.4800 => 0.5000, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: 2.91% (10.1606 => 10.4567, std.dev.: 0.0798) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.34% (1.7081 => 1.7481, std.dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: 2.22% (1.8001 => 1.8401, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/football/football: 2.16% (1.1120 => 1.1360, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.72% (1.6281 => 1.6561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.45% (1.6601 => 1.6841, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.11% (6.8400 => 6.9160, std.dev.: 0.0210) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 18.18% (0.0880 => 0.1040, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/strcat: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.30% (1.2121 => 1.2521, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/hash: 1.33% (4.2163 => 4.2723, std.dev.: 0.0154) MultiSource/Benchmarks/BitBench/five11/five11: 1.04% (2.3121 => 2.3361, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -12.50% (0.1280 => 0.1120, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -1.10% (7.6605 => 7.5765, std.dev.: 0.0258) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 173.36% (11.3687 => 31.0779, std.dev.: 0.1326) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0097) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0080) SingleSource/UnitTests/ms_struct-bitfield-init: 200.00% (0.0080 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 16.67% (0.0960 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.19% (0.3640 => 0.4120, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.20% (1.6521 => 1.8041, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.17% (1.4401 => 1.5721, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0087) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.53% (1.5481 => 1.6801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.40% (1.5241 => 1.6521, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0125) MultiSource/Applications/spiff/spiff: 8.33% (1.0080 => 1.0920, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.29% (1.4961 => 1.6201, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.22% (1.4601 => 1.5801, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.88% (1.7761 => 1.9161, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.7361 => 1.8681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (6.4680 => 6.9160, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.20% (1.4841 => 1.5761, std.dev.: 0.0152) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.95% (1.4801 => 1.5681, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.93% (0.4720 => 0.5000, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.85% (1.4361 => 1.5201, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (11.6440 => 12.3200, std.dev.: 0.0816) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.52% (1.4481 => 1.5281, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (1.7401 => 1.8361, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 5.34% (10.0443 => 10.5803, std.dev.: 0.0229) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.10% (9.4842 => 9.9682, std.dev.: 0.0601) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (5.8121 => 6.1041, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.46% (6.5440 => 6.8360, std.dev.: 0.0505) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.4640 => 1.5280, std.dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: 4.30% (21.9606 => 22.9048, std.dev.: 0.0470) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (6.5080 => 6.7800, std.dev.: 0.0540) MultiSource/Benchmarks/MallocBench/gs/gs: 4.18% (5.3600 => 5.5840, std.dev.: 0.0427) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0258) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0154) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.68% (50.0290 => 51.8690, std.dev.: 0.1000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 3.25% (2.5840 => 2.6680, std.dev.: 0.0291) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 3.04% (18.4404 => 19.0005, std.dev.: 0.0454) MultiSource/Benchmarks/Bullet/bullet: 3.01% (38.4046 => 39.5606, std.dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (3.0282 => 3.1122, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 2.67% (4.7880 => 4.9160, std.dev.: 0.0424) MultiSource/Applications/oggenc/oggenc: 2.63% (6.9844 => 7.1684, std.dev.: 0.0337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (16.3483 => 16.7763, std.dev.: 0.0582) MultiSource/Applications/ClamAV/clamscan: 2.60% (19.0444 => 19.5404, std.dev.: 0.0417) MultiSource/Applications/d/make_dparser: 2.52% (3.9681 => 4.0681, std.dev.: 0.0240) MultiSource/Applications/siod/siod: 2.50% (2.7162 => 2.7842, std.dev.: 0.0169) MultiSource/Applications/kimwitu++/kc: 2.01% (19.6891 => 20.0851, std.dev.: 0.0783) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.84% (2.1401 => 2.4362, std.dev.: 0.0424) MultiSource/Applications/siod/siod: 5.59% (2.8602 => 3.0202, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4205 => 7.5765, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.22% (2.9442 => 0.7000, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.34% (1.5641 => 0.6360, std.dev.: 0.0058) MultiSource/Applications/obsequi/Obsequi: -4.93% (1.8680 => 1.7760, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.11% (91.8497 => 49.4951, std.dev.: 10.3216) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.49% (26.0616 => 17.0731, std.dev.: 0.1260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.15% (50.3031 => 33.1221, std.dev.: 0.1312) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.59% (42.1466 => 28.8338, std.dev.: 0.4080) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1069) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0115) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 02:49:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 04:49:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140410094916.253932A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24493?compare_to=24484&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24493, Order: 205950, Start Time: 2014-04-10 05:04:36, End Time: 2014-04-10 09:55:41 To: 24484, Order: 205938, Start Time: 2014-04-10 00:04:55, End Time: 2014-04-10 04:55:48 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (134 on baseline) Performance Improvements: 2 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 33.33% (0.0480 => 0.0640, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.33% (0.2400 => 0.2600, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.94% (0.2520 => 0.2720, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -9.09% (0.3520 => 0.3200, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/random: -7.94% (0.2520 => 0.2320, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0094) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 60.00% (0.0400 => 0.0640, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.28% (1.6961 => 2.0401, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.81% (1.6761 => 2.0081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.72% (1.7241 => 2.0641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.55% (1.8001 => 2.1521, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.52% (1.6801 => 2.0081, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.49% (1.7441 => 2.0841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.38% (1.6721 => 1.9961, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.20% (1.7921 => 2.1361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.07% (1.8041 => 2.1481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.84% (1.7201 => 2.0441, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.76% (1.7481 => 2.0761, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.8281 => 2.1641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.30% (1.8361 => 2.1721, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 17.80% (1.8881 => 2.2241, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.61% (1.9081 => 2.2441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.94% (1.9601 => 2.2921, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.56% (1.9801 => 2.3081, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.87% (0.1840 => 0.2040, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.80% (0.6120 => 0.6720, std.dev.: 0.0208) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.33% (0.2400 => 0.2600, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.66% (3.5002 => 3.7682, std.dev.: 0.0120) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.19% (6.7200 => 7.1360, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.7800 => 0.8280, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.01% (11.7880 => 12.4960, std.dev.: 0.0700) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0277) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (9.9842 => 10.4562, std.dev.: 0.0434) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (1.0001 => 1.0441, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.1440 => 1.1920, std.dev.: 0.0159) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.88% (1.6481 => 1.7121, std.dev.: 0.0102) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.86% (1.3480 => 1.4000, std.dev.: 0.0125) MultiSource/Applications/Burg/burg: 3.85% (1.5600 => 1.6200, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (6.8321 => 7.0681, std.dev.: 0.0350) MultiSource/Applications/SPASS/SPASS: 3.35% (18.4924 => 19.1125, std.dev.: 0.0262) MultiSource/Applications/d/make_dparser: 3.23% (3.9641 => 4.0921, std.dev.: 0.0256) MultiSource/Applications/oggenc/oggenc: 3.18% (6.9124 => 7.1324, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 2.93% (22.6287 => 23.2927, std.dev.: 0.0517) MultiSource/Applications/treecc/treecc: 2.75% (2.6200 => 2.6920, std.dev.: 0.0279) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (10.3203 => 10.6003, std.dev.: 0.0438) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.52% (51.1089 => 52.3969, std.dev.: 0.1049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (16.5963 => 16.9443, std.dev.: 0.0570) MultiSource/Benchmarks/Bullet/bullet: 2.09% (38.9366 => 39.7486, std.dev.: 0.0726) MultiSource/Applications/ClamAV/clamscan: 1.98% (20.2445 => 20.6445, std.dev.: 0.0570) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 1.66% (19.7371 => 20.0651, std.dev.: 0.0632) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (3.0122 => 3.0562, std.dev.: 0.0128) MultiSource/Applications/sqlite3/sqlite3: 1.40% (25.1895 => 25.5415, std.dev.: 0.0464) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (6.0244 => 6.1084, std.dev.: 0.0225) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (29.4578 => 29.7539, std.dev.: 0.0554) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.86% (0.9281 => 1.1681, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0681) SingleSource/Benchmarks/Misc-C++/bigfib: 13.85% (0.2600 => 0.2960, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 2.76% (6.8204 => 7.0084, std.dev.: 0.0518) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (3.4402 => 3.5322, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.20% (5.0963 => 5.2083, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 1.64% (21.6534 => 22.0094, std.dev.: 0.0787) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (4.7563 => 4.8283, std.dev.: 0.0219) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.47% (1.0881 => 1.1041, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.56% (6.2884 => 1.3481, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.24% (1.5881 => 0.5520, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.58% (3.1762 => 1.2521, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: -32.48% (2.6481 => 1.7880, std.dev.: 0.0203) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.27% (7.4801 => 6.1880, std.dev.: 0.0636) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.62% (7.5041 => 6.3320, std.dev.: 0.0477) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -4.36% (10.9087 => 10.4327, std.dev.: 0.1508) MultiSource/Benchmarks/mafft/pairlocalalign: -3.25% (13.5243 => 13.0843, std.dev.: 0.0420) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (5.1603 => 5.0403, std.dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: -1.68% (4.9883 => 4.9043, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 02:55:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 04:55:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140410095549.C42222A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24494?compare_to=24485&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24494, Order: 205950, Start Time: 2014-04-10 05:09:46, End Time: 2014-04-10 10:02:13 To: 24485, Order: 205938, Start Time: 2014-04-10 00:08:54, End Time: 2014-04-10 05:00:57 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (127 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (953 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-LocalTypeTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 12.20% (0.1640 => 0.1840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 11.76% (0.1360 => 0.1520, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 11.43% (0.1400 => 0.1560, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 6.21% (0.7080 => 0.7520, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/09-vor/vor: 4.95% (0.4040 => 0.4240, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.90% (0.5520 => 0.5680, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 2.50% (0.6400 => 0.6560, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 1.53% (1.8281 => 1.8561, std.dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.80% (17.6723 => 19.5804, std.dev.: 0.0559) MultiSource/Applications/sqlite3/sqlite3: 1417.42% (1.7001 => 25.7976, std.dev.: 0.0468) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.28% (50.1010 => 51.7450, std.dev.: 0.0947) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.60% (11.3920 => 12.3720, std.dev.: 0.0564) SingleSource/Benchmarks/Misc/oourafft: 175.13% (11.3407 => 31.2020, std.dev.: 0.0578) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0363, std.dev.: 0.0248) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0174) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0117) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-23-TransparentUnion: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/sumarray2d: 100.00% (0.0200 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/ary3: 31.25% (0.0640 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.93% (0.1720 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0066) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 17.14% (0.1400 => 0.1640, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.38% (1.8081 => 2.0681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.16% (1.8361 => 2.0961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.01% (1.8561 => 2.1161, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.85% (1.8201 => 2.0721, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.74% (1.8921 => 2.1521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.72% (1.9241 => 2.1881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.67% (1.9601 => 2.2281, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.39% (1.9721 => 2.2361, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/09-vor/vor: 12.77% (0.3760 => 0.4240, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.93% (2.1121 => 2.3641, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.38% (2.1441 => 2.3881, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0171) MultiSource/Benchmarks/McCat/05-eks/eks: 10.59% (0.6800 => 0.7520, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.33% (1.8201 => 2.0081, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.8361 => 2.0241, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.19% (1.8441 => 2.0321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.06% (2.0681 => 2.2761, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.89% (1.9001 => 2.0881, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary2: 9.72% (0.2880 => 0.3160, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.68% (0.3720 => 0.4080, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.36% (2.0521 => 2.2441, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.35% (1.7961 => 1.9641, std.dev.: 0.0146) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0162) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.65% (0.7080 => 0.7480, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.56% (6.4800 => 6.8400, std.dev.: 0.0399) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.55% (0.7040 => 0.7360, std.dev.: 0.0105) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (9.6042 => 10.0282, std.dev.: 0.0474) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (6.5320 => 6.7840, std.dev.: 0.0407) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.58% (1.5640 => 1.6200, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (2.1240 => 2.2000, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/flops: 3.39% (0.4720 => 0.4880, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3960 => 5.5760, std.dev.: 0.0312) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.30% (6.5360 => 6.7520, std.dev.: 0.0571) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (16.3003 => 16.8003, std.dev.: 0.0451) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (5.8281 => 6.0041, std.dev.: 0.0536) MultiSource/Applications/lua/lua: 3.01% (4.7920 => 4.9360, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 2.90% (22.2206 => 22.8647, std.dev.: 0.0573) MultiSource/Applications/treecc/treecc: 2.78% (2.5880 => 2.6600, std.dev.: 0.0202) MultiSource/Applications/SPASS/SPASS: 2.61% (18.5284 => 19.0125, std.dev.: 0.0527) MultiSource/Applications/oggenc/oggenc: 2.61% (7.0524 => 7.2365, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 2.31% (38.6366 => 39.5286, std.dev.: 0.0437) MultiSource/Applications/d/make_dparser: 2.11% (3.9761 => 4.0601, std.dev.: 0.0175) MultiSource/Applications/JM/ldecod/ldecod: 2.07% (10.2283 => 10.4403, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0140) MultiSource/Applications/kimwitu++/kc: 1.45% (19.8291 => 20.1171, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (3.0562 => 3.1002, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.10% (2.1201 => 2.4402, std.dev.: 0.0312) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0297) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 2.79% (1.2881 => 1.3241, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (4.0003 => 4.0723, std.dev.: 0.0201) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (3.9442 => 4.0042, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.19% (2.9562 => 0.7040, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.23% (1.5881 => 0.5680, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0073) MultiSource/Applications/obsequi/Obsequi: -4.05% (1.8760 => 1.8000, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.05% (94.8339 => 49.2631, std.dev.: 10.3556) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.78% (49.9431 => 33.0741, std.dev.: 0.1763) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.35% (25.7136 => 17.1371, std.dev.: 0.0950) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.96% (37.0863 => 28.5698, std.dev.: 0.4156) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.33% (4.8043 => 4.6923, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -1.09% (4.7883 => 4.7363, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 02:58:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 04:58:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140410095813.0F23E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24495?compare_to=24486&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24495, Order: 205950, Start Time: 2014-04-10 05:12:39, End Time: 2014-04-10 10:04:36 To: 24486, Order: 205938, Start Time: 2014-04-10 00:11:15, End Time: 2014-04-10 05:03:44 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (145 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 200.00% (0.0080 => 0.0240, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 33.33% (0.0480 => 0.0640, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.77% (0.0520 => 0.0680, std.dev.: 0.0060) SingleSource/Benchmarks/Stanford/Queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.39% (0.0920 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.36% (0.1760 => 0.1960, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.23% (0.2600 => 0.2840, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 8.14% (0.3440 => 0.3720, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.7520 => 1.8040, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.92% (1.0441 => 1.0641, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.72% (1.3921 => 1.4161, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (12.2803 => 12.4043, std.dev.: 0.0410) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 18.75% (0.0640 => 0.0760, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.64% (0.9881 => 1.0241, std.dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0088) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0112) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0094) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0057) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 387.34% (0.2520 => 1.2281, std.dev.: 0.0157) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 277.63% (0.2320 => 0.8761, std.dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0068) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0052) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0077) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0049) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0062) SingleSource/Regression/C++/pointer_method2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0139) SingleSource/Benchmarks/Stanford/Queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0111) MultiSource/Applications/obsequi/Obsequi: 21.55% (1.3920 => 1.6920, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.81% (1.2521 => 1.5001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 19.16% (8.5802 => 10.2243, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 17.93% (1.1601 => 1.3681, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.90% (1.1841 => 1.3961, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.84% (1.1881 => 1.4001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 16.88% (1.2321 => 1.4401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.15% (1.2881 => 1.4961, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 15.37% (19.5406 => 22.5447, std.dev.: 0.0531) MultiSource/Benchmarks/Olden/bh/bh: 14.89% (0.3760 => 0.4320, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.62% (5.3360 => 6.1161, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0143) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0219) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (11.3843 => 12.4043, std.dev.: 0.0410) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.82% (0.1360 => 0.1480, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 8.47% (6.2844 => 6.8164, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.90% (5.6680 => 6.1160, std.dev.: 0.0545) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (11.4440 => 12.3440, std.dev.: 0.0593) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.82% (5.7280 => 6.1760, std.dev.: 0.0570) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (9.5802 => 10.2122, std.dev.: 0.0264) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.7360 => 0.7760, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 4.44% (4.7720 => 4.9840, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (6.8280 => 7.0800, std.dev.: 0.0422) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.63% (1.3240 => 1.3720, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.45% (0.5800 => 0.6000, std.dev.: 0.0051) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.12% (49.1529 => 50.6889, std.dev.: 0.1064) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (5.3840 => 5.5400, std.dev.: 0.0495) MultiSource/Applications/ClamAV/clamscan: 2.71% (19.2243 => 19.7444, std.dev.: 0.0529) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 2.63% (24.7575 => 25.4095, std.dev.: 0.0262) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0117) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 1.64% (19.7491 => 20.0731, std.dev.: 0.0405) MultiSource/Benchmarks/Bullet/bullet: 1.48% (39.0726 => 39.6526, std.dev.: 0.0543) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0124 => 6.0924, std.dev.: 0.0255) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.08% (29.3298 => 29.6459, std.dev.: 0.0854) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (16.7083 => 16.8843, std.dev.: 0.0320) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (3.9842 => 4.2923, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.64% (0.9881 => 1.0241, std.dev.: 0.0117) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.84% (3.2362 => 3.3282) MultiSource/Applications/minisat/minisat: 2.82% (6.8204 => 7.0124, std.dev.: 0.0355) MultiSource/Applications/sqlite3/sqlite3: 2.56% (4.0563 => 4.1603, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -4.83% (11.0207 => 10.4887, std.dev.: 0.0927) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -13.91% (0.6040 => 0.5200, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0879) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.84% (4.1243 => 4.0483, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.02% (5.0963 => 5.0443, std.dev.: 0.0135) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 03:17:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 05:17:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410101758.F33992A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24496?compare_to=24490&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24496, Order: 205952, Start Time: 2014-04-10 05:42:04, End Time: 2014-04-10 10:24:22 To: 24490, Order: 205950, Start Time: 2014-04-10 04:44:59, End Time: 2014-04-10 09:27:16 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (95 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (1001 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-26-Shorts: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C/matrixTranspose: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.00% (0.0800 => 0.1000, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/methcall: 8.62% (0.2320 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.33% (0.2880 => 0.3120, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.11% (0.1480 => 0.1600, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: 4.94% (0.3240 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.48% (0.4600 => 0.4760, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.7520 => 1.8040, std.dev.: 0.0116) MultiSource/Applications/siod/siod: 1.24% (2.5801 => 2.6121, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.23% (0.2600 => 0.2840, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: -15.63% (0.1280 => 0.1080, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0090) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/methcall: 8.62% (0.2320 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0510) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0298) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.6840 => 0.7200, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (8.1441 => 8.4481, std.dev.: 0.0548) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0240) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0429) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0188) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0361) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0048) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.76% (48.1088 => 48.9570, std.dev.: 0.1022) MultiSource/Applications/sqlite3/sqlite3: 1.68% (23.7574 => 24.1575, std.dev.: 0.0565) MultiSource/Benchmarks/Bullet/bullet: 1.61% (37.0925 => 37.6886, std.dev.: 0.0904) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0197) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0392) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.28% (4.0643 => 4.1163, std.dev.: 0.0140) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0210) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0561) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -5.03% (10.8967 => 10.3486, std.dev.: 0.1485) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 04:03:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 06:03:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410110315.77FD62A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24497?compare_to=24496&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24497, Order: 205953, Start Time: 2014-04-10 06:22:14, End Time: 2014-04-10 11:09:38 To: 24496, Order: 205952, Start Time: 2014-04-10 05:42:04, End Time: 2014-04-10 10:24:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (93 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.81% (0.1080 => 0.1240, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.2880 => 0.3040, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 4.13% (0.4840 => 0.5040, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.97% (0.5040 => 0.5240, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.74% (0.7480 => 0.7760, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.49% (0.3440 => 0.3560, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.86% (1.6801 => 1.7281, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.08% (1.1521 => 1.1761, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0035) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/UnitTests/2007-04-10-BitfieldTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0187) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.61% (1.1241 => 1.2321, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.50% (0.1600 => 0.1720, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.39% (1.1361 => 1.2201, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 6.73% (1.1881 => 1.2681, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0624) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.29% (1.1441 => 1.2161, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0391) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0382) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0280) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0488) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0504) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0403) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0510) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 2.44% (0.4920 => 0.5040, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0378) MultiSource/Benchmarks/Bullet/bullet: 1.75% (37.0925 => 37.7405, std.dev.: 0.0512) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 1.60% (23.7574 => 24.1375, std.dev.: 0.0451) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.59% (48.1088 => 48.8729, std.dev.: 0.1484) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 1.02% (18.8170 => 19.0090, std.dev.: 0.0344) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 4.57% (6.6564 => 6.9604, std.dev.: 0.0424) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0116) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0187) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0316) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -33.33% (0.0360 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -5.14% (10.8967 => 10.3366, std.dev.: 0.1015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.89% (7.7485 => 6.6724, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.5522 => 3.5042, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 05:19:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 07:19:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410121903.31F622A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24498?compare_to=24497&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24498, Order: 205954, Start Time: 2014-04-10 07:43:32, End Time: 2014-04-10 12:25:26 To: 24497, Order: 205953, Start Time: 2014-04-10 06:22:14, End Time: 2014-04-10 11:09:38 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (98 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Perm: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2840 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 6.90% (0.2320 => 0.2480, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.75% (1.1440 => 1.1640, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (1.4841 => 1.4641, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2007-04-10-BitfieldTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0675) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0130) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0195) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0483) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0190) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0422) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (2.1201 => 2.1641, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0257) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.91% (48.1088 => 49.0289, std.dev.: 0.0610) MultiSource/Applications/sqlite3/sqlite3: 1.75% (23.7574 => 24.1735, std.dev.: 0.0367) MultiSource/Benchmarks/Bullet/bullet: 1.43% (37.0925 => 37.6245, std.dev.: 0.0718) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.8322 => 2.8682, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.37% (1.6601 => 1.7161, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: 3.29% (2.0681 => 2.1361, std.dev.: 0.0156) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: -14.29% (0.0840 => 0.0720, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -4.18% (10.8967 => 10.4407, std.dev.: 0.1011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4881 => 1.4641, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 05:31:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 07:31:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410123115.4CDDF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24499?compare_to=24498&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24499, Order: 205955, Start Time: 2014-04-10 07:53:06, End Time: 2014-04-10 12:37:38 To: 24498, Order: 205954, Start Time: 2014-04-10 07:43:32, End Time: 2014-04-10 12:25:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (99 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C/PR640: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.19% (1.2761 => 1.3041, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.26% (1.2721 => 1.2881, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 1.43% (5.0403 => 5.1123, std.dev.: 0.0267) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4641 => 1.4801, std.dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0048) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 10.20% (0.1960 => 0.2160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0882) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.85% (1.3681 => 1.4481, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0088) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0360) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0177) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0193) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0445) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0372) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0302) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0095) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.93% (48.1088 => 49.0369, std.dev.: 0.0533) MultiSource/Applications/sqlite3/sqlite3: 1.77% (23.7574 => 24.1775, std.dev.: 0.0469) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (7.8562 => 7.9762, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 1.36% (37.0925 => 37.5965, std.dev.: 0.0966) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.37% (1.6601 => 1.7161, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0092) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.10% (21.1533 => 21.3853, std.dev.: 0.0729) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -4.77% (10.8967 => 10.3766, std.dev.: 0.1292) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 07:08:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 09:08:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410140817.9F1812A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24500?compare_to=24499&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24500, Order: 205958, Start Time: 2014-04-10 09:31:50, End Time: 2014-04-10 14:14:41 To: 24499, Order: 205955, Start Time: 2014-04-10 07:53:06, End Time: 2014-04-10 12:37:38 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (95 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (1001 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 400.00% (0.0040 => 0.0200, std.dev.: 0.0048) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.74% (0.0920 => 0.1120, std.dev.: 0.0063) MultiSource/Benchmarks/BitBench/five11/five11: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/matrix: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.62% (0.2320 => 0.2520, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.22% (0.2920 => 0.3160, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.7240 => 0.7400, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.40% (1.1440 => 1.1600, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.96% (4.4923 => 4.5803, std.dev.: 0.0307) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.53% (0.2280 => 0.2520, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.57% (1.2161 => 1.3081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0557) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.64% (1.1441 => 1.2201, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0428) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0417) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0328) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0328) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0311) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0364) MultiSource/Benchmarks/mafft/pairlocalalign: 2.54% (10.4082 => 10.6722, std.dev.: 0.0462) MultiSource/Applications/JM/lencod/lencod: 2.47% (17.6165 => 18.0525, std.dev.: 0.0565) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0087) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.01% (48.1088 => 49.0770, std.dev.: 0.0704) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0326) MultiSource/Benchmarks/Bullet/bullet: 1.69% (37.0925 => 37.7205, std.dev.: 0.0650) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0199) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 4.39% (6.6564 => 6.9484, std.dev.: 0.0397) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout/lists: 2.68% (5.8164 => 5.9724, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (5.0123 => 5.1243, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -4.44% (10.8967 => 10.4126, std.dev.: 0.0870) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 07:27:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 09:27:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140410142713.D1FEA2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24501?compare_to=24491&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24501, Order: 205958, Start Time: 2014-04-10 09:45:07, End Time: 2014-04-10 14:33:34 To: 24491, Order: 205950, Start Time: 2014-04-10 04:52:08, End Time: 2014-04-10 09:40:42 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1098 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_shift: 62.50% (0.0320 => 0.0520, std.dev.: 0.0032) SingleSource/Regression/C/test_indvars: 12.00% (0.1000 => 0.1120, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.11% (0.1480 => 0.1600, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.82% (0.3320 => 0.3480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 4.00% (0.3000 => 0.3120, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.19% (2.0121 => 2.0561, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/nestedloop: 1.43% (1.1201 => 1.1361, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.18% (1.7001 => 1.7201, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 44.44% (0.0360 => 0.0520, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.1600 => 0.2000, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.62% (1.6801 => 1.7241, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.3081 => 1.3321, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0147) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 07:30:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 09:30:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140410143001.882EE2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24502?compare_to=24492&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24502, Order: 205958, Start Time: 2014-04-10 09:47:17, End Time: 2014-04-10 14:36:27 To: 24492, Order: 205950, Start Time: 2014-04-10 04:53:52, End Time: 2014-04-10 09:42:59 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (139 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2005-05-12-Int64ToFP: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 17.86% (0.1120 => 0.1320, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.77% (0.4560 => 0.4960, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.53% (1.5681 => 1.5921, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.79% (0.3080 => 0.3320, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.14% (1.3081 => 1.3361, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: 1.06% (7.5765 => 7.6565, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.32% (10.5803 => 10.4403, std.dev.: 0.0361) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.00% (11.3687 => 31.1499, std.dev.: 0.1576) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0072) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0243) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0025) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C/PR640: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0116) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.07% (0.1640 => 0.1920, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/05-eks/eks: 9.09% (0.6600 => 0.7200, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.04% (1.4601 => 1.5921, std.dev.: 0.0099) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.89% (0.1800 => 0.1960, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.89% (1.4401 => 1.5681, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.66% (1.5241 => 1.6561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.56% (0.7480 => 0.8120, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.52% (1.4561 => 1.5801, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.59% (1.5281 => 1.6441, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (1.1640 => 1.2520, std.dev.: 0.0299) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.13% (1.4361 => 1.5241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.97% (1.5401 => 1.6321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.91% (1.6921 => 1.7921, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (11.6440 => 12.3280, std.dev.: 0.0767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.44% (6.4680 => 6.8200, std.dev.: 0.0445) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.15% (9.4842 => 9.9722, std.dev.: 0.0395) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (5.8121 => 6.1041, std.dev.: 0.0278) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0214) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.5480 => 1.6160, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 4.03% (21.9606 => 22.8448, std.dev.: 0.0680) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 3.94% (10.0443 => 10.4403, std.dev.: 0.0361) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0211) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (6.5440 => 6.7960, std.dev.: 0.0507) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0118) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.81% (50.0290 => 51.9330, std.dev.: 0.0841) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.0440 => 2.1160, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (6.5080 => 6.7360, std.dev.: 0.0462) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 3.09% (6.9844 => 7.2005, std.dev.: 0.0183) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0105) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0253) MultiSource/Benchmarks/Bullet/bullet: 2.87% (38.4046 => 39.5086, std.dev.: 0.0786) MultiSource/Benchmarks/MallocBench/gs/gs: 2.84% (5.3600 => 5.5120, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 2.62% (18.4404 => 18.9244, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.58% (2.3281 => 2.3881, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (16.3483 => 16.7203, std.dev.: 0.0357) MultiSource/Applications/ClamAV/clamscan: 1.91% (19.0444 => 19.4084, std.dev.: 0.0756) MultiSource/Applications/kimwitu++/kc: 1.73% (19.6891 => 20.0291, std.dev.: 0.0407) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0247) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.46% (2.1401 => 2.4282, std.dev.: 0.0582) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.88% (0.3400 => 0.3600, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0328) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.12% (1.6521 => 1.7201, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0028) MultiSource/Applications/obsequi/Obsequi: 2.73% (2.0521 => 2.1081, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.54% (4.5603 => 4.6763, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (3.9922 => 4.0683, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.3161 => 1.3361, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.11% (3.9842 => 4.0283, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -77.18% (2.9442 => 0.6720, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: -5.78% (1.8680 => 1.7600, std.dev.: 0.0219) SingleSource/UnitTests/Vector/constpool: -3.24% (10.6247 => 10.2806, std.dev.: 0.1022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.27% (91.8497 => 49.3511, std.dev.: 10.1738) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.83% (26.0616 => 16.9851, std.dev.: 0.1450) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.42% (50.3031 => 32.9901, std.dev.: 0.1265) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.39% (42.1466 => 28.4938, std.dev.: 0.4855) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1081) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.34% (0.1160 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0142) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.09% (4.0283 => 3.9842, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 07:45:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 09:45:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140410144500.C502C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24503?compare_to=24493&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24503, Order: 205958, Start Time: 2014-04-10 10:00:38, End Time: 2014-04-10 14:51:26 To: 24493, Order: 205950, Start Time: 2014-04-10 05:04:36, End Time: 2014-04-10 09:55:41 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (123 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (955 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 400.00% (0.0040 => 0.0200, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0030) SingleSource/Regression/C/casts: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.00% (0.3200 => 0.3520, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 6.29% (0.6360 => 0.6760, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/moments: 2.68% (0.4480 => 0.4600, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.91% (0.6280 => 0.6400, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/nestedloop: 1.55% (1.0321 => 1.0481, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 28.57% (0.0560 => 0.0720, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 7.20% (0.5000 => 0.5360, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (2.8162 => 2.7802, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0105) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0068) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 35.71% (0.0560 => 0.0760, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.18% (1.7641 => 2.1201, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.05% (1.6761 => 2.0121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.72% (1.7241 => 2.0641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.68% (1.7681 => 2.1161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.57% (1.6961 => 2.0281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.28% (1.6801 => 2.0041, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.15% (1.6921 => 2.0161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.14% (1.6721 => 1.9921, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.03% (1.8081 => 2.1521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.85% (1.8881 => 2.2441, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.79% (1.9801 => 2.3521, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.68% (1.6921 => 2.0081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.62% (1.8041 => 2.1401, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.46% (1.8201 => 2.1561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.16% (1.8281 => 2.1601, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.86% (1.8361 => 2.1641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.61% (1.9081 => 2.2441, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.94% (1.9601 => 2.2921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.90% (1.9641 => 2.2961, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.60% (1.9761 => 2.3041, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.56% (1.9801 => 2.3081, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0059) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.32% (0.3280 => 0.3520, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2360 => 0.2520, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (11.7880 => 12.5240, std.dev.: 0.0747) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.7200 => 7.1000, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0221) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (9.9842 => 10.4402, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0053) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0288) MultiSource/Applications/d/make_dparser: 3.53% (3.9641 => 4.1041, std.dev.: 0.0249) MultiSource/Applications/JM/ldecod/ldecod: 3.45% (10.3203 => 10.6764, std.dev.: 0.0232) MultiSource/Applications/oggenc/oggenc: 3.41% (6.9124 => 7.1484, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (6.8321 => 7.0641, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: 2.86% (18.4924 => 19.0206, std.dev.: 0.0521) MultiSource/Applications/JM/lencod/lencod: 2.74% (22.6287 => 23.2488, std.dev.: 0.0576) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (2.0440 => 2.1000, std.dev.: 0.0197) MultiSource/Applications/treecc/treecc: 2.60% (2.6200 => 2.6880, std.dev.: 0.0205) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.24% (51.1089 => 52.2529, std.dev.: 0.1260) MultiSource/Benchmarks/Bullet/bullet: 1.87% (38.9366 => 39.6646, std.dev.: 0.0943) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (3.0122 => 3.0682, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (16.5963 => 16.9003, std.dev.: 0.0451) MultiSource/Applications/ClamAV/clamscan: 1.78% (20.2445 => 20.6045, std.dev.: 0.0458) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: 1.72% (19.7371 => 20.0771, std.dev.: 0.0529) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2203 => 4.2843, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 1.22% (25.1895 => 25.4975, std.dev.: 0.0377) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 4.69% (0.5120 => 0.5360, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0356) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (0.6840 => 0.6960, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0184) MultiSource/Applications/lua/lua: 1.57% (21.6534 => 21.9934, std.dev.: 0.0925) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (1.2921 => 1.3121, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.75% (6.2884 => 1.3361, std.dev.: 0.0151) SingleSource/UnitTests/2002-08-19-CodegenBug: -66.67% (0.0240 => 0.0080, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/nestedloop: -64.64% (2.9642 => 1.0481, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.70% (3.1762 => 1.2481, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: -33.84% (2.6481 => 1.7520, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout/matrix: -31.25% (0.1280 => 0.0880, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.58% (7.4801 => 6.2400, std.dev.: 0.0419) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.21% (7.5041 => 6.2880, std.dev.: 0.0550) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: -4.07% (10.9087 => 10.4647, std.dev.: 0.0949) MultiSource/Benchmarks/mafft/pairlocalalign: -3.05% (13.5243 => 13.1123, std.dev.: 0.0418) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0200) MultiSource/Applications/JM/lencod/lencod: -1.73% (8.3085 => 8.1645, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -1.44% (4.9883 => 4.9163, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3401 => 2.3081, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0127) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 07:55:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 09:55:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140410145540.1BC592A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24504?compare_to=24494&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24504, Order: 205959, Start Time: 2014-04-10 10:09:42, End Time: 2014-04-10 15:02:04 To: 24494, Order: 205950, Start Time: 2014-04-10 05:09:46, End Time: 2014-04-10 10:02:13 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (127 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C/globalrefs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 30.00% (0.0400 => 0.0520, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/mst/mst: 18.18% (0.1320 => 0.1560, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.2480 => 0.2680, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 3.86% (1.7600 => 1.8280, std.dev.: 0.0174) MultiSource/Benchmarks/sim/sim: 3.23% (0.3720 => 0.3840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 2.46% (0.4880 => 0.5000, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.95% (10.4403 => 10.6444, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.43% (1.9641 => 1.9921, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -19.05% (0.0840 => 0.0680, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.86% (17.6723 => 19.5923, std.dev.: 0.0389) MultiSource/Applications/sqlite3/sqlite3: 1412.95% (1.7001 => 25.7216, std.dev.: 0.0504) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.51% (50.1010 => 51.8610, std.dev.: 0.0942) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (11.3920 => 12.3600, std.dev.: 0.0536) SingleSource/Benchmarks/Misc/oourafft: 175.31% (11.3407 => 31.2220, std.dev.: 0.0690) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0363, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0132) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0090) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0038) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-6: 44.44% (0.0360 => 0.0520, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 15.62% (0.1280 => 0.1480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.94% (1.8361 => 2.0921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.85% (1.8201 => 2.0721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.67% (1.9601 => 2.2281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0147) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.32% (1.8921 => 2.1441, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.12% (1.8601 => 2.1041, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.13% (1.9761 => 2.1961, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.06% (1.8081 => 2.0081, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.11% (1.8201 => 2.0041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.89% (1.8601 => 2.0441, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.79% (1.8801 => 2.0641, std.dev.: 0.0172) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.35% (1.0880 => 1.1680, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0130) MultiSource/Applications/hbd/hbd: 5.79% (1.7280 => 1.8280, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (6.4800 => 6.8360, std.dev.: 0.0539) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.12% (2.9721 => 3.1242, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.6960 => 1.7760, std.dev.: 0.0214) MultiSource/Applications/sgefa/sgefa: 4.55% (0.6160 => 0.6440, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (9.6042 => 10.0242, std.dev.: 0.0398) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (5.8281 => 6.0761, std.dev.: 0.0299) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (10.2283 => 10.6444, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 3.59% (1.7841 => 1.8481, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 3.53% (1.1320 => 1.1720, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (5.3960 => 5.5840, std.dev.: 0.0236) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (6.5320 => 6.7440, std.dev.: 0.0569) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0077) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.63% (6.5360 => 6.7080, std.dev.: 0.0351) MultiSource/Applications/treecc/treecc: 2.63% (2.5880 => 2.6560, std.dev.: 0.0180) MultiSource/Applications/SPASS/SPASS: 2.55% (18.5284 => 19.0005, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (16.3003 => 16.7083, std.dev.: 0.0447) MultiSource/Applications/oggenc/oggenc: 2.38% (7.0524 => 7.2205, std.dev.: 0.0179) MultiSource/Benchmarks/Bullet/bullet: 2.26% (38.6366 => 39.5086, std.dev.: 0.0684) MultiSource/Applications/JM/lencod/lencod: 2.16% (22.2206 => 22.7008, std.dev.: 0.0625) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.21% (2.1201 => 2.4002, std.dev.: 0.0605) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0275) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.18% (6.5964 => 6.7404, std.dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (3.9442 => 4.0042, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.32% (2.9562 => 0.7000, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: -7.46% (1.8760 => 1.7360, std.dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.05% (94.8339 => 49.2631, std.dev.: 10.5396) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.18% (49.9431 => 32.8741, std.dev.: 0.1288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.82% (25.7136 => 17.0171, std.dev.: 0.1321) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.44% (37.0863 => 28.3938, std.dev.: 0.4990) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1131) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: -1.34% (4.7883 => 4.7243, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0219) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 07:57:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 09:57:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140410145720.0EF5D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24505?compare_to=24495&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24505, Order: 205959, Start Time: 2014-04-10 10:11:58, End Time: 2014-04-10 15:03:46 To: 24495, Order: 205950, Start Time: 2014-04-10 05:12:39, End Time: 2014-04-10 10:04:36 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (145 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (950 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: 125.00% (0.0160 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/treeadd/treeadd: 55.56% (0.0360 => 0.0560, std.dev.: 0.0076) SingleSource/Regression/C/casts: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.26% (0.3760 => 0.3920, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (1.0160 => 1.0560, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.15% (1.5240 => 1.5720, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.94% (1.4401 => 1.4681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.87% (1.4961 => 1.5241, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.33% (0.3000 => 0.3280, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.67% (0.6000 => 0.5840, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2012.50% (0.0320 => 0.6760, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0101) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0076) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 392.10% (0.2520 => 1.2401, std.dev.: 0.0147) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 275.91% (0.2320 => 0.8721, std.dev.: 0.0095) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0090) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0070) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0082) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0047) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0160) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.00% (1.2321 => 1.5401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.75% (1.2481 => 1.5321, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: 22.13% (1.3920 => 1.7000, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.45% (1.1721 => 1.4001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.39% (1.1761 => 1.4041, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0166) MultiSource/Applications/JM/ldecod/ldecod: 18.74% (8.5802 => 10.1883, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 17.58% (1.1601 => 1.3641, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.25% (1.2521 => 1.4681, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.67% (1.2001 => 1.4001, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.89% (1.3841 => 1.6041, std.dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: 15.17% (19.5406 => 22.5047, std.dev.: 0.0425) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.32% (5.3360 => 6.1001, std.dev.: 0.0447) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.7400 => 1.9560, std.dev.: 0.0157) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 11.61% (0.4480 => 0.5000, std.dev.: 0.0126) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.82% (5.6680 => 6.1680, std.dev.: 0.0405) MultiSource/Benchmarks/mafft/pairlocalalign: 8.71% (11.3843 => 12.3763, std.dev.: 0.0401) MultiSource/Applications/oggenc/oggenc: 8.34% (6.2844 => 6.8084, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.24% (5.7280 => 6.2000, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (11.4440 => 12.3400, std.dev.: 0.0677) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.52% (0.3680 => 0.3920, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.18% (9.5802 => 10.1722, std.dev.: 0.0469) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.4760 => 1.5440, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (6.8280 => 7.0640, std.dev.: 0.0488) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0505) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.30% (49.1529 => 50.7769, std.dev.: 0.0703) MultiSource/Applications/lua/lua: 3.19% (4.7720 => 4.9240, std.dev.: 0.0410) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.7320 => 1.7840, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (1.5280 => 1.5720, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 2.75% (19.2243 => 19.7523, std.dev.: 0.0543) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 2.34% (24.7575 => 25.3375, std.dev.: 0.0224) MultiSource/Benchmarks/Bullet/bullet: 1.35% (39.0726 => 39.6006, std.dev.: 0.0840) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0124 => 6.0924, std.dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.7282 => 2.7642, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 1.24% (19.7491 => 19.9931, std.dev.: 0.0661) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0117) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.87% (6.8204 => 7.0164, std.dev.: 0.0313) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.84% (3.2362 => 3.3282) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0173) MultiSource/Applications/sqlite3/sqlite3: 2.07% (4.0563 => 4.1403, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.59% (11.0207 => 10.4047, std.dev.: 0.0986) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.60% (5.2763 => 4.9283, std.dev.: 0.0760) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3401 => 2.3121, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 08:07:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 10:07:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410150749.136AD2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24506?compare_to=24500&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24506, Order: 205960, Start Time: 2014-04-10 10:31:24, End Time: 2014-04-10 15:14:12 To: 24500, Order: 205958, Start Time: 2014-04-10 09:31:50, End Time: 2014-04-10 14:14:41 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (100 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/function_try_block: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Regression/C/sumarray: 60.00% (0.0200 => 0.0320, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/bmm/bmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.39% (0.0920 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1560 => 0.1760, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.46% (0.2960 => 0.3240, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 7.69% (0.1560 => 0.1680, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3280 => 0.3400, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.81% (3.7560 => 3.8241, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.57% (1.2721 => 1.2921, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.55% (1.2881 => 1.3081, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.52% (1.3161 => 1.3361, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4322 => 2.4602, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.53% (0.2280 => 0.2520, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.26% (0.2160 => 0.2360, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0498) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0478) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.16% (1.3641 => 1.4481, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0392) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0223) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0290) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0509) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (5.8000 => 5.9400, std.dev.: 0.0535) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.00% (48.1088 => 49.0689, std.dev.: 0.0622) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 1.60% (37.0925 => 37.6846, std.dev.: 0.0674) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0522) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0078) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.20% (1.0921 => 1.1161, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.10% (21.1533 => 21.3853, std.dev.: 0.0618) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -4.96% (10.8967 => 10.3566, std.dev.: 0.1136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 09:15:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 11:15:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410161545.25FF52A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24507?compare_to=24506&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24507, Order: 205962, Start Time: 2014-04-10 11:34:45, End Time: 2014-04-10 16:22:09 To: 24506, Order: 205960, Start Time: 2014-04-10 10:31:24, End Time: 2014-04-10 15:14:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (90 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1004 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/n-body: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.2880 => 0.3040, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.4280 => 0.4480, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: 3.57% (1.4560 => 1.5080, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.42% (1.5200 => 1.5720, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.13% (0.5120 => 0.5280, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.38% (1.4481 => 1.4681, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -14.29% (0.0840 => 0.0720, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0159) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.60% (1.2721 => 1.3561, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0657) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0152) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0386) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0439) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0353) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: 2.11% (17.6165 => 17.9885, std.dev.: 0.0481) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0284) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.82% (48.1088 => 48.9849, std.dev.: 0.0787) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0532) MultiSource/Benchmarks/Bullet/bullet: 1.67% (37.0925 => 37.7126, std.dev.: 0.0805) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 1.15% (18.8170 => 19.0330, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0086) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0306) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -5.58% (10.8967 => 10.2886, std.dev.: 0.0999) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: -3.76% (0.7440 => 0.7160, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 10:41:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 12:41:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410174103.A6C332A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24508?compare_to=24507&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24508, Order: 205963, Start Time: 2014-04-10 13:04:46, End Time: 2014-04-10 17:47:27 To: 24507, Order: 205962, Start Time: 2014-04-10 11:34:45, End Time: 2014-04-10 16:22:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (97 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/testtrace: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/almabench: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.14% (0.2800 => 0.3000, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.12% (0.6800 => 0.7080, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.47% (1.2961 => 1.3281, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.58% (1.2681 => 1.2881, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 2.79% (0.7160 => 0.7360, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (3.9562 => 4.0003, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.50% (1.1761 => 1.2761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.69% (1.1441 => 1.2321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0680) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.71% (1.1921 => 1.2721, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (6.0160 => 6.3320, std.dev.: 0.0453) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0501) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.32% (0.7400 => 0.7720, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0233) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0400) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0305) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0337) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0448) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0574) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0501) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0361) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0365) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.67% (48.1088 => 48.9129, std.dev.: 0.0977) MultiSource/Benchmarks/Bullet/bullet: 1.63% (37.0925 => 37.6966, std.dev.: 0.0703) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0373) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.96% (5.8164 => 5.9884, std.dev.: 0.0094) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0173) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.28% (4.0643 => 4.1163, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -4.29% (10.8967 => 10.4287, std.dev.: 0.0959) MultiSource/Applications/lemon/lemon: -2.60% (1.3841 => 1.3481, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 11:13:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 13:13:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410181308.141782A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24509?compare_to=24508&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24509, Order: 205964, Start Time: 2014-04-10 13:34:59, End Time: 2014-04-10 18:19:32 To: 24508, Order: 205963, Start Time: 2014-04-10 13:04:46, End Time: 2014-04-10 17:47:27 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (96 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.53% (0.1520 => 0.1680, std.dev.: 0.0049) SingleSource/UnitTests/SignlessTypes/rem: 10.00% (0.1200 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.86% (0.2840 => 0.3120, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.09% (0.3080 => 0.3360, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.59% (0.3160 => 0.3400, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: 3.75% (0.3200 => 0.3320, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (1.5240 => 1.5680, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: 1.78% (1.3481 => 1.3721, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9121 => 0.9281, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.13% (3.2962 => 3.4322, std.dev.: 0.0506) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0055) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.09% (1.2361 => 1.3361, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0660) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.60% (1.2721 => 1.3561, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0109) SingleSource/Benchmarks/Linpack/linpack-pc: 5.06% (0.3160 => 0.3320, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0157) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0548) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0315) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: 2.34% (17.6165 => 18.0285, std.dev.: 0.0547) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.87% (48.1088 => 49.0089, std.dev.: 0.0466) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 1.33% (37.0925 => 37.5845, std.dev.: 0.0856) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.31% (0.9161 => 0.9281, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0383) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: 3.29% (2.0681 => 2.1361, std.dev.: 0.0117) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (4.0643 => 4.1203, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/Regression/C++/EH/function_try_block: -37.50% (0.0320 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -3.96% (10.8967 => 10.4647, std.dev.: 0.1200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0227) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 11:56:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 13:56:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410185646.15CED2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24510?compare_to=24509&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24510, Order: 205967, Start Time: 2014-04-10 14:21:00, End Time: 2014-04-10 19:03:09 To: 24509, Order: 205964, Start Time: 2014-04-10 13:34:59, End Time: 2014-04-10 18:19:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (97 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 25.00% (0.0640 => 0.0800, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.88% (0.6760 => 0.7360, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.68% (0.3520 => 0.3720, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (4.9760 => 5.0520, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 25.00% (0.0960 => 0.1200, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.54% (10.4647 => 2.0361, std.dev.: 0.0101) SingleSource/Benchmarks/Linpack/linpack-pc: -4.82% (0.3320 => 0.3160, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.53% (0.3040 => 0.3360, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.77% (1.2361 => 1.3321, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0757) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.27% (1.2121 => 1.2881, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0217) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0246) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (8.1441 => 8.4641, std.dev.: 0.0599) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0220) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0324) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0162) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.29% (17.6165 => 18.0205, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0486) MultiSource/Applications/sqlite3/sqlite3: 2.14% (23.7574 => 24.2655, std.dev.: 0.0397) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1170, std.dev.: 0.0949) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0343) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8206, std.dev.: 0.0817) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1290, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0471) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.04% (4.5203 => 4.6123, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (4.0643 => 4.1203, std.dev.: 0.0178) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0262) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 12:20:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 14:20:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140410192034.2163D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24511?compare_to=24501&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24511, Order: 205967, Start Time: 2014-04-10 14:39:54, End Time: 2014-04-10 19:26:59 To: 24501, Order: 205958, Start Time: 2014-04-10 09:45:07, End Time: 2014-04-10 14:33:34 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 14.29% (0.0840 => 0.0960, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 10.64% (0.1880 => 0.2080, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 5.13% (0.4680 => 0.4920, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.7800 => 0.8200, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.55% (0.2640 => 0.2760, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4520 => 0.4720, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.12% (1.5520 => 1.6160, std.dev.: 0.0206) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/oggenc/oggenc: 9.09% (0.1320 => 0.1440, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 1.76% (0.6800 => 0.6920, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.69% (10.4847 => 2.0241, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/football/football: -2.42% (1.1560 => 1.1280, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 12:24:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 14:24:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140410192418.9F7BF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24512?compare_to=24502&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24512, Order: 205967, Start Time: 2014-04-10 14:42:49, End Time: 2014-04-10 19:30:43 To: 24502, Order: 205958, Start Time: 2014-04-10 09:47:17, End Time: 2014-04-10 14:36:27 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 10 (134 on baseline) Performance Improvements: 2 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.98% (0.3280 => 0.3640, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.41% (0.2160 => 0.2320, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.14% (0.1680 => 0.1800, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.4160 => 0.4320, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.34% (2.3881 => 2.4202, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.23% (1.6321 => 1.6521, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Puzzle: 1.09% (1.8281 => 1.8481, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.31% (10.2806 => 2.0241, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.56% (0.3600 => 0.3400, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.38% (11.3687 => 31.1939, std.dev.: 0.0697) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0062) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 301.76% (0.4600 => 1.8481, std.dev.: 0.0057) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 27.78% (0.0720 => 0.0920, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0128) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.35% (0.3240 => 0.3640, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.43% (1.4961 => 1.6521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0131) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.61% (1.4561 => 1.5961, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.49% (1.5601 => 1.7081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.31% (1.4601 => 1.5961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.26% (0.2160 => 0.2360, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0082) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.43% (0.3320 => 0.3600, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.7361 => 1.8681, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.43% (1.7761 => 1.9081, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.14% (0.1680 => 0.1800, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.04% (0.2840 => 0.3040, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.96% (1.6081 => 1.7201, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.49% (11.6440 => 12.4000, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (6.4680 => 6.8600, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.93% (1.4161 => 1.5001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.7400 => 1.8400, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0153) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0226) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0155) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (9.4842 => 9.9402, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/hash2: 4.76% (0.5040 => 0.5280, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0139) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (6.5440 => 6.8120, std.dev.: 0.0524) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (5.8121 => 6.0441, std.dev.: 0.0497) MultiSource/Applications/JM/ldecod/ldecod: 3.98% (10.0443 => 10.4443, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.1280 => 1.1720, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (5.3600 => 5.5640, std.dev.: 0.0239) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.81% (50.0290 => 51.9330, std.dev.: 0.0603) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 3.63% (21.9606 => 22.7568, std.dev.: 0.0548) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0165) MultiSource/Applications/hbd/hbd: 3.46% (1.7360 => 1.7960, std.dev.: 0.0230) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 3.12% (38.4046 => 39.6046, std.dev.: 0.0614) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 2.95% (18.4404 => 18.9846, std.dev.: 0.0357) MultiSource/Applications/treecc/treecc: 2.94% (2.5840 => 2.6600, std.dev.: 0.0270) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: 2.52% (19.0444 => 19.5244, std.dev.: 0.0486) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (16.3483 => 16.7483, std.dev.: 0.0425) MultiSource/Applications/kimwitu++/kc: 2.07% (19.6891 => 20.0971, std.dev.: 0.0491) MultiSource/Applications/siod/siod: 2.06% (2.7162 => 2.7722, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.97% (0.9241 => 1.1641, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.70% (2.1401 => 2.4762, std.dev.: 0.0531) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.91% (7.4205 => 7.6365, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.21% (3.9842 => 4.0323, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.10% (1.5641 => 0.6240, std.dev.: 0.0070) MultiSource/Applications/obsequi/Obsequi: -6.85% (1.8680 => 1.7400, std.dev.: 0.0324) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.54% (91.8497 => 49.1031, std.dev.: 10.0748) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.97% (26.0616 => 16.9491, std.dev.: 0.1888) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.39% (50.3031 => 33.0061, std.dev.: 0.1352) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.24% (42.1466 => 28.5578, std.dev.: 0.5394) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1130) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0106) MultiSource/Benchmarks/BitBench/five11/five11: -1.19% (2.3561 => 2.3281, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0164) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 12:41:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 14:41:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140410194105.0BDFE2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24513?compare_to=24503&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24513, Order: 205967, Start Time: 2014-04-10 14:57:35, End Time: 2014-04-10 19:47:30 To: 24503, Order: 205958, Start Time: 2014-04-10 10:00:38, End Time: 2014-04-10 14:51:26 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (126 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 52.94% (0.0680 => 0.1040, std.dev.: 0.0059) SingleSource/UnitTests/2003-08-11-VaListArg: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.53% (0.1520 => 0.1680, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 7.08% (0.4520 => 0.4840, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.45% (0.4640 => 0.4800, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (0.9201 => 0.9361, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.41% (1.9921 => 2.0201, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.05% (2.2801 => 2.3041, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 25.00% (0.0640 => 0.0800, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 14.29% (0.0840 => 0.0960, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4647 => 2.0321, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 500.00% (0.0040 => 0.0240, std.dev.: 0.0048) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0160 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.18% (1.7641 => 2.1201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.66% (1.6681 => 1.9961, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.62% (1.6921 => 2.0241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.52% (1.6801 => 2.0081, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.30% (1.7201 => 2.0521, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.79% (1.9801 => 2.3521, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.60% (1.8281 => 2.1681, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.08% (1.8361 => 2.1681, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.97% (1.9801 => 2.3161, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 13.51% (0.1480 => 0.1680, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.46% (0.2080 => 0.2360, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0070) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0057) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.77% (3.5002 => 3.7722, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.45% (11.7880 => 12.5480, std.dev.: 0.0609) MultiSource/Benchmarks/McCat/18-imp/imp: 6.14% (0.4560 => 0.4840, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0232) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (6.7200 => 7.1080, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (1.6481 => 1.7321, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0171) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0150) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (1.0001 => 1.0441, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (2.0680 => 2.1520, std.dev.: 0.0187) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3040 => 0.3160, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 3.88% (6.9124 => 7.1804, std.dev.: 0.0174) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.81% (9.9842 => 10.3642, std.dev.: 0.0602) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 3.43% (3.9641 => 4.1001, std.dev.: 0.0360) MultiSource/Applications/lua/lua: 3.42% (4.7920 => 4.9560, std.dev.: 0.0324) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (10.3203 => 10.6644, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (2.0440 => 2.1120, std.dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: 3.14% (18.4924 => 19.0725, std.dev.: 0.0322) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (6.8321 => 7.0321, std.dev.: 0.0402) MultiSource/Applications/JM/lencod/lencod: 2.86% (22.6287 => 23.2767, std.dev.: 0.0543) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.56% (0.4680 => 0.4800, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.44% (0.4920 => 0.5040, std.dev.: 0.0043) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.33% (51.1089 => 52.3009, std.dev.: 0.1175) MultiSource/Benchmarks/Bullet/bullet: 2.22% (38.9366 => 39.8006, std.dev.: 0.0663) MultiSource/Applications/kimwitu++/kc: 1.97% (19.7371 => 20.1251, std.dev.: 0.0448) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (3.0122 => 3.0682, std.dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: 1.84% (20.2445 => 20.6165, std.dev.: 0.0632) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (16.5963 => 16.8683, std.dev.: 0.0535) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2203 => 4.2843, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (6.0244 => 6.1084, std.dev.: 0.0184) MultiSource/Applications/sqlite3/sqlite3: 1.35% (25.1895 => 25.5295, std.dev.: 0.0399) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 26.29% (0.9281 => 1.1721, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.26% (1.2121 => 1.3001, std.dev.: 0.0302) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0098) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 2.01% (5.9604 => 6.0804, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.7563 => 4.8203, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.37% (10.9087 => 2.0321, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.82% (6.2884 => 1.3321, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout/nestedloop: -64.78% (2.9642 => 1.0441, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.70% (3.1762 => 1.2481, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/recursive: -44.44% (0.0360 => 0.0200, std.dev.: 0.0059) SingleSource/Regression/C++/EH/ConditionalExpr: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -32.78% (2.6481 => 1.7800, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.58% (7.4801 => 6.2400, std.dev.: 0.0695) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.26% (7.5041 => 6.2840, std.dev.: 0.0453) SingleSource/UnitTests/Vector/multiplies: -14.63% (0.1640 => 0.1400, std.dev.: 0.0066) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: -3.31% (13.5243 => 13.0763, std.dev.: 0.0500) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -15.03% (7.8005 => 6.6284, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0226) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0121) MultiSource/Benchmarks/sim/sim: -1.68% (4.9883 => 4.9043, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 12:50:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 14:50:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140410195026.51E0D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24514?compare_to=24504&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24514, Order: 205967, Start Time: 2014-04-10 15:06:02, End Time: 2014-04-10 19:56:50 To: 24504, Order: 205959, Start Time: 2014-04-10 10:09:42, End Time: 2014-04-10 15:02:04 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 18 (123 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (959 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/byval-alignment: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/NP/np: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C/sumarray2d: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/almabench: 22.22% (0.0720 => 0.0880, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.18% (0.0880 => 0.1040, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/lists: 6.85% (0.2920 => 0.3120, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.92% (0.2440 => 0.2560, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 4.92% (0.2440 => 0.2560, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (1.5920 => 1.6360, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.71% (2.1041 => 2.1401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.13% (2.1281 => 2.1521, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 16.13% (0.1240 => 0.1440, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 16.00% (0.1000 => 0.1160, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.42% (10.3806 => 2.0321, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.27% (17.6723 => 19.6644, std.dev.: 0.0572) MultiSource/Applications/sqlite3/sqlite3: 1417.65% (1.7001 => 25.8016, std.dev.: 0.0314) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.66% (50.1010 => 51.9330, std.dev.: 0.0893) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 0.38% (1.0520 => 1.0560, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.08% (11.3920 => 12.3120, std.dev.: 0.0527) SingleSource/Benchmarks/Misc/oourafft: 174.67% (11.3407 => 31.1499, std.dev.: 0.1252) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0363, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0074) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0083) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: 100.00% (0.0200 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 66.67% (0.0240 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.93% (0.1720 => 0.2080, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.05% (1.8601 => 2.1401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.71% (1.8761 => 2.1521, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.78% (1.9161 => 2.1801, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.26% (1.9601 => 2.2201, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.11% (1.8921 => 2.1401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.97% (1.9121 => 2.1601, std.dev.: 0.0113) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (1.9761 => 2.2041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.50% (1.8081 => 2.0161, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0119) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.83% (1.7721 => 1.9641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 10.34% (0.2320 => 0.2560, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.25% (2.0681 => 2.2801, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.21% (1.9201 => 2.1161, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.02% (1.8361 => 2.0201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.89% (2.1041 => 2.3121, std.dev.: 0.0135) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/matrix: 8.57% (0.2800 => 0.3040, std.dev.: 0.0057) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.47% (0.2360 => 0.2560, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4920 => 0.5280, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0220) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.86% (6.4800 => 6.8600, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (2.9721 => 3.1322, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (5.8281 => 6.1001, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.5640 => 1.6360, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (9.6042 => 10.0202, std.dev.: 0.0274) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (6.5320 => 6.7920, std.dev.: 0.0394) MultiSource/Applications/Burg/burg: 3.93% (1.5280 => 1.5880, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.7480 => 1.8160, std.dev.: 0.0204) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 3.83% (10.2283 => 10.6204, std.dev.: 0.0414) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (2.1600 => 2.2400, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 2.84% (4.7920 => 4.9280, std.dev.: 0.0302) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (16.3003 => 16.7483, std.dev.: 0.0336) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0217) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.2206 => 22.8087, std.dev.: 0.0496) MultiSource/Benchmarks/Bullet/bullet: 2.52% (38.6366 => 39.6086, std.dev.: 0.0642) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (2.3401 => 2.3961, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (5.3960 => 5.5240, std.dev.: 0.0367) MultiSource/Applications/SPASS/SPASS: 2.31% (18.5284 => 18.9565, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.14% (6.5360 => 6.6760, std.dev.: 0.0485) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 1.19% (19.8291 => 20.0651, std.dev.: 0.0455) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.53% (2.1201 => 2.4282, std.dev.: 0.0420) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0329) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 2.18% (6.5964 => 6.7404, std.dev.: 0.0423) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.32% (2.9562 => 0.7000, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0035) MultiSource/Applications/obsequi/Obsequi: -6.18% (1.8760 => 1.7600, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.05% (94.8339 => 49.2671, std.dev.: 10.8653) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.04% (49.9431 => 32.9421, std.dev.: 0.2002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.87% (25.7136 => 17.0051, std.dev.: 0.1362) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.70% (3.0722 => 2.3441, std.dev.: 0.1121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.85% (37.0863 => 28.6138, std.dev.: 0.6578) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 12:51:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 14:51:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140410195126.5C0112A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24515?compare_to=24505&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24515, Order: 205967, Start Time: 2014-04-10 15:07:40, End Time: 2014-04-10 19:57:51 To: 24505, Order: 205959, Start Time: 2014-04-10 10:11:58, End Time: 2014-04-10 15:03:46 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 12 (149 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/TestLoop: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2002-05-02-CastTest: 133.33% (0.0120 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/FloatMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2440 => 0.2560, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (2.1280 => 2.1720, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.63% (1.4681 => 1.4921, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.43% (1.9560 => 1.9840, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (1.0881 => 1.1001, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4047 => 2.0201, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0110) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0116) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 392.10% (0.2520 => 1.2401, std.dev.: 0.0175) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 281.08% (0.2320 => 0.8841, std.dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0070) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0041) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0051) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0038) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0062) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0054) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 45.83% (0.0960 => 0.1400, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0097) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.13% (1.2401 => 1.5641, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: 21.84% (1.3920 => 1.6960, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.54% (1.3001 => 1.5801, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.39% (1.1761 => 1.4041, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: 18.51% (8.5802 => 10.1683, std.dev.: 0.0429) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.77% (1.2881 => 1.5041, std.dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: 15.52% (19.5406 => 22.5727, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.17% (5.3360 => 6.0921, std.dev.: 0.0402) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.02% (1.7400 => 1.9840, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0086) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 9.35% (11.3843 => 12.4483, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0142) MultiSource/Applications/oggenc/oggenc: 8.66% (6.2844 => 6.8284, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.7280 => 6.1960, std.dev.: 0.0595) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (11.4440 => 12.3560, std.dev.: 0.0549) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.83% (5.6680 => 6.1120, std.dev.: 0.0687) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.4320 => 0.4640, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.89% (9.5802 => 10.2402, std.dev.: 0.0315) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.7360 => 0.7760, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0234) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.4760 => 1.5440, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0084) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.82% (2.0920 => 2.1720, std.dev.: 0.0132) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0158) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (49.1529 => 50.8329, std.dev.: 0.1048) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (5.3840 => 5.5520, std.dev.: 0.0536) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 2.87% (19.2243 => 19.7764, std.dev.: 0.0425) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.75% (6.8280 => 7.0160, std.dev.: 0.0512) MultiSource/Applications/sqlite3/sqlite3: 2.68% (24.7575 => 25.4215, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (1.2320 => 1.2640, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0101) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 2.15% (19.7491 => 20.1731, std.dev.: 0.0335) MultiSource/Benchmarks/Bullet/bullet: 1.96% (39.0726 => 39.8366, std.dev.: 0.0262) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0124 => 6.1164, std.dev.: 0.0172) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.04% (29.3298 => 29.6339, std.dev.: 0.0382) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0306) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.44% (3.9842 => 4.3203, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.84% (3.2362 => 3.3282, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.52% (6.8204 => 6.9924, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.17% (4.0563 => 4.1443, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0141) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0109) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0911) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0358) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.40% (0.6680 => 0.6520, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.04% (4.1243 => 4.0403, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.24% (3.8562 => 3.8082, std.dev.: 0.0172) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 12:53:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 14:53:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410195315.97C532A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24516?compare_to=24510&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24516, Order: 205968, Start Time: 2014-04-10 15:18:07, End Time: 2014-04-10 19:59:40 To: 24510, Order: 205967, Start Time: 2014-04-10 14:21:00, End Time: 2014-04-10 19:03:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (97 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C/matrixTranspose: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 5.41% (0.4440 => 0.4680, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.46% (0.4480 => 0.4680, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.13% (0.5120 => 0.5280, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.80% (1.3321 => 1.3561, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 1.65% (0.7280 => 0.7400, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.29% (5.4243 => 5.5483, std.dev.: 0.0469) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/PR640: -37.50% (0.0320 => 0.0200, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0044) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0018) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0632) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (6.0160 => 6.3600, std.dev.: 0.0459) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0160) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0379) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0185) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0333) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0298) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0595) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: 2.31% (37.0925 => 37.9485, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0093) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.26% (48.1088 => 49.1968, std.dev.: 0.0748) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0321) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0699) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0164) MultiSource/Applications/kimwitu++/kc: 1.36% (18.8170 => 19.0730, std.dev.: 0.0425) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.89% (0.9321 => 1.1921, std.dev.: 0.0191) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0436) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.24% (10.8967 => 2.0441, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -20.00% (0.1200 => 0.0960, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 14:05:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 16:05:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410210519.1A5A12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24517?compare_to=24516&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24517, Order: 205971, Start Time: 2014-04-10 16:25:57, End Time: 2014-04-10 21:11:43 To: 24516, Order: 205968, Start Time: 2014-04-10 15:18:07, End Time: 2014-04-10 19:59:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (93 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1002 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/test_indvars: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-6: 57.14% (0.0280 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 28.57% (0.0560 => 0.0720, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.67% (0.3000 => 0.3320, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.36% (0.6920 => 0.7360, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/moments: 4.67% (0.4280 => 0.4480, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 4.60% (0.6960 => 0.7280, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.23% (1.2961 => 1.3121, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.21% (1.3201 => 1.3361, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.13% (4.7043 => 4.8043, std.dev.: 0.0272) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0076) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0162) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.60% (1.2121 => 1.2921, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.47% (10.6960 => 11.3880, std.dev.: 0.0740) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0386) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0172) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0089) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.88% (8.1441 => 8.4601, std.dev.: 0.0554) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.3640 => 0.3760, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0201) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0257) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0333) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0564) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0590) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0301) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0447) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.12% (48.1088 => 49.1290, std.dev.: 0.0949) MultiSource/Benchmarks/Bullet/bullet: 1.83% (37.0925 => 37.7726, std.dev.: 0.0760) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0333) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0325) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0446) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0221) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 15:26:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 17:26:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410222616.2EB2E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24518?compare_to=24517&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24518, Order: 205972, Start Time: 2014-04-10 17:51:24, End Time: 2014-04-10 22:32:40 To: 24517, Order: 205971, Start Time: 2014-04-10 16:25:57, End Time: 2014-04-10 21:11:43 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (108 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-02-DependentPHI: 400.00% (0.0040 => 0.0200, std.dev.: 0.0047) SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/treeadd/treeadd: 44.44% (0.0360 => 0.0520, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 38.46% (0.0520 => 0.0720, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Towers: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: 26.67% (0.0600 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.00% (0.0800 => 0.0960, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3200 => 0.3360, std.dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-7: 66.67% (0.0240 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.87% (0.3680 => 0.4080, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0118) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0645) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0445) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0437) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (5.8000 => 6.0560, std.dev.: 0.0309) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0188) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0132) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0299) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0192) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (1.5200 => 1.5760, std.dev.: 0.0210) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0182) MultiSource/Applications/hbd/hbd: 3.33% (1.6800 => 1.7360, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0261) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.35% (48.1088 => 49.2409, std.dev.: 0.0974) MultiSource/Applications/treecc/treecc: 2.29% (2.4480 => 2.5040, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0471) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0445) MultiSource/Benchmarks/Bullet/bullet: 2.12% (37.0925 => 37.8805, std.dev.: 0.1045) MultiSource/Applications/sqlite3/sqlite3: 2.09% (23.7574 => 24.2535, std.dev.: 0.0593) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1330, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0641) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0299) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (1.2601 => 1.2841, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.04% (21.1533 => 21.3733, std.dev.: 0.0646) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0203) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 16:03:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 18:03:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410230345.A30582A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24519?compare_to=24518&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24519, Order: 205975, Start Time: 2014-04-10 18:26:31, End Time: 2014-04-10 23:10:10 To: 24518, Order: 205972, Start Time: 2014-04-10 17:51:24, End Time: 2014-04-10 22:32:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (92 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-04-10-BitfieldTest: 133.33% (0.0120 => 0.0280, std.dev.: 0.0030) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/ccc: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 21.74% (0.0920 => 0.1120, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/SmallPT/smallpt: 12.12% (0.1320 => 0.1480, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.67% (0.3000 => 0.3320, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.86% (1.2881 => 1.3121, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 200.00% (0.0080 => 0.0240, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: 5.26% (0.3800 => 0.4000, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2007-04-10-BitfieldTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0130) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.77% (1.2361 => 1.3321, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (10.6960 => 11.3920, std.dev.: 0.0676) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0359) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0407) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0362) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0196) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0194) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0308) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0482) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0445) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0304) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.78% (48.1088 => 48.9649, std.dev.: 0.1120) MultiSource/Benchmarks/Bullet/bullet: 1.77% (37.0925 => 37.7485, std.dev.: 0.0569) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0598) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (7.8562 => 7.9882, std.dev.: 0.0440) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 4.57% (6.6564 => 6.9604, std.dev.: 0.0429) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.41% (5.8164 => 5.9564, std.dev.: 0.0112) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0186) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3361 => 2.3081, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 16:45:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 18:45:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140410234555.34A2A2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24520?compare_to=24519&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24520, Order: 205980, Start Time: 2014-04-10 19:10:25, End Time: 2014-04-10 23:52:16 To: 24519, Order: 205975, Start Time: 2014-04-10 18:26:31, End Time: 2014-04-10 23:10:10 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (100 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2005-05-13-SDivTwo: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 23.53% (0.0680 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.00% (0.0800 => 0.0920, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.28% (0.6760 => 0.7320, std.dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.82% (0.1760 => 0.1880, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2400 => 0.2520, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 1.63% (2.4520 => 2.4920, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.58% (1.2681 => 1.2881, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.74% (0.0920 => 0.0720, std.dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0752) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0411) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0195) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0292) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0330) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (10.4082 => 10.7202, std.dev.: 0.0425) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0342) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (4.9200 => 5.0440, std.dev.: 0.0429) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2369, std.dev.: 0.0753) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0376) MultiSource/Applications/sqlite3/sqlite3: 2.27% (23.7574 => 24.2975, std.dev.: 0.0387) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8965, std.dev.: 0.0445) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0097) MultiSource/Applications/treecc/treecc: 1.80% (2.4480 => 2.4920, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1131, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0144) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0190) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: 4.57% (6.6564 => 6.9604, std.dev.: 0.0468) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0108) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0095) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0274) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 17:15:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 19:15:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411001509.D0CEC2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24521?compare_to=24511&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24521, Order: 205981, Start Time: 2014-04-10 19:33:59, End Time: 2014-04-11 00:21:33 To: 24511, Order: 205967, Start Time: 2014-04-10 14:39:54, End Time: 2014-04-10 19:26:59 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1097 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/objinst: 27.27% (0.0440 => 0.0560, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.71% (0.1360 => 0.1560, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.45% (1.1600 => 1.2000, std.dev.: 0.0137) MultiSource/Applications/lemon/lemon: 1.60% (1.4961 => 1.5201, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.41% (1.7041 => 1.7281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.17% (1.7081 => 1.7281, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 38.46% (0.0520 => 0.0720, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.73% (0.7280 => 0.5480, std.dev.: 0.0116) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 17:19:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 19:19:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411001907.B3EA92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24522?compare_to=24512&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24522, Order: 205981, Start Time: 2014-04-10 19:37:36, End Time: 2014-04-11 00:25:35 To: 24512, Order: 205967, Start Time: 2014-04-10 14:42:49, End Time: 2014-04-10 19:30:43 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 19 (145 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0031) SingleSource/UnitTests/Vector/sumarray-dbl: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 18.00% (0.2000 => 0.2360, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.29% (0.1680 => 0.1920, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.36% (0.1760 => 0.1960, std.dev.: 0.0076) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.39% (0.4560 => 0.4760, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 2.81% (4.8480 => 4.9840, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.24% (1.7880 => 1.8280, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.09% (1.7201 => 1.7561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.47% (1.9081 => 1.9361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.23% (1.6201 => 1.6401, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.02% (1.5641 => 1.5801, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.71% (0.3400 => 0.3560, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3761 => 1.3921, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.67% (0.1800 => 0.1680, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.52% (11.3687 => 31.2099, std.dev.: 0.0929) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0115) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0103) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.75% (1.0240 => 1.2160, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 13.46% (0.2080 => 0.2360, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.32% (0.6200 => 0.6840, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.77% (1.0240 => 1.1240, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.42% (1.5281 => 1.6721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.27% (1.4241 => 1.5561, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0106) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.29% (1.4961 => 1.6201, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (1.1640 => 1.2560, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.63% (1.4681 => 1.5801, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0117) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.41% (1.4361 => 1.5281, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (11.6440 => 12.3760, std.dev.: 0.0577) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: 6.10% (1.5080 => 1.6000, std.dev.: 0.0272) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0141) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.61% (9.4842 => 10.0162, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.54% (1.7320 => 1.8280, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/strcat: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (5.8121 => 6.1041, std.dev.: 0.0425) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.01% (6.4680 => 6.7920, std.dev.: 0.0586) SingleSource/Benchmarks/Shootout-C++/sieve: 4.71% (0.3400 => 0.3560, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (10.0443 => 10.5123, std.dev.: 0.0454) MultiSource/Benchmarks/McCat/18-imp/imp: 4.55% (0.4400 => 0.4600, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.4640 => 1.5280, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.5600 => 1.6280, std.dev.: 0.0175) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0133) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.23% (50.0290 => 52.1450, std.dev.: 0.0918) MultiSource/Applications/JM/lencod/lencod: 4.14% (21.9606 => 22.8688, std.dev.: 0.0562) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 4.09% (4.7880 => 4.9840, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (2.0440 => 2.1240, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (6.5440 => 6.7880, std.dev.: 0.0535) MultiSource/Applications/SPASS/SPASS: 3.67% (18.4404 => 19.1166, std.dev.: 0.0276) MultiSource/Benchmarks/Bullet/bullet: 3.67% (38.4046 => 39.8126, std.dev.: 0.0723) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0168) MultiSource/Applications/oggenc/oggenc: 3.49% (6.9844 => 7.2285, std.dev.: 0.0181) MultiSource/Applications/hbd/hbd: 3.46% (1.7360 => 1.7960, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (5.3600 => 5.5440, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (3.0282 => 3.1282, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.20% (6.5080 => 6.7160, std.dev.: 0.0517) MultiSource/Applications/ClamAV/clamscan: 2.88% (19.0444 => 19.5923, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0138) MultiSource/Applications/d/make_dparser: 2.82% (3.9681 => 4.0801, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (16.3483 => 16.7803, std.dev.: 0.0626) MultiSource/Applications/kimwitu++/kc: 2.62% (19.6891 => 20.2051, std.dev.: 0.0337) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 2.21% (2.7162 => 2.7762, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.27% (2.1401 => 2.4882, std.dev.: 0.0257) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 5.17% (2.8602 => 3.0082, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.71% (0.3400 => 0.3560, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0258) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.81% (4.5603 => 4.6883, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (3.9922 => 4.0603, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.31% (3.9842 => 4.0363, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (3.9562 => 4.0042, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.50% (2.9442 => 0.6920, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0065) MultiSource/Applications/obsequi/Obsequi: -5.57% (1.8680 => 1.7640, std.dev.: 0.0237) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.10% (91.8497 => 49.5111, std.dev.: 9.6829) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.98% (26.0616 => 16.9451, std.dev.: 0.1250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.39% (50.3031 => 33.0061, std.dev.: 0.1457) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.12% (42.1466 => 28.6098, std.dev.: 0.3857) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1078) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3561 => 2.3081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 17:38:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 19:38:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140411003816.0D4962A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24523?compare_to=24513&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24523, Order: 205984, Start Time: 2014-04-10 19:54:20, End Time: 2014-04-11 00:44:41 To: 24513, Order: 205967, Start Time: 2014-04-10 14:57:35, End Time: 2014-04-10 19:47:30 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (129 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (953 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-7: 33.33% (0.0360 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 20.00% (0.0800 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.25% (0.1920 => 0.2040, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 4.29% (0.6520 => 0.6800, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3600 => 0.3720, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (1.1160 => 1.1400, std.dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.35% (10.3642 => 10.5042, std.dev.: 0.0310) MultiSource/Applications/lua/lua: 1.29% (4.9560 => 5.0200, std.dev.: 0.0210) MultiSource/Applications/d/make_dparser: 1.17% (4.1001 => 4.1481, std.dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 20.69% (0.1160 => 0.1400, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0025) SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0099) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0051) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0024) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.28% (1.6961 => 2.0401, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.86% (1.7321 => 2.0761, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.81% (1.6761 => 2.0081, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.72% (1.7241 => 2.0641, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.60% (1.8281 => 2.1681, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.21% (1.9761 => 2.3161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.98% (1.9081 => 2.2321, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.77% (1.9801 => 2.3121, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: 14.29% (0.0840 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0076) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0190) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.01% (11.7880 => 12.4960, std.dev.: 0.0763) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.95% (6.7200 => 7.1200, std.dev.: 0.0374) MultiSource/Benchmarks/McCat/08-main/main: 5.75% (0.3480 => 0.3680, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.4160 => 1.4920, std.dev.: 0.0123) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (9.9842 => 10.5042, std.dev.: 0.0310) MultiSource/Applications/spiff/spiff: 5.10% (1.0200 => 1.0720, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0210) MultiSource/Applications/d/make_dparser: 4.64% (3.9641 => 4.1481, std.dev.: 0.0154) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0213) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.94% (1.7280 => 1.7960, std.dev.: 0.0244) MultiSource/Applications/oggenc/oggenc: 3.76% (6.9124 => 7.1724, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (6.8321 => 7.0801, std.dev.: 0.0379) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (10.3203 => 10.6883, std.dev.: 0.0303) MultiSource/Applications/JM/lencod/lencod: 3.11% (22.6287 => 23.3328, std.dev.: 0.0564) MultiSource/Applications/SPASS/SPASS: 3.07% (18.4924 => 19.0606, std.dev.: 0.0569) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.92% (1.3720 => 1.4120, std.dev.: 0.0147) MultiSource/Benchmarks/Bullet/bullet: 2.69% (38.9366 => 39.9846, std.dev.: 0.0694) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.65% (51.1089 => 52.4609, std.dev.: 0.1196) MultiSource/Applications/ClamAV/clamscan: 2.47% (20.2445 => 20.7445, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (16.5963 => 16.9883, std.dev.: 0.0350) MultiSource/Applications/kimwitu++/kc: 2.21% (19.7371 => 20.1731, std.dev.: 0.0465) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.12% (6.0244 => 6.1524, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (3.0122 => 3.0602, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.45% (25.1895 => 25.5535, std.dev.: 0.0517) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.9281 => 1.1601, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0116) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0106) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0388) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.21% (0.9961 => 1.0281, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.55% (4.7003 => 4.8203, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 1.72% (21.6534 => 22.0254, std.dev.: 0.0780) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.7563 => 4.8203, std.dev.: 0.0184) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.69% (6.2884 => 1.3401, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout/nestedloop: -64.78% (2.9642 => 1.0441, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.23% (1.5881 => 0.5680, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.83% (3.1762 => 1.2441, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: -32.63% (2.6481 => 1.7840, std.dev.: 0.0152) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.10% (7.5041 => 6.2960, std.dev.: 0.0585) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.83% (7.4801 => 6.2960, std.dev.: 0.0291) SingleSource/UnitTests/Vector/multiplies: -14.63% (0.1640 => 0.1400, std.dev.: 0.0080) SingleSource/Regression/C/sumarray2d: -7.26% (0.7160 => 0.6640, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (13.5243 => 13.1243, std.dev.: 0.0367) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 17:42:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 19:42:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411004212.ED4322A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24524?compare_to=24520&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24524, Order: 205984, Start Time: 2014-04-10 20:06:21, End Time: 2014-04-11 00:48:38 To: 24520, Order: 205980, Start Time: 2014-04-10 19:10:25, End Time: 2014-04-10 23:52:16 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (97 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.77% (0.2600 => 0.2880, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.73% (0.9241 => 0.9401, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 33.33% (0.0360 => 0.0480, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.48% (3.9322 => 4.1083, std.dev.: 0.0547) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (0.4680 => 0.4800, std.dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0458) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 6.33% (0.3160 => 0.3360, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0390) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0236) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0167) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0360) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0126) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0423) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0136) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0337) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.83% (5.8000 => 5.9640, std.dev.: 0.0509) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0519) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0500) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0332) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0368) MultiSource/Benchmarks/Bullet/bullet: 2.12% (37.0925 => 37.8805, std.dev.: 0.0796) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.95% (48.1088 => 49.0449, std.dev.: 0.1092) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 1.23% (18.8170 => 19.0490, std.dev.: 0.0403) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0165) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0375) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.89% (0.9321 => 1.1921, std.dev.: 0.0182) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0610) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0278) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0287) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/whetstone: -20.83% (0.0960 => 0.0760, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 17:48:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 19:48:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140411004809.816D32A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24525?compare_to=24514&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24525, Order: 205984, Start Time: 2014-04-10 20:03:40, End Time: 2014-04-11 00:54:31 To: 24514, Order: 205967, Start Time: 2014-04-10 15:06:02, End Time: 2014-04-10 19:56:50 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 12 (131 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 200.00% (0.0080 => 0.0240, std.dev.: 0.0054) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/shr: 42.86% (0.0280 => 0.0400, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 12.50% (0.1920 => 0.2160, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (2.1280 => 2.1760, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (6.6760 => 6.7880, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.29% (2.1761 => 2.2041, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.20% (17.6723 => 19.6524, std.dev.: 0.0546) MultiSource/Applications/sqlite3/sqlite3: 1420.48% (1.7001 => 25.8496, std.dev.: 0.0409) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.61% (50.1010 => 51.9090, std.dev.: 0.1093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (11.3920 => 12.2680, std.dev.: 0.0874) SingleSource/Benchmarks/Misc/oourafft: 175.10% (11.3407 => 31.1979, std.dev.: 0.1023) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0323, std.dev.: 0.0196) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0126) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0117) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/shr: 100.00% (0.0200 => 0.0400, std.dev.: 0.0018) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/UnitTests/Vector/sumarray-dbl: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: 45.45% (0.0440 => 0.0640, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.1280 => 0.1560, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.07% (1.8201 => 2.0761, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.59% (1.9721 => 2.2401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4122, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.47% (1.8601 => 2.0921, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.13% (1.9761 => 2.1961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.06% (1.7721 => 1.9681, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.64% (2.0681 => 2.2881, std.dev.: 0.0101) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.55% (1.8201 => 2.0121, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.27% (2.1041 => 2.3201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.75% (2.0521 => 2.2521, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0054) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 8.13% (0.4920 => 0.5320, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (6.4800 => 6.8880, std.dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.68% (0.7040 => 0.7440, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0203) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.1320 => 1.1920, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0170) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0175) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (5.8281 => 6.0801, std.dev.: 0.0292) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (9.6042 => 10.0002, std.dev.: 0.0415) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.7480 => 1.8160, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (6.5360 => 6.7880, std.dev.: 0.0213) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (10.2283 => 10.6164, std.dev.: 0.0348) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 3.42% (4.7920 => 4.9560, std.dev.: 0.0300) MultiSource/Applications/treecc/treecc: 3.25% (2.5880 => 2.6720, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (16.3003 => 16.7723, std.dev.: 0.0654) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.3960 => 5.5440, std.dev.: 0.0414) MultiSource/Applications/SPASS/SPASS: 2.68% (18.5284 => 19.0245, std.dev.: 0.0470) MultiSource/Applications/oggenc/oggenc: 2.67% (7.0524 => 7.2405, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.63% (6.5320 => 6.7040, std.dev.: 0.0650) MultiSource/Benchmarks/Bullet/bullet: 2.58% (38.6366 => 39.6326, std.dev.: 0.0923) MultiSource/Applications/JM/lencod/lencod: 2.50% (22.2206 => 22.7767, std.dev.: 0.0738) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (2.1240 => 2.1760, std.dev.: 0.0165) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0195) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (3.0562 => 3.1042, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 1.43% (19.8291 => 20.1131, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (4.2243 => 4.2843, std.dev.: 0.0120) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7842 => 2.8122, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.99% (2.1201 => 2.4802, std.dev.: 0.0393) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.94% (6.5964 => 6.7244, std.dev.: 0.0418) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.50% (3.7442 => 3.8002, std.dev.: 0.0201) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (3.9442 => 3.9962, std.dev.: 0.0183) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.50% (10.4007 => 2.0281, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.32% (2.9562 => 0.7000, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: -6.18% (1.8760 => 1.7600, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.88% (94.8339 => 49.4231, std.dev.: 10.5787) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.08% (49.9431 => 32.9221, std.dev.: 0.2208) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.67% (25.7136 => 17.0571, std.dev.: 0.1399) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.53% (37.0863 => 28.7298, std.dev.: 0.3821) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: -1.19% (2.3521 => 2.3241, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0151) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 17:48:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 19:48:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140411004841.043A82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24526?compare_to=24515&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24526, Order: 205984, Start Time: 2014-04-10 20:04:28, End Time: 2014-04-11 00:55:04 To: 24515, Order: 205967, Start Time: 2014-04-10 15:07:40, End Time: 2014-04-10 19:57:51 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (147 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 14.29% (0.0840 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2200 => 0.2360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.24% (0.7400 => 0.7640, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.16% (0.3800 => 0.3920, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.99% (1.4041 => 1.4321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.78% (1.3521 => 1.3761, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.77% (7.0160 => 7.1400, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.60% (1.5041 => 1.5281, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (1.5561 => 1.5761, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 26.09% (0.0920 => 0.1160, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1962.50% (0.0320 => 0.6600, std.dev.: 0.0123) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0072) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 757.89% (0.0760 => 0.6520, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 398.45% (0.2520 => 1.2561, std.dev.: 0.0123) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 281.08% (0.2320 => 0.8841, std.dev.: 0.0064) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0054) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0100) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0041) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0050) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 34.62% (0.1040 => 0.1400, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: 21.26% (1.3920 => 1.6880, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.12% (1.1361 => 1.3761, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.41% (1.1561 => 1.3921, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.05% (1.1761 => 1.4001, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 18.51% (8.5802 => 10.1683, std.dev.: 0.0460) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.18% (0.0880 => 0.1040, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 15.52% (19.5406 => 22.5727, std.dev.: 0.0486) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.17% (5.3360 => 6.0921, std.dev.: 0.0342) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.66% (0.3160 => 0.3560, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.6800 => 0.7640, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 9.17% (11.3843 => 12.4283, std.dev.: 0.0425) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.73% (5.7280 => 6.2280, std.dev.: 0.0254) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 8.59% (6.2844 => 6.8244, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.6680 => 6.1480, std.dev.: 0.0328) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (11.4440 => 12.3640, std.dev.: 0.0657) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (9.5802 => 10.2322, std.dev.: 0.0562) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0224) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.4760 => 1.5440, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (6.8280 => 7.1400, std.dev.: 0.0230) MultiSource/Applications/lua/lua: 4.27% (4.7720 => 4.9760, std.dev.: 0.0479) MultiSource/Applications/spiff/spiff: 4.20% (1.0480 => 1.0920, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0231) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.43% (49.1529 => 50.8409, std.dev.: 0.0843) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.7600 => 1.8160, std.dev.: 0.0150) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: 2.75% (19.2243 => 19.7524, std.dev.: 0.0644) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 2.47% (24.7575 => 25.3695, std.dev.: 0.0549) MultiSource/Benchmarks/Bullet/bullet: 1.98% (39.0726 => 39.8446, std.dev.: 0.0704) MultiSource/Applications/kimwitu++/kc: 1.62% (19.7491 => 20.0691, std.dev.: 0.0415) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (6.0124 => 6.0804, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (16.7083 => 16.8963, std.dev.: 0.0341) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0703) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0312) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0233) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.0563 => 4.1643, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0146) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.60% (11.0207 => 2.0281, std.dev.: 0.0075) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.60% (5.2763 => 4.9283, std.dev.: 0.0877) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -1.84% (4.9963 => 4.9043, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.0963 => 5.0403, std.dev.: 0.0207) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 18:58:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 20:58:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411015802.B4A7E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24527?compare_to=24524&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24527, Order: 205986, Start Time: 2014-04-10 21:18:49, End Time: 2014-04-11 02:04:26 To: 24524, Order: 205984, Start Time: 2014-04-10 20:06:21, End Time: 2014-04-11 00:48:38 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (94 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (1002 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray-dbl: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 21.05% (0.0760 => 0.0920, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 18.75% (0.0640 => 0.0760, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (1.1360 => 1.1560, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 12.73% (0.2200 => 0.2480, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0065) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.39% (1.1361 => 1.2201, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0767) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0506) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0369) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0142) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.49% (1.3760 => 1.4240, std.dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0228) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (10.4082 => 10.7242, std.dev.: 0.0304) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0300) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8726, std.dev.: 0.0610) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0379) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.95% (48.1088 => 49.0490, std.dev.: 0.0613) MultiSource/Applications/sqlite3/sqlite3: 1.77% (23.7574 => 24.1775, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 1.19% (18.8170 => 19.0410, std.dev.: 0.0486) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 4.99% (6.6564 => 6.9884, std.dev.: 0.0370) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0124) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.12% (21.1533 => 21.3893, std.dev.: 0.0824) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0320) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 20:27:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 22:27:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411032738.F3B902A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24528?compare_to=24527&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24528, Order: 205994, Start Time: 2014-04-10 22:54:41, End Time: 2014-04-11 03:34:01 To: 24527, Order: 205986, Start Time: 2014-04-10 21:18:49, End Time: 2014-04-11 02:04:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (98 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.00% (0.3000 => 0.3120, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.6640 => 0.6840, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.29% (1.2361 => 1.2521, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.45% (1.3801 => 1.4001, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/flops-5: -36.36% (0.0440 => 0.0280, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0073) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.55% (1.2721 => 1.3681, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0718) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0466) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.9880 => 1.0320, std.dev.: 0.0154) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0154) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0273) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (5.8000 => 5.9720, std.dev.: 0.0428) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0410) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0415) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 2.16% (23.7574 => 24.2695, std.dev.: 0.0308) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8206, std.dev.: 0.1167) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.70% (48.1088 => 48.9290, std.dev.: 0.1139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 1.15% (18.8170 => 19.0330, std.dev.: 0.0371) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0386) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0124) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0067) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0168) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (4.0643 => 4.1123, std.dev.: 0.0172) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -9.09% (0.1760 => 0.1600, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.26% (0.5320 => 0.5040, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 21:18:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Apr 2014 23:18:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411041833.2ABD32A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24529?compare_to=24528&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24529, Order: 205996, Start Time: 2014-04-10 23:41:34, End Time: 2014-04-11 04:24:58 To: 24528, Order: 205994, Start Time: 2014-04-10 22:54:41, End Time: 2014-04-11 03:34:01 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (86 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (1009 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2007-03-02-VaCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.20% (0.1640 => 0.1840, std.dev.: 0.0051) SingleSource/Benchmarks/SmallPT/smallpt: 8.82% (0.1360 => 0.1480, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.45% (0.2200 => 0.2320, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5040 => 0.5280, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.7160 => 0.7360, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.26% (1.2401 => 1.2681, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.48% (5.9480 => 6.0360, std.dev.: 0.0283) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0035) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0143) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0525) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0425) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2320 => 0.2440, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0276) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0261) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (8.1441 => 8.4241, std.dev.: 0.0517) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0283) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9126, std.dev.: 0.0629) MultiSource/Applications/sqlite3/sqlite3: 2.14% (23.7574 => 24.2655, std.dev.: 0.0433) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0297) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.62% (48.1088 => 48.8890, std.dev.: 0.1324) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0473) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/strcat: 9.38% (0.1280 => 0.1400, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0419) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0310) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0290) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (1.3481 => 1.3321, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 22:02:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 00:02:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411050235.20CDD2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24530?compare_to=24529&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24530, Order: 206002, Start Time: 2014-04-11 00:27:30, End Time: 2014-04-11 05:08:58 To: 24529, Order: 205996, Start Time: 2014-04-10 23:41:34, End Time: 2014-04-11 04:24:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (95 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.39% (0.0920 => 0.1080, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 15.79% (0.1520 => 0.1760, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.04% (0.2840 => 0.3040, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.13% (0.3120 => 0.3280, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 5.00% (0.3200 => 0.3360, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (5.0000 => 5.1080, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.94% (1.2401 => 1.2641, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.81% (1.3281 => 1.3521, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 4.94% (0.9721 => 1.0201, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.86% (1.6801 => 1.7281, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 18.92% (0.1480 => 0.1760, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0478) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.94% (1.2801 => 1.3561, std.dev.: 0.0180) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0432) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0176) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0500) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0391) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0256) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0372) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0211) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0469) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0412) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0110) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.24% (48.1088 => 49.1849, std.dev.: 0.0682) MultiSource/Benchmarks/Bullet/bullet: 2.23% (37.0925 => 37.9206, std.dev.: 0.0704) MultiSource/Applications/sqlite3/sqlite3: 2.17% (23.7574 => 24.2735, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1251, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0117) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0404) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0517) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0092) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.68% (5.8164 => 5.9724, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 2.07% (5.0123 => 5.1163, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0042) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0587) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0067) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0247) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 22:32:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 00:32:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411053250.180652A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24531?compare_to=24521&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24531, Order: 206003, Start Time: 2014-04-11 00:52:17, End Time: 2014-04-11 05:39:15 To: 24521, Order: 205981, Start Time: 2014-04-10 19:33:59, End Time: 2014-04-11 00:21:33 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1101 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-07-17-INT-To-FP: 400.00% (0.0040 => 0.0200, std.dev.: 0.0054) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Towers: 33.33% (0.0480 => 0.0640, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 12.12% (0.1320 => 0.1480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.41% (0.3240 => 0.3480, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.37% (1.7481 => 1.7721, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 15.38% (0.1040 => 0.1200, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.73% (0.7280 => 0.5480, std.dev.: 0.0136) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 22:37:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 00:37:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411053713.45D912A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24532?compare_to=24522&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24532, Order: 206003, Start Time: 2014-04-11 00:55:55, End Time: 2014-04-11 05:43:40 To: 24522, Order: 205981, Start Time: 2014-04-10 19:37:36, End Time: 2014-04-11 00:25:35 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 4 (132 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1107 (953 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.19% (0.4520 => 0.4800, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -2.84% (1.8280 => 1.7760, std.dev.: 0.0200) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.52% (11.3687 => 31.2099, std.dev.: 0.0714) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0074) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0117) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0051) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.3640 => 0.4160, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.21% (0.4240 => 0.4800, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0132) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.43% (0.3320 => 0.3600, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.09% (1.4841 => 1.6041, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.83% (1.7361 => 1.8721, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.75% (1.5481 => 1.6681, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.39% (0.7040 => 0.7560, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0160) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0122) MultiSource/Applications/spiff/spiff: 6.35% (1.0080 => 1.0720, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (11.6440 => 12.3760, std.dev.: 0.0558) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.97% (0.2680 => 0.2840, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (6.4680 => 6.8480, std.dev.: 0.0600) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.08% (0.2360 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.7400 => 1.8280, std.dev.: 0.0219) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.98% (9.4842 => 9.9562, std.dev.: 0.0533) MultiSource/Applications/Burg/burg: 4.77% (1.5080 => 1.5800, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.4640 => 1.5280, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.20% (5.8121 => 6.0561, std.dev.: 0.0518) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.0443 => 10.4523, std.dev.: 0.0436) MultiSource/Applications/JM/lencod/lencod: 3.88% (21.9606 => 22.8128, std.dev.: 0.0594) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.85% (1.5600 => 1.6200, std.dev.: 0.0194) MultiSource/Applications/lua/lua: 3.84% (4.7880 => 4.9720, std.dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0075) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.63% (50.0290 => 51.8450, std.dev.: 0.0454) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (6.5440 => 6.7760, std.dev.: 0.0505) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (5.3600 => 5.5360, std.dev.: 0.0635) MultiSource/Applications/hbd/hbd: 3.23% (1.7360 => 1.7920, std.dev.: 0.0142) MultiSource/Applications/oggenc/oggenc: 3.21% (6.9844 => 7.2085, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.20% (6.5080 => 6.7160, std.dev.: 0.0533) MultiSource/Benchmarks/Bullet/bullet: 2.91% (38.4046 => 39.5206, std.dev.: 0.0755) MultiSource/Applications/SPASS/SPASS: 2.86% (18.4404 => 18.9686, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (3.0282 => 3.1122, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (4.1843 => 4.3003, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.65% (1.6601 => 1.7041, std.dev.: 0.0147) MultiSource/Applications/ClamAV/clamscan: 2.50% (19.0444 => 19.5204, std.dev.: 0.0733) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (16.3483 => 16.7403, std.dev.: 0.0533) MultiSource/Applications/d/make_dparser: 2.22% (3.9681 => 4.0561, std.dev.: 0.0192) MultiSource/Applications/siod/siod: 2.21% (2.7162 => 2.7762, std.dev.: 0.0166) MultiSource/Applications/kimwitu++/kc: 1.93% (19.6891 => 20.0691, std.dev.: 0.0310) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.14% (2.1401 => 2.4642, std.dev.: 0.0695) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0291) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.81% (4.5603 => 4.6883, std.dev.: 0.0035) MultiSource/Applications/obsequi/Obsequi: 2.53% (2.0521 => 2.1041, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.81% (3.9922 => 4.0643, std.dev.: 0.0156) MultiSource/Applications/minisat/minisat: 1.56% (6.6684 => 6.7724, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.31% (3.9842 => 4.0363, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -77.04% (2.9442 => 0.6760, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0099) MultiSource/Applications/obsequi/Obsequi: -7.49% (1.8680 => 1.7280, std.dev.: 0.0289) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.16% (91.8497 => 49.4511, std.dev.: 10.0926) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.47% (50.3031 => 32.9661, std.dev.: 0.1994) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.24% (26.0616 => 17.1371, std.dev.: 0.1409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.24% (42.1466 => 28.5578, std.dev.: 0.4760) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1135) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: -1.36% (2.3561 => 2.3241, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0138) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 22:54:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 00:54:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411055420.478CB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24533?compare_to=24530&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24533, Order: 206007, Start Time: 2014-04-11 01:19:27, End Time: 2014-04-11 06:00:44 To: 24530, Order: 206002, Start Time: 2014-04-11 00:27:30, End Time: 2014-04-11 05:08:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (98 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2005-11-29-LongSwitch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/mandel-text: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.00% (0.0800 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0098) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.82% (0.1360 => 0.1480, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/09-vor/vor: 6.59% (0.3640 => 0.3880, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.74% (0.4280 => 0.4440, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.75% (0.4360 => 0.4480, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.1480 => 1.1720, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.00% (0.1000 => 0.1200, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 1.22% (1.3161 => 1.3321, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -3.21% (2.4960 => 2.4160, std.dev.: 0.0286) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.87% (0.3680 => 0.4080, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/chomp: 8.77% (0.2280 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0592) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.49% (1.2321 => 1.3121, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0224) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0356) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0183) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (10.4082 => 10.7242, std.dev.: 0.0346) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.75% (0.4360 => 0.4480, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 2.65% (4.5200 => 4.6400, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0417) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (4.9200 => 5.0440, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0309) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0256) MultiSource/Benchmarks/Bullet/bullet: 1.90% (37.0925 => 37.7965, std.dev.: 0.0901) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0507) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.80% (48.1088 => 48.9730, std.dev.: 0.0967) MultiSource/Applications/kimwitu++/kc: 1.59% (18.8170 => 19.1171, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0127) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: 3.29% (2.0681 => 2.1361, std.dev.: 0.0142) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.02% (21.1533 => 21.3693, std.dev.: 0.0814) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/pi: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3361 => 2.3081, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 22:55:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 00:55:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140411055546.6305C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24534?compare_to=24523&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24534, Order: 206007, Start Time: 2014-04-11 01:12:17, End Time: 2014-04-11 06:02:11 To: 24523, Order: 205984, Start Time: 2014-04-10 19:54:20, End Time: 2014-04-11 00:44:41 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (128 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.49% (0.3560 => 0.3720, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.25% (0.6160 => 0.6360, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.89% (1.0561 => 1.0761, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.25% (2.2321 => 2.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.20% (2.0081 => 2.0321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.18% (2.0321 => 2.0561, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.52% (0.1840 => 0.1960, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 4.54% (0.9681 => 1.0121, std.dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.08% (16.9883 => 16.8043, std.dev.: 0.0478) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0090) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.80% (1.6881 => 2.0561, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.28% (1.6921 => 2.0521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.11% (1.8001 => 2.1801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.04% (1.6921 => 2.0481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.42% (1.7241 => 2.0761, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.13% (1.8881 => 2.2681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.30% (1.8361 => 2.1721, std.dev.: 0.0132) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.03% (0.6120 => 0.7040, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.86% (0.2360 => 0.2640, std.dev.: 0.0105) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.7200 => 7.1400, std.dev.: 0.0255) MultiSource/Benchmarks/McCat/09-vor/vor: 6.12% (0.3920 => 0.4160, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (11.7880 => 12.5040, std.dev.: 0.0841) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.5240 => 1.6080, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0302) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.84% (0.9920 => 1.0400, std.dev.: 0.0178) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0139) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (9.9842 => 10.3962, std.dev.: 0.0615) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.13% (1.6481 => 1.7161, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.86% (1.0361 => 1.0761, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0369) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (6.8321 => 7.0761, std.dev.: 0.0232) MultiSource/Applications/d/make_dparser: 3.43% (3.9641 => 4.1001, std.dev.: 0.0217) MultiSource/Applications/oggenc/oggenc: 3.41% (6.9124 => 7.1484, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (2.0680 => 2.1360, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0088) MultiSource/Applications/treecc/treecc: 3.05% (2.6200 => 2.7000, std.dev.: 0.0197) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (10.3203 => 10.6244, std.dev.: 0.0363) MultiSource/Applications/SPASS/SPASS: 2.86% (18.4924 => 19.0205, std.dev.: 0.0395) MultiSource/Applications/JM/lencod/lencod: 2.70% (22.6287 => 23.2407, std.dev.: 0.0509) MultiSource/Applications/minisat/minisat: 2.34% (0.8560 => 0.8760, std.dev.: 0.0072) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.21% (51.1089 => 52.2409, std.dev.: 0.1338) MultiSource/Benchmarks/Bullet/bullet: 2.09% (38.9366 => 39.7486, std.dev.: 0.0607) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 1.88% (20.2445 => 20.6245, std.dev.: 0.0767) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.73% (3.0122 => 3.0642, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 1.66% (19.7371 => 20.0651, std.dev.: 0.0589) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0244 => 6.1004, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.25% (16.5963 => 16.8043, std.dev.: 0.0478) MultiSource/Applications/sqlite3/sqlite3: 1.05% (25.1895 => 25.4535, std.dev.: 0.0620) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0125) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.39% (1.6521 => 1.7081, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9604 => 6.0644, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 1.57% (21.6534 => 21.9934, std.dev.: 0.0562) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.43% (4.7563 => 4.8243, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/nestedloop: -65.18% (2.9642 => 1.0321, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0084) MultiSource/Applications/obsequi/Obsequi: -34.75% (2.6481 => 1.7280, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout/matrix: -31.25% (0.1280 => 0.0880, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.06% (7.4801 => 6.2040, std.dev.: 0.0369) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.47% (7.5041 => 6.2680, std.dev.: 0.0353) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -3.11% (13.5243 => 13.1043, std.dev.: 0.0486) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (0.9281 => 0.8561, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0186) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: -1.41% (11.6527 => 11.4887, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.25% (3.8442 => 3.7962, std.dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 23:08:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 01:08:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140411060811.3D2CA2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24535?compare_to=24526&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24535, Order: 206008, Start Time: 2014-04-11 01:24:52, End Time: 2014-04-11 06:14:36 To: 24526, Order: 205984, Start Time: 2014-04-10 20:04:28, End Time: 2014-04-11 00:55:04 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (143 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-09-18-BitFieldTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.75% (0.0640 => 0.0760, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.80% (0.3160 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.31% (1.0880 => 1.1240, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.46% (1.3681 => 1.3881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.46% (1.3721 => 1.3921, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0086) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0078) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 395.28% (0.2520 => 1.2481, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: 274.18% (0.2320 => 0.8681, std.dev.: 0.0128) SingleSource/UnitTests/Vector/multiplies: 228.57% (0.0280 => 0.0920, std.dev.: 0.0103) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0081) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0058) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0040) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0044) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0053) SingleSource/Regression/C/bigstack: 46.15% (0.0520 => 0.0760, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0074) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/five11/five11: 26.67% (0.0600 => 0.0760, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 22.22% (0.1080 => 0.1320, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.91% (1.1321 => 1.3801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.16% (1.1721 => 1.4201, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0092) MultiSource/Applications/obsequi/Obsequi: 20.98% (1.3920 => 1.6840, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.80% (1.2321 => 1.4761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.75% (0.0640 => 0.0760, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.43% (1.1721 => 1.3881, std.dev.: 0.0137) MultiSource/Applications/JM/ldecod/ldecod: 18.37% (8.5802 => 10.1563, std.dev.: 0.0352) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.18% (1.3841 => 1.6081, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/bh/bh: 15.96% (0.3760 => 0.4360, std.dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 15.52% (19.5406 => 22.5727, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.39% (5.3360 => 6.1041, std.dev.: 0.0314) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.66% (0.3160 => 0.3560, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.26% (0.6480 => 0.7080, std.dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (11.3843 => 12.4043, std.dev.: 0.0413) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.6680 => 6.1480, std.dev.: 0.0496) MultiSource/Applications/oggenc/oggenc: 8.21% (6.2844 => 6.8004, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.82% (5.7280 => 6.1760, std.dev.: 0.0501) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (11.4440 => 12.3080, std.dev.: 0.0763) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (9.5802 => 10.2282, std.dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0109) MultiSource/Applications/spiff/spiff: 4.96% (1.0480 => 1.1000, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 4.11% (4.7720 => 4.9680, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (1.0680 => 1.1040, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (6.8280 => 7.0520, std.dev.: 0.0614) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3840 => 5.5560, std.dev.: 0.0228) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0179) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.95% (49.1529 => 50.6009, std.dev.: 0.0899) MultiSource/Applications/minisat/minisat: 2.87% (0.8360 => 0.8600, std.dev.: 0.0088) MultiSource/Applications/ClamAV/clamscan: 2.58% (19.2243 => 19.7204, std.dev.: 0.0708) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 2.26% (24.7575 => 25.3175, std.dev.: 0.0524) MultiSource/Applications/kimwitu++/kc: 1.64% (19.7491 => 20.0731, std.dev.: 0.0343) MultiSource/Benchmarks/Bullet/bullet: 1.42% (39.0726 => 39.6286, std.dev.: 0.0866) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.00% (0.3000 => 0.3360, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.53% (3.9842 => 4.2843, std.dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0511) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.60% (3.2362 => 3.3202, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0307) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4001 => 1.4161, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0112) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: -13.91% (0.6040 => 0.5200, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0898) MultiSource/Applications/siod/siod: -6.17% (2.9842 => 2.8002, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.04% (4.1243 => 4.0403, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -1.92% (4.9963 => 4.9003, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.0963 => 5.0323, std.dev.: 0.0222) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (2.3401 => 2.3161, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 10 23:08:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 01:08:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140411060858.330CF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24536?compare_to=24525&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24536, Order: 206008, Start Time: 2014-04-11 01:24:38, End Time: 2014-04-11 06:15:26 To: 24525, Order: 205984, Start Time: 2014-04-10 20:03:40, End Time: 2014-04-11 00:54:31 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 9 (115 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (965 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.07% (0.2320 => 0.2600, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.49% (2.0921 => 2.1441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.60% (2.2521 => 2.2881, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.14% (12.2680 => 12.4080, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.03% (2.3201 => 2.3441, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 10.77% (0.2600 => 0.2880, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.77% (17.6723 => 19.5762, std.dev.: 0.0565) MultiSource/Applications/sqlite3/sqlite3: 1412.71% (1.7001 => 25.7176, std.dev.: 0.0457) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.28% (50.1010 => 51.7450, std.dev.: 0.0956) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (1.0520 => 1.0640, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.92% (11.3920 => 12.4080, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/oourafft: 174.85% (11.3407 => 31.1699, std.dev.: 0.0793) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0483, std.dev.: 0.0225) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0093) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0132) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 50.00% (0.0320 => 0.0480, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Quicksort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 26.09% (0.0920 => 0.1160, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.00% (0.0800 => 0.1000, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.90% (1.9601 => 2.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0134) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.4160 => 0.4760, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.02% (1.9121 => 2.1801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.95% (0.1720 => 0.1960, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.06% (2.1441 => 2.4242, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.82% (0.1560 => 0.1760, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.50% (2.0521 => 2.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (6.4800 => 6.9160, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.93% (2.9721 => 3.1482, std.dev.: 0.0127) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.68% (0.7040 => 0.7440, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.26% (1.7480 => 1.8400, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0149) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.81% (1.6641 => 1.7441, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (5.8281 => 6.1041, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.6960 => 1.7760, std.dev.: 0.0225) MultiSource/Benchmarks/McCat/18-imp/imp: 4.55% (0.4400 => 0.4600, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (10.2283 => 10.6444, std.dev.: 0.0277) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.81% (1.5760 => 1.6360, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (6.5320 => 6.7720, std.dev.: 0.0350) MultiSource/Applications/lua/lua: 3.67% (4.7920 => 4.9680, std.dev.: 0.0262) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.67% (9.6042 => 9.9562, std.dev.: 0.0454) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.2206 => 22.8088, std.dev.: 0.0546) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.58% (16.3003 => 16.7203, std.dev.: 0.0613) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.3960 => 5.5320, std.dev.: 0.0438) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.51% (6.5360 => 6.7000, std.dev.: 0.0583) MultiSource/Benchmarks/Bullet/bullet: 2.46% (38.6366 => 39.5886, std.dev.: 0.0834) MultiSource/Applications/oggenc/oggenc: 2.38% (7.0524 => 7.2205, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0136) MultiSource/Applications/SPASS/SPASS: 2.01% (18.5284 => 18.9006, std.dev.: 0.0603) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.88% (2.3401 => 2.3841, std.dev.: 0.0153) MultiSource/Applications/d/make_dparser: 1.81% (3.9761 => 4.0481, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2243 => 4.2923, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: 1.09% (19.8291 => 20.0451, std.dev.: 0.0354) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0325) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 2.24% (6.5964 => 6.7444, std.dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0020) MultiSource/Applications/obsequi/Obsequi: 1.96% (2.0441 => 2.0841, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9684 => 6.0644, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.19% (2.9562 => 0.7040, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: -5.12% (1.8760 => 1.7800, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.08% (94.8339 => 49.2391, std.dev.: 9.6930) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.13% (49.9431 => 32.8981, std.dev.: 0.1579) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.57% (25.7136 => 17.0811, std.dev.: 0.1489) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.78% (37.0863 => 28.6378, std.dev.: 0.6657) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 00:12:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 02:12:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411071259.3869F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24537?compare_to=24533&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24537, Order: 206016, Start Time: 2014-04-11 02:33:16, End Time: 2014-04-11 07:19:23 To: 24533, Order: 206007, Start Time: 2014-04-11 01:19:27, End Time: 2014-04-11 06:00:44 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (104 on baseline) Performance Improvements: 2 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: 33.33% (0.0360 => 0.0480, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.4080 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/neural/neural: 6.38% (0.1880 => 0.2000, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 4.14% (2.4160 => 2.5160, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.13% (1.3121 => 1.3401, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 2.07% (4.6400 => 4.7360, std.dev.: 0.0291) SingleSource/UnitTests/Vector/constpool: 1.20% (2.0081 => 2.0321, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (10.7242 => 10.8362, std.dev.: 0.0256) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 22.73% (0.0880 => 0.1080, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/matrixTranspose: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.36% (3.5402 => 3.4922, std.dev.: 0.0166) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: 50.00% (0.0320 => 0.0480, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0069) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0645) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0556) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.05% (1.1921 => 1.2761, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.60% (1.2121 => 1.2921, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (1.7360 => 1.8240, std.dev.: 0.0205) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.71% (0.7640 => 0.8000, std.dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (10.4082 => 10.8362, std.dev.: 0.0256) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0451) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0429) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: 2.97% (17.6165 => 18.1405, std.dev.: 0.0408) MultiSource/Applications/treecc/treecc: 2.78% (2.4480 => 2.5160, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0453) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.54% (48.1088 => 49.3289, std.dev.: 0.0863) MultiSource/Benchmarks/Bullet/bullet: 2.26% (37.0925 => 37.9326, std.dev.: 0.0875) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0301) MultiSource/Applications/sqlite3/sqlite3: 2.12% (23.7574 => 24.2615, std.dev.: 0.0391) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: 1.48% (17.5484 => 17.8084, std.dev.: 0.0421) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 4.39% (6.6564 => 6.9484, std.dev.: 0.0432) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0125) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0200) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0324) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: -1.69% (3.5522 => 3.4922, std.dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 02:19:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 04:19:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411091928.608F12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24538?compare_to=24537&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24538, Order: 206017, Start Time: 2014-04-11 04:46:03, End Time: 2014-04-11 09:25:51 To: 24537, Order: 206016, Start Time: 2014-04-11 02:33:16, End Time: 2014-04-11 07:19:23 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (97 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.12% (0.6400 => 0.6920, std.dev.: 0.0164) MultiSource/Applications/hbd/hbd: 4.36% (1.6520 => 1.7240, std.dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.23% (1.4360 => 1.4680, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.86% (1.2921 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5962 => 2.6322, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 1.60% (3.4922 => 3.5482, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 1.03% (3.5082 => 3.5442, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0075) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.89% (1.2161 => 1.3121, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0683) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0414) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0282) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0453) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0429) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0199) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0472) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0382) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0062) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.59% (48.1088 => 49.3530, std.dev.: 0.1016) MultiSource/Applications/treecc/treecc: 2.45% (2.4480 => 2.5080, std.dev.: 0.0152) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0171) MultiSource/Benchmarks/Bullet/bullet: 2.28% (37.0925 => 37.9366, std.dev.: 0.0895) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0151) MultiSource/Applications/sqlite3/sqlite3: 2.26% (23.7574 => 24.2935, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 1.96% (18.8170 => 19.1851, std.dev.: 0.0662) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.4400 => 1.4680, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0119) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0659) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0114) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0285) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.24% (10.8967 => 2.0441, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 03:31:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 05:31:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411103100.4C02E2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24539?compare_to=24531&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24539, Order: 206017, Start Time: 2014-04-11 05:49:47, End Time: 2014-04-11 10:37:22 To: 24531, Order: 206003, Start Time: 2014-04-11 00:52:17, End Time: 2014-04-11 05:39:15 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Regression/C/sumarray: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.51% (0.1880 => 0.2040, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4480 => 0.4680, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: 3.85% (1.7680 => 1.8360, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: 2.03% (1.7720 => 1.8080, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.56% (1.0241 => 1.0401, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: 200.00% (0.0080 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.82% (0.9921 => 1.0201, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: 1.85% (1.3001 => 1.3241, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 03:41:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 05:41:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411104129.25D312A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24540?compare_to=24532&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24540, Order: 206017, Start Time: 2014-04-11 05:59:53, End Time: 2014-04-11 10:47:55 To: 24532, Order: 206003, Start Time: 2014-04-11 00:55:55, End Time: 2014-04-11 05:43:40 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (146 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0080 => 0.0240, std.dev.: 0.0022) SingleSource/UnitTests/2005-05-13-SDivTwo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.81% (0.1080 => 0.1240, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.61% (0.2640 => 0.2920, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.00% (0.2400 => 0.2640, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 9.09% (0.2200 => 0.2400, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 7.96% (0.4520 => 0.4880, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4440 => 0.4720, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 5.08% (0.2360 => 0.2480, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.64% (1.7041 => 1.7321, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: 1.39% (2.0121 => 2.0401, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.90% (1.3161 => 1.4201, std.dev.: 0.0310) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.46% (11.3687 => 31.2020, std.dev.: 0.1127) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0141) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0111) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0065) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0101) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 20.45% (0.1760 => 0.2120, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.23% (0.1040 => 0.1240, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.87% (0.2520 => 0.2920, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.62% (1.0240 => 1.1840, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0137) SingleSource/Regression/C/bigstack: 10.87% (0.1840 => 0.2040, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.84% (0.3320 => 0.3680, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.11% (1.4241 => 1.5681, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.62% (1.4841 => 1.6121, std.dev.: 0.0146) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.4961 => 1.6241, std.dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (1.1640 => 1.2560, std.dev.: 0.0271) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.59% (1.5281 => 1.6441, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.43% (1.7761 => 1.9081, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (0.2240 => 0.2400, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4440 => 0.4720, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (11.6440 => 12.3760, std.dev.: 0.0631) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (6.4680 => 6.8480, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.82% (9.4842 => 10.0362, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0119) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (1.7401 => 1.8361, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.03% (0.7960 => 0.8360, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0180) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0195) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.0443 => 10.4843, std.dev.: 0.0302) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.7400 => 1.8160, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.36% (6.5080 => 6.7920, std.dev.: 0.0549) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 4.34% (21.9606 => 22.9128, std.dev.: 0.0637) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (6.5440 => 6.8080, std.dev.: 0.0532) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.00% (50.0290 => 52.0290, std.dev.: 0.0894) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 3.31% (38.4046 => 39.6766, std.dev.: 0.0646) MultiSource/Applications/hbd/hbd: 3.23% (1.7360 => 1.7920, std.dev.: 0.0187) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.23% (0.6200 => 0.6400, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (5.3600 => 5.5320, std.dev.: 0.0558) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 3.15% (6.9844 => 7.2044, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 3.06% (18.4404 => 19.0046, std.dev.: 0.0407) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (16.3483 => 16.8363, std.dev.: 0.0653) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (3.0282 => 3.1122, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (4.1843 => 4.2923, std.dev.: 0.0112) MultiSource/Applications/lua/lua: 2.51% (4.7880 => 4.9080, std.dev.: 0.0462) MultiSource/Applications/siod/siod: 2.50% (2.7162 => 2.7842, std.dev.: 0.0172) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0226) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 2.29% (19.0444 => 19.4804, std.dev.: 0.0650) MultiSource/Applications/kimwitu++/kc: 2.07% (19.6891 => 20.0971, std.dev.: 0.0562) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0563 => 13.1963, std.dev.: 0.0293) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.96% (2.1401 => 2.3961, std.dev.: 0.0502) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0287) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0209) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (3.9922 => 4.0603, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.80% (10.6247 => 2.0401, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.36% (2.9442 => 0.6960, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: -5.14% (1.8680 => 1.7720, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.25% (91.8497 => 49.3671, std.dev.: 10.2157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.77% (26.0616 => 17.0011, std.dev.: 0.1790) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.55% (50.3031 => 32.9221, std.dev.: 0.1974) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -33.02% (42.1466 => 28.2298, std.dev.: 0.5550) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1117) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0130) MultiSource/Benchmarks/sim/sim: -1.42% (4.7883 => 4.7203, std.dev.: 0.0122) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: -1.04% (4.2123 => 4.1683, std.dev.: 0.0136) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 04:00:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 06:00:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140411110037.1C4F12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24541?compare_to=24534&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24541, Order: 206017, Start Time: 2014-04-11 06:17:03, End Time: 2014-04-11 11:07:01 To: 24534, Order: 206007, Start Time: 2014-04-11 01:12:17, End Time: 2014-04-11 06:02:11 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (132 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/UnitTests/Vector/simple: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 13.33% (0.1800 => 0.2040, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 8.16% (0.1960 => 0.2120, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.2520 => 0.2680, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.31% (0.4520 => 0.4760, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 5.26% (0.3040 => 0.3200, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (1.7560 => 1.8120, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.63% (1.7161 => 1.7441, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7802 => 2.8122, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.07% (16.8043 => 16.9843, std.dev.: 0.0469) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4641 => 1.4801, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.49% (1.0761 => 1.0601, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0090) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.09% (1.7321 => 2.0801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.91% (1.7681 => 2.1201, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.86% (1.6721 => 2.0041, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.67% (1.6881 => 2.0201, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.66% (1.6681 => 1.9961, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.31% (1.7401 => 2.0761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.28% (1.6801 => 2.0041, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.20% (1.7921 => 2.1361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.07% (1.8041 => 2.1481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.03% (1.8081 => 2.1521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.62% (1.8041 => 2.1401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.90% (1.9641 => 2.2961, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0135) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: 8.24% (1.0200 => 1.1040, std.dev.: 0.0199) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3000 => 0.3200, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (11.7880 => 12.5640, std.dev.: 0.0773) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (6.7200 => 7.1560, std.dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.8601 => 0.9121, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.77% (1.5240 => 1.6120, std.dev.: 0.0256) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (1.7280 => 1.8240, std.dev.: 0.0217) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0121) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.04% (1.3480 => 1.4160, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (9.9842 => 10.4642, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0162) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.44% (0.7200 => 0.7520, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/18-imp/imp: 4.39% (0.4560 => 0.4760, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.1440 => 1.1920, std.dev.: 0.0114) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0320) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (2.0440 => 2.1240, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: 3.83% (3.9641 => 4.1161, std.dev.: 0.0233) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (6.8321 => 7.0561, std.dev.: 0.0532) MultiSource/Applications/SPASS/SPASS: 3.25% (18.4924 => 19.0925, std.dev.: 0.0501) MultiSource/Applications/oggenc/oggenc: 3.18% (6.9124 => 7.1324, std.dev.: 0.0242) MultiSource/Applications/JM/ldecod/ldecod: 3.18% (10.3203 => 10.6484, std.dev.: 0.0371) MultiSource/Applications/JM/lencod/lencod: 2.86% (22.6287 => 23.2768, std.dev.: 0.0588) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.68% (51.1089 => 52.4809, std.dev.: 0.1178) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (16.5963 => 16.9843, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 2.19% (19.7371 => 20.1691, std.dev.: 0.0493) MultiSource/Applications/ClamAV/clamscan: 2.17% (20.2445 => 20.6845, std.dev.: 0.0557) MultiSource/Benchmarks/Bullet/bullet: 2.08% (38.9366 => 39.7446, std.dev.: 0.0984) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0099) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0157) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0179) MultiSource/Applications/sqlite3/sqlite3: 1.48% (25.1895 => 25.5616, std.dev.: 0.0334) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (3.0122 => 3.0522, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.86% (0.9281 => 1.1681, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.93% (1.2681 => 1.4321, std.dev.: 0.0292) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.76% (1.0921 => 1.1441, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.02% (3.4842 => 3.6242, std.dev.: 0.0328) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0177) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0099) MultiSource/Applications/lua/lua: 1.57% (21.6534 => 21.9934, std.dev.: 0.0694) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (4.7563 => 4.8163, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0170) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.43% (6.2884 => 1.3561, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.33% (3.1762 => 1.2601, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: -33.39% (2.6481 => 1.7640, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.01% (7.4801 => 6.2080, std.dev.: 0.0525) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.73% (7.5041 => 6.3240, std.dev.: 0.0571) SingleSource/UnitTests/Vector/multiplies: -14.63% (0.1640 => 0.1400, std.dev.: 0.0058) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (13.5243 => 13.1243, std.dev.: 0.0252) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0050) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.19% (0.9281 => 0.8521, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -2.71% (5.1603 => 5.0203, std.dev.: 0.0244) MultiSource/Applications/viterbi/viterbi: -2.50% (2.7242 => 2.6562, std.dev.: 0.0241) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0558) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -1.52% (4.9883 => 4.9123, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.22% (2.6202 => 2.5882, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 04:11:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 06:11:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411111147.B4C052A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24542?compare_to=24538&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24542, Order: 206021, Start Time: 2014-04-11 06:36:39, End Time: 2014-04-11 11:18:12 To: 24538, Order: 206017, Start Time: 2014-04-11 04:46:03, End Time: 2014-04-11 09:25:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (110 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-07-VarArgs: 133.33% (0.0120 => 0.0280, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 4.88% (0.3280 => 0.3440, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.85% (0.3120 => 0.3240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.44% (1.3121 => 1.3441, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.47% (1.3641 => 1.3841, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.29% (1.2361 => 1.2521, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.00% (2.4002 => 2.5202, std.dev.: 0.0309) MultiSource/Applications/viterbi/viterbi: 3.46% (2.6602 => 2.7522, std.dev.: 0.0328) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sieve: 10.26% (0.3120 => 0.3440, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.22% (1.1281 => 1.2321, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0154) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (10.6960 => 11.5120, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0502) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0035) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0287) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0763) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0262) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0491) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 3.16% (17.6165 => 18.1725, std.dev.: 0.0392) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0063) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.54% (48.1088 => 49.3289, std.dev.: 0.0802) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0505) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0403) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 2.25% (37.0925 => 37.9286, std.dev.: 0.0836) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0194) MultiSource/Applications/kimwitu++/kc: 2.11% (18.8170 => 19.2131, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0121) MultiSource/Applications/SPASS/SPASS: 1.50% (17.5484 => 17.8124, std.dev.: 0.0342) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.11% (28.1538 => 28.4658, std.dev.: 0.0272) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0221) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/treeadd/treeadd: 16.07% (0.2240 => 0.2600, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0370) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.48% (4.0643 => 4.1243, std.dev.: 0.0132) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.0123 => 5.0803, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.05% (3.3482 => 3.1122, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 04:12:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 06:12:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140411111255.8B14C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24543?compare_to=24535&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24543, Order: 206017, Start Time: 2014-04-11 06:29:49, End Time: 2014-04-11 11:19:20 To: 24535, Order: 206008, Start Time: 2014-04-11 01:24:52, End Time: 2014-04-11 06:14:36 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (151 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.00% (0.1200 => 0.1320, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 5.50% (0.4360 => 0.4600, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3080 => 0.3240, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3520 => 0.3680, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: 3.70% (0.3240 => 0.3360, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.47% (0.8080 => 0.8360, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.31% (1.3881 => 1.4201, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.72% (1.3961 => 1.4201, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: -6.90% (0.3480 => 0.3240, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0103) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0079) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0058) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C/ConstructorDestructorAttributes: 400.00% (0.0040 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 388.93% (0.2520 => 1.2321, std.dev.: 0.0190) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0103) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0052) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0054) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0047) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0070) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0061) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 26.32% (0.0760 => 0.0960, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 25.00% (0.0960 => 0.1200, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0062) MultiSource/Applications/obsequi/Obsequi: 22.99% (1.3920 => 1.7120, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.84% (1.1561 => 1.4201, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/chomp: 20.83% (0.1920 => 0.2320, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.79% (1.1321 => 1.3561, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (1.3681 => 1.6361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0154) MultiSource/Applications/JM/ldecod/ldecod: 19.02% (8.5802 => 10.2123, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.77% (1.2881 => 1.5041, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.37% (5.3360 => 6.1561, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.32% (1.3841 => 1.5961, std.dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: 15.29% (19.5406 => 22.5287, std.dev.: 0.0674) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0120) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0155) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0214) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.11% (0.1800 => 0.2000, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.87% (0.1840 => 0.2040, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 9.03% (11.3843 => 12.4123, std.dev.: 0.0452) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 8.53% (6.2844 => 6.8204, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.24% (5.7280 => 6.2000, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (11.4440 => 12.3800, std.dev.: 0.0631) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.65% (0.6800 => 0.7320, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (5.6680 => 6.1000, std.dev.: 0.0540) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (9.5802 => 10.2642, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.16% (1.6240 => 1.7240, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6120 => 0.6480, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.69% (1.1240 => 1.1880, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.50% (0.8000 => 0.8360, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 4.44% (4.7720 => 4.9840, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (6.8280 => 7.0840, std.dev.: 0.0471) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.6961 => 1.7561, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash: 3.48% (0.4600 => 0.4760, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.46% (49.1529 => 50.8529, std.dev.: 0.0960) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (5.3840 => 5.5440, std.dev.: 0.0572) MultiSource/Applications/ClamAV/clamscan: 2.91% (19.2243 => 19.7844, std.dev.: 0.0601) MultiSource/Applications/sqlite3/sqlite3: 2.25% (24.7575 => 25.3135, std.dev.: 0.0531) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: 1.40% (39.0726 => 39.6206, std.dev.: 0.1024) MultiSource/Applications/kimwitu++/kc: 1.38% (19.7491 => 20.0211, std.dev.: 0.0712) MultiSource/Applications/siod/siod: 1.16% (2.7562 => 2.7882, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.44% (3.9842 => 4.3203, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 6.40% (1.3121 => 1.3961, std.dev.: 0.0322) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.42% (1.6521 => 1.6921, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.3085 => 7.4725, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.97% (4.0563 => 4.1363, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.56% (11.0207 => 2.0321, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0891) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0263) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0153) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.85% (4.7643 => 4.6763, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.41% (5.0963 => 5.0243, std.dev.: 0.0250) MultiSource/Applications/obsequi/Obsequi: -1.32% (2.1241 => 2.0961, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 04:16:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 06:16:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140411111607.86BB92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24544?compare_to=24536&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24544, Order: 206017, Start Time: 2014-04-11 06:31:10, End Time: 2014-04-11 11:22:32 To: 24536, Order: 206008, Start Time: 2014-04-11 01:24:38, End Time: 2014-04-11 06:15:26 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 15 (129 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C/casts: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 9.68% (0.1240 => 0.1360, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Applications/viterbi/viterbi: 7.84% (0.2040 => 0.2200, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 4.96% (0.4840 => 0.5080, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.92% (0.4080 => 0.4240, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.35% (1.7921 => 1.8521, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (1.0001 => 1.0201, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.86% (2.1560 => 2.1960, std.dev.: 0.0148) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.14% (17.6723 => 19.6403, std.dev.: 0.0554) MultiSource/Applications/sqlite3/sqlite3: 1416.95% (1.7001 => 25.7896, std.dev.: 0.0660) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.82% (50.1010 => 52.0130, std.dev.: 0.0501) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (1.0520 => 1.1080, std.dev.: 0.0305) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.71% (11.3920 => 12.3840, std.dev.: 0.0833) SingleSource/Benchmarks/Misc/oourafft: 174.71% (11.3407 => 31.1539, std.dev.: 0.0693) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0443, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0103) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0127) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.24% (0.1160 => 0.1360, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.66% (1.8281 => 2.0961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.38% (1.8081 => 2.0681, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.79% (1.8561 => 2.1121, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.49% (2.1361 => 2.4242, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.32% (1.8921 => 2.1441, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.30% (1.9241 => 2.1801, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.22% (1.8761 => 2.1241, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.18% (1.9721 => 2.2321, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.11% (1.9521 => 2.2081, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.74% (2.1121 => 2.3601, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.57% (2.1441 => 2.3921, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.93% (1.9761 => 2.1921, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.67% (2.0681 => 2.2681, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.24% (0.3400 => 0.3680, std.dev.: 0.0100) MultiSource/Applications/viterbi/viterbi: 7.84% (0.2040 => 0.2200, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.3760 => 0.4040, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.4760 => 0.5080, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (6.4800 => 6.9040, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: 6.30% (1.0160 => 1.0800, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.65% (0.7080 => 0.7480, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.58% (0.7880 => 0.8320, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0152) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0310) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.11% (0.7040 => 0.7400, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.83% (9.6042 => 10.0682, std.dev.: 0.0457) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.81% (1.6641 => 1.7441, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0153) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0162) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (5.8281 => 6.0921, std.dev.: 0.0202) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 4.19% (10.2283 => 10.6564, std.dev.: 0.0324) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (6.5320 => 6.7920, std.dev.: 0.0449) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (16.3003 => 16.8683, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0148) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0124) MultiSource/Benchmarks/sim/sim: 3.19% (0.3760 => 0.3880, std.dev.: 0.0025) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.04% (1.3160 => 1.3560, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 3.04% (5.3960 => 5.5600, std.dev.: 0.0418) MultiSource/Applications/JM/lencod/lencod: 2.85% (22.2206 => 22.8528, std.dev.: 0.0714) MultiSource/Benchmarks/Bullet/bullet: 2.67% (38.6366 => 39.6686, std.dev.: 0.0972) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (2.3401 => 2.3961, std.dev.: 0.0133) MultiSource/Applications/SPASS/SPASS: 2.22% (18.5284 => 18.9404, std.dev.: 0.0697) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.14% (6.5360 => 6.6760, std.dev.: 0.0450) MultiSource/Applications/d/make_dparser: 2.11% (3.9761 => 4.0601, std.dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 1.23% (19.8291 => 20.0731, std.dev.: 0.0575) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (13.0363 => 13.1843, std.dev.: 0.0337) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.53% (2.1201 => 2.4282, std.dev.: 0.0432) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0376) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.3725 => 7.6605, std.dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.82% (6.5964 => 6.7164, std.dev.: 0.0365) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (3.7442 => 3.7962, std.dev.: 0.0160) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.73% (2.9562 => 0.6880, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0092) MultiSource/Applications/obsequi/Obsequi: -5.12% (1.8760 => 1.7800, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.24% (94.8339 => 49.0871, std.dev.: 10.6597) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.15% (49.9431 => 32.8861, std.dev.: 0.2283) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.53% (25.7136 => 17.0931, std.dev.: 0.1253) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.13% (37.0863 => 28.8778, std.dev.: 0.4796) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 07:50:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 09:50:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411145034.191D82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24545?compare_to=24542&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24545, Order: 206026, Start Time: 2014-04-11 10:10:32, End Time: 2014-04-11 14:56:59 To: 24542, Order: 206021, Start Time: 2014-04-11 06:36:39, End Time: 2014-04-11 11:18:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (103 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-12-Int64ToFP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 40.00% (0.0400 => 0.0560, std.dev.: 0.0035) SingleSource/Regression/C++/EH/class_hierarchy: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 28.57% (0.0560 => 0.0720, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 3.51% (0.4560 => 0.4720, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.10% (0.9521 => 0.9721, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 1.77% (1.3561 => 1.3801, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.62% (1.2321 => 1.2521, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.38% (0.2560 => 0.2800, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0069) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0095) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0622) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0557) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0385) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0365) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0354) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0126) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0420) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0486) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0289) MultiSource/Benchmarks/Bullet/bullet: 2.46% (37.0925 => 38.0046, std.dev.: 0.0587) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0073) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.37% (48.1088 => 49.2489, std.dev.: 0.1129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0323) MultiSource/Applications/sqlite3/sqlite3: 2.34% (23.7574 => 24.3135, std.dev.: 0.0432) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 2.11% (18.8170 => 19.2131, std.dev.: 0.0399) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0112) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0453) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 4.21% (6.6564 => 6.9364, std.dev.: 0.0398) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 2.15% (5.0123 => 5.1203, std.dev.: 0.0177) MultiSource/Applications/obsequi/Obsequi: 2.13% (2.0681 => 2.1121, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.9443 => 5.0003, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.13% (1.0641 => 1.0761, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 1.00% (21.1533 => 21.3653, std.dev.: 0.0287) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.24% (10.8967 => 2.0441, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0128) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 08:30:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 10:30:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411153027.38C122A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24546?compare_to=24539&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24546, Order: 206026, Start Time: 2014-04-11 10:49:38, End Time: 2014-04-11 15:36:54 To: 24539, Order: 206017, Start Time: 2014-04-11 05:49:47, End Time: 2014-04-11 10:37:22 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 20 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1091 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-26-Shorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/member-function-pointers: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 20.00% (0.0800 => 0.0960, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.50% (0.1280 => 0.1440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.2240 => 0.2400, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (2.1000 => 2.1360, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.63% (1.7201 => 1.7481, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.58% (1.7681 => 1.7961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.41% (1.7001 => 1.7241, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.07% (1.8721 => 1.8921, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.4962 => 2.4562, std.dev.: 0.0130) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 08:42:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 10:42:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411154252.19FF7312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/24547?compare_to=24540&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24547, Order: 206026, Start Time: 2014-04-11 11:01:23, End Time: 2014-04-11 15:49:19 To: 24540, Order: 206017, Start Time: 2014-04-11 05:59:53, End Time: 2014-04-11 10:47:55 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 12 (144 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/perlin: 25.00% (0.0640 => 0.0800, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: 4.88% (0.3280 => 0.3440, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.06% (1.5760 => 1.6400, std.dev.: 0.0243) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.73% (0.7320 => 0.7520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.23% (1.6121 => 1.6481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.47% (1.9081 => 1.9361, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 25.00% (0.0960 => 0.1200, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 11.36% (0.1760 => 0.1960, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.70% (11.3687 => 31.2300, std.dev.: 0.0996) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0094) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0110) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0063) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ConditionalExpr: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 25.00% (0.0640 => 0.0800, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.23% (0.1040 => 0.1240, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.05% (1.4841 => 1.6481, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.24% (1.5241 => 1.6801, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.89% (0.3640 => 0.4000, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.72% (1.4401 => 1.5801, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.28% (1.1640 => 1.2720, std.dev.: 0.0286) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.03% (0.6200 => 0.6760, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (0.2240 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (6.4680 => 6.8800, std.dev.: 0.0495) SingleSource/Benchmarks/Linpack/linpack-pc: 6.17% (0.3240 => 0.3440, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.15% (11.6440 => 12.3600, std.dev.: 0.0646) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (1.5480 => 1.6400, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (9.4842 => 10.0202, std.dev.: 0.0426) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.38% (1.5600 => 1.6440, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.7000 => 0.7360, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 5.08% (0.2360 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (5.8121 => 6.1041, std.dev.: 0.0405) MultiSource/Applications/Burg/burg: 4.77% (1.5080 => 1.5800, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.47% (1.5201 => 1.5881, std.dev.: 0.0182) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.0443 => 10.4923, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (6.5440 => 6.8280, std.dev.: 0.0324) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (6.5080 => 6.7800, std.dev.: 0.0498) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 4.15% (21.9606 => 22.8728, std.dev.: 0.0623) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0173) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.89% (50.0290 => 51.9730, std.dev.: 0.0591) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.87% (0.7240 => 0.7520, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (5.3600 => 5.5640, std.dev.: 0.0305) MultiSource/Applications/hbd/hbd: 3.69% (1.7360 => 1.8000, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.0440 => 2.1160, std.dev.: 0.0273) MultiSource/Applications/lua/lua: 3.51% (4.7880 => 4.9560, std.dev.: 0.0164) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0195) MultiSource/Applications/oggenc/oggenc: 3.26% (6.9844 => 7.2124, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 3.09% (38.4046 => 39.5926, std.dev.: 0.0780) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0141) MultiSource/Applications/SPASS/SPASS: 2.97% (18.4404 => 18.9885, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.7480 => 0.7680, std.dev.: 0.0074) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (16.3483 => 16.7683, std.dev.: 0.0574) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 2.42% (19.6891 => 20.1651, std.dev.: 0.0342) MultiSource/Applications/ClamAV/clamscan: 2.42% (19.0444 => 19.5044, std.dev.: 0.0487) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.1200 => 0.1400, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0350) MultiSource/Applications/ClamAV/clamscan: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0113) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0321) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.62% (0.2600 => 0.2720, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.81% (4.5603 => 4.6883, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: 2.14% (2.0521 => 2.0961, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (3.9922 => 4.0603, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.87% (10.6247 => 2.0321, std.dev.: 0.0328) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -75.95% (2.9442 => 0.7080, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.62% (1.5641 => 0.6160, std.dev.: 0.0101) MultiSource/Applications/obsequi/Obsequi: -6.42% (1.8680 => 1.7480, std.dev.: 0.0286) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.17% (91.8497 => 49.4431, std.dev.: 10.4541) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.67% (26.0616 => 17.0251, std.dev.: 0.0978) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.12% (50.3031 => 33.1381, std.dev.: 0.0976) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.65% (42.1466 => 28.8058, std.dev.: 0.3033) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1074) SingleSource/UnitTests/Vector/multiplies: -20.75% (1.6961 => 1.3441, std.dev.: 0.0069) SingleSource/Benchmarks/Linpack/linpack-pc: -13.21% (7.7845 => 6.7564, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3561 => 2.3201, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0194) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.17% (2.7442 => 2.7122, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 08:59:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 10:59:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140411155955.A27F42A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24548?compare_to=24541&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24548, Order: 206026, Start Time: 2014-04-11 11:16:20, End Time: 2014-04-11 16:06:22 To: 24541, Order: 206017, Start Time: 2014-04-11 06:17:03, End Time: 2014-04-11 11:07:01 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (127 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 8.33% (0.2880 => 0.3120, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.44% (2.1320 => 2.1840, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.58% (2.0201 => 2.0521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.36% (2.0521 => 2.0801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.22% (2.2961 => 2.3241, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.29% (0.1680 => 0.1920, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.08% (1.7081 => 2.0681, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.89% (1.8001 => 2.1761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.55% (1.8881 => 2.2761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.13% (1.8081 => 2.1721, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.51% (1.9881 => 2.3561, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.8281 => 2.1641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.42% (0.6120 => 0.6880, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 9.20% (0.3480 => 0.3800, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.66% (3.5002 => 3.7682, std.dev.: 0.0196) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.35% (11.7880 => 12.5360, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (6.7200 => 7.0920, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.4160 => 1.4920, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (9.9842 => 10.4642, std.dev.: 0.0380) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0216) MultiSource/Applications/d/make_dparser: 4.34% (3.9641 => 4.1361, std.dev.: 0.0210) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0162) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0380) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (10.3203 => 10.7044, std.dev.: 0.0378) MultiSource/Applications/oggenc/oggenc: 3.65% (6.9124 => 7.1644, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (6.8321 => 7.0801, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0070) MultiSource/Applications/Burg/burg: 3.59% (1.5600 => 1.6160, std.dev.: 0.0176) MultiSource/Applications/SPASS/SPASS: 3.29% (18.4924 => 19.1007, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.23% (0.3720 => 0.3840, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 2.85% (22.6287 => 23.2728, std.dev.: 0.0673) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (5.5480 => 5.6960, std.dev.: 0.0394) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.62% (51.1089 => 52.4489, std.dev.: 0.1232) MultiSource/Benchmarks/Bullet/bullet: 2.46% (38.9366 => 39.8926, std.dev.: 0.1017) MultiSource/Applications/ClamAV/clamscan: 2.35% (20.2445 => 20.7205, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 2.19% (19.7371 => 20.1691, std.dev.: 0.0660) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2203 => 4.3123, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.5963 => 16.9523, std.dev.: 0.0810) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 1.57% (25.1895 => 25.5856, std.dev.: 0.0283) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (3.0122 => 3.0562, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0244 => 6.1044, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (2.2721 => 2.3001, std.dev.: 0.0101) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 27.58% (0.9281 => 1.1841, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.59% (1.2121 => 1.3041, std.dev.: 0.0329) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0304) MultiSource/Applications/minisat/minisat: 2.70% (6.8204 => 7.0044, std.dev.: 0.0354) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9604 => 6.0684, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (4.2403 => 4.3163, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 1.17% (7.5485 => 7.6365, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0120) SingleSource/UnitTests/2002-08-19-CodegenBug: -66.67% (0.0240 => 0.0080, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/nestedloop: -65.05% (2.9642 => 1.0361, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.33% (3.1762 => 1.2601, std.dev.: 0.0073) SingleSource/Regression/C++/EH/dead_try_block: -60.00% (0.0200 => 0.0080, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: -32.93% (2.6481 => 1.7760, std.dev.: 0.0216) MultiSource/Applications/sgefa/sgefa: -26.84% (0.7600 => 0.5560, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.22% (7.4801 => 6.1920, std.dev.: 0.0656) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.67% (7.5041 => 6.3280, std.dev.: 0.0377) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0063) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -2.90% (13.5243 => 13.1323, std.dev.: 0.0598) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0257) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/five11/five11: -1.20% (2.3401 => 2.3121, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 09:14:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 11:14:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140411161417.4B3272A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24549?compare_to=24543&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24549, Order: 206026, Start Time: 2014-04-11 11:30:43, End Time: 2014-04-11 16:20:43 To: 24543, Order: 206017, Start Time: 2014-04-11 06:29:49, End Time: 2014-04-11 11:19:20 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (155 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/Regression/C++/EH/function_try_block: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/FloatMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0960 => 0.1120, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.79% (0.0760 => 0.0880, std.dev.: 0.0025) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.34% (0.1160 => 0.1280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.77% (1.3561 => 1.3801, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.75% (1.5961 => 1.6241, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (2.2481 => 2.2721, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 200.00% (0.0080 => 0.0240, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/strcat: 42.86% (0.0560 => 0.0800, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.13% (1.6921 => 1.7281, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0073) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0086) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 390.52% (0.2520 => 1.2361, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/nestedloop: 272.46% (0.2320 => 0.8641, std.dev.: 0.0107) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0041) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0055) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 47.37% (0.0760 => 0.1120, std.dev.: 0.0056) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0091) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.19% (1.2401 => 1.5401, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0144) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: 22.41% (1.3920 => 1.7040, std.dev.: 0.0275) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 22.15% (1.3001 => 1.5881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.91% (1.1321 => 1.3801, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.65% (1.1401 => 1.3641, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.39% (1.1761 => 1.4041, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.23% (1.1441 => 1.3641, std.dev.: 0.0186) MultiSource/Applications/JM/ldecod/ldecod: 19.11% (8.5802 => 10.2203, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.57% (1.2521 => 1.4721, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.79% (0.0760 => 0.0880, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 15.29% (19.5406 => 22.5287, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.99% (5.3360 => 6.1361, std.dev.: 0.0355) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0170) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0057) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 9.45% (11.3843 => 12.4603, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.38% (5.7280 => 6.2080, std.dev.: 0.0500) MultiSource/Applications/oggenc/oggenc: 8.34% (6.2844 => 6.8084, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.32% (11.4440 => 12.3960, std.dev.: 0.0476) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.97% (5.6680 => 6.1200, std.dev.: 0.0526) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.7640 => 0.8240, std.dev.: 0.0137) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.4320 => 0.4640, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.41% (0.6480 => 0.6960, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.2200 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.01% (9.5802 => 10.2522, std.dev.: 0.0409) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.16% (1.6240 => 1.7240, std.dev.: 0.0254) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6120 => 0.6480, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0067) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wc: 4.69% (0.2560 => 0.2680, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0213) MultiSource/Applications/lua/lua: 4.19% (4.7720 => 4.9720, std.dev.: 0.0329) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (6.8280 => 7.0760, std.dev.: 0.0555) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.25% (49.1529 => 50.7489, std.dev.: 0.1123) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3840 => 5.5560, std.dev.: 0.0550) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.7680 => 0.7920, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.7600 => 1.8120, std.dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: 2.91% (19.2243 => 19.7844, std.dev.: 0.0422) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.79% (1.1480 => 1.1800, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 2.67% (24.7575 => 25.4175, std.dev.: 0.0345) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0129) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 1.72% (39.0726 => 39.7446, std.dev.: 0.0805) MultiSource/Applications/kimwitu++/kc: 1.54% (19.7491 => 20.0531, std.dev.: 0.0483) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0018) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0117) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.08% (0.5920 => 0.6280, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0417) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.84% (3.2362 => 3.3282, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0225) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 2.07% (4.0563 => 4.1403, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4001 => 1.4161, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.60% (11.0207 => 2.0281, std.dev.: 0.0093) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -15.73% (7.8605 => 6.6244, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0774) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0199) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 09:16:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 11:16:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140411161620.B937E2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24550?compare_to=24544&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24550, Order: 206026, Start Time: 2014-04-11 11:31:43, End Time: 2014-04-11 16:22:44 To: 24544, Order: 206017, Start Time: 2014-04-11 06:31:10, End Time: 2014-04-11 11:22:32 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 19 (133 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.50% (0.0960 => 0.1080, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (0.1760 => 0.1960, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 11.11% (0.1800 => 0.2000, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.33% (0.3000 => 0.3280, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.43% (0.3320 => 0.3600, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.25% (0.1920 => 0.2040, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 5.66% (0.2120 => 0.2240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.95% (0.3040 => 0.3160, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 3.80% (0.6320 => 0.6560, std.dev.: 0.0060) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.44% (1.3120 => 1.3440, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.82% (2.1921 => 2.2321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.17% (2.3921 => 2.4202, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4681 => 1.4841, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.18% (17.6723 => 19.6483, std.dev.: 0.0487) MultiSource/Applications/sqlite3/sqlite3: 1419.06% (1.7001 => 25.8256, std.dev.: 0.0491) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.80% (50.1010 => 52.0050, std.dev.: 0.1184) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (1.0520 => 1.0880, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.81% (11.3920 => 12.3960, std.dev.: 0.0524) SingleSource/Benchmarks/Misc/oourafft: 175.66% (11.3407 => 31.2620, std.dev.: 0.0729) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0483, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0076) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0072) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0047) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: 25.00% (0.1280 => 0.1600, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0065) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.20% (1.9721 => 2.2521, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.95% (1.9761 => 2.2321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.50% (0.0960 => 0.1080, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0098) MultiSource/Benchmarks/NPB-serial/is/is: 12.00% (0.1000 => 0.1120, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.50% (2.0521 => 2.2881, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0139) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.47% (1.9481 => 2.1521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.43% (0.6360 => 0.6960, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.21% (0.3040 => 0.3320, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.20% (0.3480 => 0.3800, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0039) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0060) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0195) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0282) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (6.4800 => 6.8440, std.dev.: 0.0460) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.61% (1.2120 => 1.2800, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.71% (9.6042 => 10.0562, std.dev.: 0.0377) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (6.5320 => 6.8200, std.dev.: 0.0530) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0254) MultiSource/Applications/hbd/hbd: 4.17% (1.7280 => 1.8000, std.dev.: 0.0239) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.2283 => 10.6324, std.dev.: 0.0461) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (5.8281 => 6.0521, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.7480 => 1.8120, std.dev.: 0.0172) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.38% (1.3000 => 1.3440, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (6.5360 => 6.7560, std.dev.: 0.0328) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0135) MultiSource/Applications/lua/lua: 3.26% (4.7920 => 4.9480, std.dev.: 0.0329) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (16.3003 => 16.8123, std.dev.: 0.0619) MultiSource/Applications/JM/lencod/lencod: 3.03% (22.2206 => 22.8928, std.dev.: 0.0346) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 2.72% (3.9761 => 4.0841, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.54% (38.6366 => 39.6166, std.dev.: 0.0876) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (2.3401 => 2.3961, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 2.38% (18.5284 => 18.9686, std.dev.: 0.0557) MultiSource/Applications/oggenc/oggenc: 2.21% (7.0524 => 7.2085, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0154) MultiSource/Applications/kimwitu++/kc: 1.69% (19.8291 => 20.1651, std.dev.: 0.0340) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0363 => 13.1763, std.dev.: 0.0340) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0377) MultiSource/Applications/siod/siod: 4.89% (2.8642 => 3.0042, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 3.91% (7.3725 => 7.6605, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0026) MultiSource/Applications/obsequi/Obsequi: 2.54% (2.0441 => 2.0961, std.dev.: 0.0175) MultiSource/Applications/minisat/minisat: 2.36% (6.5964 => 6.7524, std.dev.: 0.0461) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0148) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.69% (10.4007 => 2.0081, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.32% (2.9562 => 0.7000, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0069) MultiSource/Applications/obsequi/Obsequi: -5.97% (1.8760 => 1.7640, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.23% (94.8339 => 49.0951, std.dev.: 10.5312) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.88% (49.9431 => 33.0221, std.dev.: 0.2330) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.77% (25.7136 => 17.0291, std.dev.: 0.1503) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.57% (3.0722 => 2.3481, std.dev.: 0.1115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.91% (37.0863 => 28.5898, std.dev.: 0.3924) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3521 => 2.3041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0168) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 10:01:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 12:01:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411170125.D19992A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24551?compare_to=24545&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24551, Order: 206027, Start Time: 2014-04-11 12:24:31, End Time: 2014-04-11 17:07:51 To: 24545, Order: 206026, Start Time: 2014-04-11 10:10:32, End Time: 2014-04-11 14:56:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (101 on baseline) Performance Improvements: 4 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.76% (0.1640 => 0.1800, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.69% (0.6760 => 0.7280, std.dev.: 0.0189) MultiSource/Benchmarks/McCat/05-eks/eks: 4.07% (0.6880 => 0.7160, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.24% (1.2881 => 1.3041, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.21% (1.3241 => 1.3401, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.68% (0.1520 => 0.1880, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/class_hierarchy: -33.33% (0.0480 => 0.0320, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash: -4.24% (0.4720 => 0.4520, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -1.52% (2.6281 => 2.5881, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: -1.42% (19.2131 => 18.9410, std.dev.: 0.0503) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0022) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0363) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (10.6960 => 11.3680, std.dev.: 0.0762) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.85% (1.3681 => 1.4481, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0180) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0325) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.29% (0.6520 => 0.6800, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0335) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0416) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0473) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (7.8562 => 8.0802, std.dev.: 0.0246) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.53% (1.7360 => 1.7800, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (4.9200 => 5.0440, std.dev.: 0.0331) MultiSource/Applications/sqlite3/sqlite3: 2.48% (23.7574 => 24.3455, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0430) MultiSource/Benchmarks/Bullet/bullet: 2.07% (37.0925 => 37.8606, std.dev.: 0.0561) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.51% (48.1088 => 48.8369, std.dev.: 0.1186) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0111) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0178) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0392) MultiSource/Applications/obsequi/Obsequi: 3.48% (2.0681 => 2.1401, std.dev.: 0.0188) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0033) SingleSource/Benchmarks/SmallPT/smallpt: 1.26% (14.0009 => 14.1769, std.dev.: 0.0368) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (1.3481 => 1.3321, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 10:36:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 12:36:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411173654.DAFB42A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24552?compare_to=24551&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24552, Order: 206029, Start Time: 2014-04-11 13:01:29, End Time: 2014-04-11 17:43:19 To: 24551, Order: 206027, Start Time: 2014-04-11 12:24:31, End Time: 2014-04-11 17:07:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (94 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.76% (0.5320 => 0.5520, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.7120 => 0.7240, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.06% (11.3680 => 11.4880, std.dev.: 0.0459) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.04% (3.3322 => 3.5002, std.dev.: 0.0585) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.37% (1.6881 => 1.7281, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0058) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.28% (1.1601 => 1.2561, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.85% (1.3681 => 1.4481, std.dev.: 0.0154) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0406) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0420) MultiSource/Applications/JM/lencod/lencod: 2.72% (17.6165 => 18.0965, std.dev.: 0.0579) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0352) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0340) MultiSource/Applications/sqlite3/sqlite3: 2.34% (23.7574 => 24.3135, std.dev.: 0.0380) MultiSource/Benchmarks/Bullet/bullet: 1.92% (37.0925 => 37.8046, std.dev.: 0.0570) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.7120 => 0.7240, std.dev.: 0.0044) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.58% (48.1088 => 48.8689, std.dev.: 0.1121) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.27% (2.8322 => 2.8682, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0180) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.86% (0.3160 => 0.3440, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.26% (3.5322 => 3.6122, std.dev.: 0.0295) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0364) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/perlin: -22.22% (0.0720 => 0.0560, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0080) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 12:04:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 14:04:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411190414.DEC9E2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24553?compare_to=24552&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24553, Order: 206032, Start Time: 2014-04-11 14:29:31, End Time: 2014-04-11 19:10:40 To: 24552, Order: 206029, Start Time: 2014-04-11 13:01:29, End Time: 2014-04-11 17:43:19 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (99 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.00% (0.0800 => 0.0960, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.55% (1.2561 => 1.2881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.26% (1.2681 => 1.2841, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (1.2521 => 1.2801, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/rem: -14.71% (0.1360 => 0.1160, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.4602 => 2.4322, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0018) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 16.22% (0.1480 => 0.1720, std.dev.: 0.0074) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.18% (0.6240 => 0.7000, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0124) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.05% (1.1921 => 1.2761, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0631) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0602) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0450) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0192) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0401) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0476) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0487) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0554) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0235) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0521) MultiSource/Applications/sqlite3/sqlite3: 2.29% (23.7574 => 24.3015, std.dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (2.1201 => 2.1641, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 1.71% (37.0925 => 37.7286, std.dev.: 0.0674) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.65% (48.1088 => 48.9049, std.dev.: 0.0651) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0191) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0100) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (5.0123 => 5.1243, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.2601 => 1.2801, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.28% (10.8967 => 2.0401, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.76% (0.5320 => 0.5120, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: -1.16% (1.3841 => 1.3681, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 13:46:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 15:46:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411204629.3F9E82A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24554?compare_to=24546&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24554, Order: 206032, Start Time: 2014-04-11 16:05:58, End Time: 2014-04-11 20:52:56 To: 24546, Order: 206026, Start Time: 2014-04-11 10:49:38, End Time: 2014-04-11 15:36:54 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1104 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Towers: 36.36% (0.0440 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 4.23% (0.2840 => 0.2960, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.29% (1.5720 => 1.6080, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.47% (2.4562 => 2.4922, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.06% (1.7481 => 1.7121, std.dev.: 0.0130) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 13:47:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 15:47:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140411204713.F0C442A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24555?compare_to=24547&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24555, Order: 206033, Start Time: 2014-04-11 16:05:40, End Time: 2014-04-11 20:53:40 To: 24547, Order: 206026, Start Time: 2014-04-11 11:01:23, End Time: 2014-04-11 15:49:19 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 10 (135 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (953 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.60% (0.6160 => 0.6320, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.27% (1.5881 => 1.6241, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.89% (1.2720 => 1.2960, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.21% (11.3687 => 31.1739, std.dev.: 0.0421) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4600 => 1.8401, std.dev.: 0.0047) SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0060) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: 66.67% (0.0240 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.36% (1.0240 => 1.2120, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.07% (0.1640 => 0.1920, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.34% (1.1640 => 1.2960, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.77% (1.0240 => 1.1240, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.81% (1.8161 => 1.9761, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.73% (1.4201 => 1.5441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0117) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.62% (1.4841 => 1.6121, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.27% (1.5481 => 1.6761, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.46% (0.2680 => 0.2880, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (6.4680 => 6.8960, std.dev.: 0.0280) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (11.6440 => 12.3720, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (9.4842 => 10.0202, std.dev.: 0.0508) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.45% (1.4681 => 1.5481, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0414) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (1.7921 => 1.8841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.05% (1.5841 => 1.6641, std.dev.: 0.0123) MultiSource/Applications/Burg/burg: 5.04% (1.5080 => 1.5840, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 4.63% (21.9606 => 22.9768, std.dev.: 0.0270) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.52% (6.5440 => 6.8400, std.dev.: 0.0274) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.0443 => 10.4923, std.dev.: 0.0302) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: 4.15% (1.7360 => 1.8080, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (6.5080 => 6.7760, std.dev.: 0.0390) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (2.0440 => 2.1240, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.90% (1.8440 => 1.9160, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (5.3600 => 5.5640, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0099) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.69% (50.0290 => 51.8770, std.dev.: 0.1015) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0097) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0172) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.35% (1.3120 => 1.3560, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.28% (16.3483 => 16.8843, std.dev.: 0.0338) MultiSource/Applications/oggenc/oggenc: 3.26% (6.9844 => 7.2124, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0175) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.23% (0.6200 => 0.6400, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 3.20% (38.4046 => 39.6326, std.dev.: 0.0585) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0087) MultiSource/Applications/SPASS/SPASS: 2.95% (18.4404 => 18.9845, std.dev.: 0.0576) MultiSource/Applications/lua/lua: 2.92% (4.7880 => 4.9280, std.dev.: 0.0279) MultiSource/Applications/ClamAV/clamscan: 2.52% (19.0444 => 19.5243, std.dev.: 0.0421) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0113) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0202) MultiSource/Applications/siod/siod: 2.06% (2.7162 => 2.7722, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 1.79% (19.6891 => 20.0411, std.dev.: 0.0568) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0318) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.89% (2.1401 => 2.4802, std.dev.: 0.0464) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 5.60% (1.0721 => 1.1321, std.dev.: 0.0219) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.44% (0.7200 => 0.7520, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) MultiSource/Applications/obsequi/Obsequi: 2.92% (2.0521 => 2.1121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.63% (4.5603 => 4.6803, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.8481 => 0.8641, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.3161 => 1.3361, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (2.9322 => 2.9682, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.87% (10.6247 => 2.0321, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -77.18% (2.9442 => 0.6720, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.59% (1.5641 => 0.6320, std.dev.: 0.0037) MultiSource/Applications/obsequi/Obsequi: -5.14% (1.8680 => 1.7720, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.13% (91.8497 => 49.4831, std.dev.: 10.2962) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -35.12% (26.0616 => 16.9091, std.dev.: 0.1773) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.15% (50.3031 => 33.1261, std.dev.: 0.1920) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.21% (42.1466 => 28.5698, std.dev.: 0.4591) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1099) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0132) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0209) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 13:51:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 15:51:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411205112.9272E2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24556?compare_to=24553&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24556, Order: 206033, Start Time: 2014-04-11 16:12:20, End Time: 2014-04-11 20:57:39 To: 24553, Order: 206032, Start Time: 2014-04-11 14:29:31, End Time: 2014-04-11 19:10:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (92 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1005 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/family/family: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Perm: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.79% (0.8921 => 0.9081, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.72% (3.5282 => 3.6242, std.dev.: 0.0300) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4322 => 2.4602, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.57% (1.2161 => 1.3081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.34% (1.1441 => 1.2281, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0420) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0353) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0237) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0314) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0492) MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (10.4082 => 10.7082, std.dev.: 0.0410) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0378) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0337) MultiSource/Applications/sqlite3/sqlite3: 2.29% (23.7574 => 24.3015, std.dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0089) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.86% (48.1088 => 49.0050, std.dev.: 0.0738) MultiSource/Benchmarks/Bullet/bullet: 1.71% (37.0925 => 37.7285, std.dev.: 0.0785) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0201) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0072) MultiSource/Applications/minisat/minisat: 4.69% (6.6564 => 6.9684, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0109) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0086) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.60% (3.5322 => 3.6242, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.0123 => 5.0803, std.dev.: 0.0261) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.68% (7.7485 => 6.6884, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 14:12:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 16:12:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140411211247.AD00E2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24557?compare_to=24548&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24557, Order: 206033, Start Time: 2014-04-11 16:29:43, End Time: 2014-04-11 21:19:14 To: 24548, Order: 206026, Start Time: 2014-04-11 11:16:20, End Time: 2014-04-11 16:06:22 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (135 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 33.33% (0.0480 => 0.0640, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.81% (0.7720 => 0.8400, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.69% (0.2560 => 0.2680, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.60% (0.5560 => 0.5760, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Puzzle: 296.51% (0.4560 => 1.8081, std.dev.: 0.0138) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/dt: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.13% (1.8081 => 2.1721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.86% (1.6921 => 2.0281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.68% (1.7681 => 2.1161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.49% (1.7441 => 2.0841, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.38% (1.6921 => 2.0201, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.38% (1.6721 => 1.9961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.27% (1.7641 => 2.1041, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.62% (1.7401 => 2.0641, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.60% (1.8281 => 2.1681, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.11% (1.9641 => 2.3001, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.56% (1.9801 => 2.3081, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.81% (0.1080 => 0.1240, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0089) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 8.06% (0.2480 => 0.2680, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.26% (0.9920 => 1.0640, std.dev.: 0.0142) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (11.7880 => 12.5160, std.dev.: 0.0758) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 6.00% (0.2000 => 0.2120, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.00% (0.2000 => 0.2120, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.00% (0.2000 => 0.2120, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.95% (6.7200 => 7.1200, std.dev.: 0.0387) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0088) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.75% (1.3480 => 1.4120, std.dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (9.9842 => 10.4482, std.dev.: 0.0478) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.52% (1.2400 => 1.2960, std.dev.: 0.0205) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 4.34% (4.7920 => 5.0000, std.dev.: 0.0241) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0213) MultiSource/Applications/d/make_dparser: 4.14% (3.9641 => 4.1281, std.dev.: 0.0139) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0194) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.92% (0.4080 => 0.4240, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.68% (2.0680 => 2.1440, std.dev.: 0.0272) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.67% (1.5240 => 1.5800, std.dev.: 0.0193) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.1440 => 1.1840, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.47% (1.0361 => 1.0721, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 3.36% (22.6287 => 23.3888, std.dev.: 0.0291) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (10.3203 => 10.6524, std.dev.: 0.0563) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (6.8321 => 7.0321, std.dev.: 0.0371) MultiSource/Applications/SPASS/SPASS: 2.70% (18.4924 => 18.9926, std.dev.: 0.0694) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (16.5963 => 17.0123, std.dev.: 0.0608) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.29% (51.1089 => 52.2809, std.dev.: 0.1342) MultiSource/Applications/treecc/treecc: 2.29% (2.6200 => 2.6800, std.dev.: 0.0221) MultiSource/Applications/ClamAV/clamscan: 2.27% (20.2445 => 20.7045, std.dev.: 0.0412) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: 1.93% (38.9366 => 39.6886, std.dev.: 0.0904) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: 1.80% (19.7371 => 20.0931, std.dev.: 0.0387) MultiSource/Applications/sqlite3/sqlite3: 1.73% (25.1895 => 25.6256, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (3.0122 => 3.0522, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.83% (1.2681 => 1.4561, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.33% (3.4842 => 3.6002, std.dev.: 0.0430) MultiSource/Applications/minisat/minisat: 2.87% (6.8204 => 7.0164, std.dev.: 0.0483) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.44% (3.4402 => 3.5242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (4.2403 => 4.3163, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0174) MultiSource/Applications/lua/lua: 1.68% (21.6534 => 22.0174, std.dev.: 0.0937) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (1.2921 => 1.3121, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.7563 => 4.8203, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0203 => 4.0723, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: 1.17% (7.5485 => 7.6365, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.08% (4.4523 => 4.5003, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.26% (10.9087 => 2.0441, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/nestedloop: -64.78% (2.9642 => 1.0441, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.70% (3.1762 => 1.2481, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: -32.48% (2.6481 => 1.7880, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.63% (7.5041 => 6.2560, std.dev.: 0.0548) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (7.4801 => 6.2520, std.dev.: 0.0441) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0056) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: -2.72% (13.5243 => 13.1563, std.dev.: 0.0334) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -46.67% (0.0600 => 0.0320, std.dev.: 0.0075) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0179) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 14:24:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 16:24:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411212405.AB20D2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24558?compare_to=24556&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24558, Order: 206037, Start Time: 2014-04-11 16:51:36, End Time: 2014-04-11 21:30:31 To: 24556, Order: 206033, Start Time: 2014-04-11 16:12:20, End Time: 2014-04-11 20:57:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (90 on baseline) Performance Improvements: 3 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (1005 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0160 => 0.0320, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/lowercase: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 8.00% (0.2000 => 0.2160, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.3360 => 0.3560, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.87% (1.2841 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.49% (1.3401 => 1.3601, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest2: -57.14% (0.0280 => 0.0120, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: -10.67% (0.3000 => 0.2680, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.87% (0.8561 => 0.8401, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: 12.66% (0.3160 => 0.3560, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0129) MultiSource/Applications/viterbi/viterbi: 10.20% (0.1960 => 0.2160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0820) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0412) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0480) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0316) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0244) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0424) MultiSource/Applications/JM/lencod/lencod: 3.11% (17.6165 => 18.1645, std.dev.: 0.0301) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0387) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0414) MultiSource/Benchmarks/Bullet/bullet: 1.74% (37.0925 => 37.7366, std.dev.: 0.0988) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0141) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.68% (48.1088 => 48.9168, std.dev.: 0.1077) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 4.15% (6.6564 => 6.9324, std.dev.: 0.0659) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0171) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.78% (0.8641 => 0.8401, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 14:33:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 16:33:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140411213358.98D112A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24559?compare_to=24549&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24559, Order: 206033, Start Time: 2014-04-11 16:50:39, End Time: 2014-04-11 21:40:22 To: 24549, Order: 206026, Start Time: 2014-04-11 11:30:43, End Time: 2014-04-11 16:20:43 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (143 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-26-Shorts: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 57.14% (0.0280 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Perm: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.25% (0.1920 => 0.2040, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.10% (0.3280 => 0.3480, std.dev.: 0.0065) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.07% (1.3520 => 1.3800, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.71% (1.4041 => 1.4281, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 1975.00% (0.0320 => 0.6640, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0104) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0058) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 392.10% (0.2520 => 1.2401, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/nestedloop: 275.91% (0.2320 => 0.8721, std.dev.: 0.0115) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0075) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 115.38% (0.1040 => 0.2240, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0160 => 0.0320, std.dev.: 0.0062) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0087) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0065) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 47.37% (0.0760 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Perm: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.19% (1.2401 => 1.5401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0050) MultiSource/Applications/obsequi/Obsequi: 21.84% (1.3920 => 1.6960, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.54% (1.3001 => 1.5801, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.45% (1.1721 => 1.4001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 18.98% (8.5802 => 10.2083, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.88% (1.1441 => 1.3601, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/chomp: 18.75% (0.1920 => 0.2280, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.24% (1.2281 => 1.4521, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 15.72% (19.5406 => 22.6127, std.dev.: 0.0527) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.67% (5.3360 => 6.1721, std.dev.: 0.0152) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 13.31% (1.3521 => 1.5321, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.10% (1.7400 => 1.9680, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.52% (0.3360 => 0.3680, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (11.3843 => 12.4043, std.dev.: 0.0442) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.89% (5.6680 => 6.1720, std.dev.: 0.0432) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.45% (5.7280 => 6.2120, std.dev.: 0.0377) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (11.4440 => 12.4040, std.dev.: 0.0424) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.41% (0.3240 => 0.3480, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.06% (0.6800 => 0.7280, std.dev.: 0.0147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (9.5802 => 10.2322, std.dev.: 0.0369) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0154) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: 6.00% (0.2000 => 0.2120, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.4760 => 1.5440, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0062) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0463) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.67% (0.8721 => 0.9041, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (6.8280 => 7.0720, std.dev.: 0.0506) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (1.0680 => 1.1040, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0088) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.04% (49.1529 => 50.6489, std.dev.: 0.1019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (5.3840 => 5.5360, std.dev.: 0.0405) MultiSource/Applications/ClamAV/clamscan: 2.79% (19.2243 => 19.7603, std.dev.: 0.0453) MultiSource/Applications/sqlite3/sqlite3: 2.70% (24.7575 => 25.4255, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 1.72% (39.0726 => 39.7446, std.dev.: 0.0683) MultiSource/Applications/siod/siod: 1.45% (2.7562 => 2.7962, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 1.32% (19.7491 => 20.0091, std.dev.: 0.0506) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.43% (3.9842 => 4.2803, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.1001 => 1.1401, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.24% (0.9881 => 1.0201, std.dev.: 0.0113) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0333) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.60% (11.0207 => 2.0281, std.dev.: 0.0095) SingleSource/UnitTests/2003-09-18-BitFieldTest: -80.00% (0.0200 => 0.0040, std.dev.: 0.0059) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -15.62% (7.8605 => 6.6324, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.31% (3.4442 => 3.0202, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0923) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.0963 => 5.0363, std.dev.: 0.0139) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 14:35:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 16:35:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140411213511.484CC2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24560?compare_to=24550&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24560, Order: 206037, Start Time: 2014-04-11 16:50:39, End Time: 2014-04-11 21:41:38 To: 24550, Order: 206026, Start Time: 2014-04-11 11:31:43, End Time: 2014-04-11 16:22:44 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 12 (120 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (961 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-LoadShorts: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 40.00% (0.0400 => 0.0560, std.dev.: 0.0054) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.98% (0.1720 => 0.1840, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.00% (0.8000 => 0.8400, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 1.74% (5.5080 => 5.6040, std.dev.: 0.0298) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (2.3961 => 2.4202, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 5.75% (17.3211 => 18.3171, std.dev.: 0.2657) MultiSource/Benchmarks/Olden/bisort/bisort: 1.63% (0.7360 => 0.7480, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 1.39% (2.3041 => 2.3361, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.77% (17.6723 => 19.5764, std.dev.: 0.0649) MultiSource/Applications/sqlite3/sqlite3: 1414.12% (1.7001 => 25.7416, std.dev.: 0.0501) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.38% (50.1010 => 51.7930, std.dev.: 0.1441) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (11.3920 => 12.3480, std.dev.: 0.0800) SingleSource/Benchmarks/Misc/oourafft: 174.92% (11.3407 => 31.1779, std.dev.: 0.0545) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0443, std.dev.: 0.0227) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3521, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0059) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0112) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.17% (2.1361 => 2.4602, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.02% (1.9121 => 2.1801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.72% (1.9241 => 2.1881, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.41% (1.7721 => 1.9921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/em3d/em3d: 11.32% (0.2120 => 0.2360, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.64% (2.0681 => 2.2881, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.89% (1.8601 => 2.0441, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.20% (0.3480 => 0.3800, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.72% (1.0880 => 1.1720, std.dev.: 0.0199) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.7400 => 0.7920, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.60% (0.7880 => 0.8400, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0137) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.80% (6.4800 => 6.8560, std.dev.: 0.0392) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.8881 => 0.9361, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.6960 => 1.7840, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.00% (0.2400 => 0.2520, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0095) MultiSource/Applications/hbd/hbd: 4.63% (1.7280 => 1.8080, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0253) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (9.6042 => 10.0322, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (6.5320 => 6.8160, std.dev.: 0.0390) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (5.8281 => 6.0641, std.dev.: 0.0334) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (10.2283 => 10.6364, std.dev.: 0.0356) MultiSource/Benchmarks/MallocBench/gs/gs: 3.85% (5.3960 => 5.6040, std.dev.: 0.0298) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0154) MultiSource/Applications/lua/lua: 3.51% (4.7920 => 4.9600, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (16.3003 => 16.8443, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.7480 => 1.8040, std.dev.: 0.0184) MultiSource/Applications/SPASS/SPASS: 2.72% (18.5284 => 19.0325, std.dev.: 0.0392) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.2206 => 22.8088, std.dev.: 0.0467) MultiSource/Applications/treecc/treecc: 2.63% (2.5880 => 2.6560, std.dev.: 0.0243) MultiSource/Benchmarks/Bullet/bullet: 2.56% (38.6366 => 39.6246, std.dev.: 0.0808) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 2.16% (7.0524 => 7.2044, std.dev.: 0.0327) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0224) MultiSource/Applications/siod/siod: 1.89% (2.7522 => 2.8042, std.dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: 1.67% (19.8291 => 20.1611, std.dev.: 0.0574) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (4.2243 => 4.2843, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 18.18% (0.9241 => 1.0921, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0340) MultiSource/Applications/siod/siod: 5.17% (2.8642 => 3.0122, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.76% (6.5964 => 6.7124, std.dev.: 0.0359) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.38% (10.4007 => 2.0401, std.dev.: 0.0310) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.59% (2.9562 => 0.6920, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0073) MultiSource/Applications/obsequi/Obsequi: -5.12% (1.8760 => 1.7800, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.02% (94.8339 => 49.2911, std.dev.: 9.9254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.74% (49.9431 => 33.0941, std.dev.: 0.1585) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.43% (25.7136 => 17.1171, std.dev.: 0.1096) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.90% (37.0863 => 28.9658, std.dev.: 0.3689) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -3.85% (0.6240 => 0.6000, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 15:05:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 17:05:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411220533.C43052A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24561?compare_to=24558&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24561, Order: 206038, Start Time: 2014-04-11 17:28:58, End Time: 2014-04-11 22:11:56 To: 24558, Order: 206037, Start Time: 2014-04-11 16:51:36, End Time: 2014-04-11 21:30:31 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (94 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 50.00% (0.0240 => 0.0360, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 44.44% (0.0360 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/exptree: 23.81% (0.0840 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 8.96% (0.2680 => 0.2920, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.82% (0.6800 => 0.7400, std.dev.: 0.0189) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.14% (0.1680 => 0.1800, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3440 => 0.3600, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 3.08% (0.7800 => 0.8040, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9121 => 0.9281, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.48% (1.6241 => 1.6481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.23% (1.3041 => 1.3201, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.67% (0.2400 => 0.2800, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.00% (0.0800 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.59% (0.3640 => 0.3880, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.43% (0.8401 => 0.8521, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/hash: 1.03% (4.2523 => 4.2963, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/simple_throw: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -10.45% (0.2680 => 0.2400, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0866) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0167) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0115) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0527) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0426) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0514) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0231) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0282) MultiSource/Applications/JM/lencod/lencod: 2.79% (17.6165 => 18.1085, std.dev.: 0.0463) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.58% (1.7080 => 1.7520, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0449) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8965, std.dev.: 0.0680) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0521) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0308) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.79% (48.1088 => 48.9688, std.dev.: 0.0996) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0850, std.dev.: 0.0417) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0118) MultiSource/Applications/SPASS/SPASS: 1.00% (17.5484 => 17.7244, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 4.51% (6.6564 => 6.9564, std.dev.: 0.0491) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0110) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0322) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3361 => 2.3001, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 15:35:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 17:35:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140411223520.E40432A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24562?compare_to=24561&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24562, Order: 206039, Start Time: 2014-04-11 17:59:50, End Time: 2014-04-11 22:41:46 To: 24561, Order: 206038, Start Time: 2014-04-11 17:28:58, End Time: 2014-04-11 22:11:56 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (99 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/mason/mason: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.07% (0.2320 => 0.2600, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2200 => 0.2360, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists1: 6.98% (0.3440 => 0.3680, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3960 => 0.4120, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 2.39% (5.0200 => 5.1400, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.87% (1.2841 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (1.3841 => 1.4041, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.18% (1.3521 => 1.3681, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.17% (1.3721 => 1.3881, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/sieve: 10.26% (0.3120 => 0.3440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0866) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0132) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0494) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0060) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (4.9200 => 5.1400, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0339) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0369) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0283) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 2.45% (37.0925 => 38.0006, std.dev.: 0.0906) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0411) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.94% (48.1088 => 49.0408, std.dev.: 0.1079) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0415) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1450, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0119) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.89% (0.9321 => 1.1921, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0072) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0357) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0160) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0000) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0473) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0166) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.05% (3.3482 => 3.1122, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0110) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 17:05:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 19:05:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412000510.35D202A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24563?compare_to=24562&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24563, Order: 206046, Start Time: 2014-04-11 19:30:39, End Time: 2014-04-12 00:11:33 To: 24562, Order: 206039, Start Time: 2014-04-11 17:59:50, End Time: 2014-04-11 22:41:46 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (98 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 23.53% (0.0680 => 0.0840, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 16.13% (0.1240 => 0.1440, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 13.04% (0.0920 => 0.1040, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.09% (0.1320 => 0.1440, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.62% (0.2320 => 0.2520, std.dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: 1.19% (2.0201 => 2.0441, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.33% (0.1800 => 0.2040, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.19% (1.0961 => 1.1201, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.05% (1.3681 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (1.1680 => 1.1480, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1480 => 0.1680, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.50% (0.1600 => 0.1720, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0673) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.29% (1.2721 => 1.3521, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (6.0160 => 6.3520, std.dev.: 0.0514) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.2920 => 0.3080, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (8.1441 => 8.4241, std.dev.: 0.0562) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.14% (0.7640 => 0.7880, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0381) MultiSource/Applications/JM/lencod/lencod: 2.34% (17.6165 => 18.0285, std.dev.: 0.0510) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0308) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8166, std.dev.: 0.0769) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0062) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.53% (48.1088 => 48.8449, std.dev.: 0.1035) MultiSource/Applications/sqlite3/sqlite3: 1.52% (23.7574 => 24.1175, std.dev.: 0.0525) MultiSource/Applications/kimwitu++/kc: 1.28% (18.8170 => 19.0570, std.dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0201) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.33% (0.1800 => 0.2040, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0411) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.24% (10.8967 => 2.0441, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 18:50:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 20:50:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412015001.B57C62A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24564?compare_to=24555&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24564, Order: 206063, Start Time: 2014-04-11 21:08:40, End Time: 2014-04-12 01:56:27 To: 24555, Order: 206033, Start Time: 2014-04-11 16:05:40, End Time: 2014-04-11 20:53:40 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (136 on baseline) Performance Improvements: 2 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray2d: 100.00% (0.0160 => 0.0320, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/nestedloop: 60.00% (0.0200 => 0.0320, std.dev.: 0.0020) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.08% (0.0520 => 0.0640, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0031) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.52% (0.1680 => 0.1840, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.28% (1.1360 => 1.1960, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.81% (1.5481 => 1.5761, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.62% (1.9761 => 2.0081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.49% (1.6121 => 1.6361, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.51% (3.3722 => 3.5242, std.dev.: 0.0541) MultiSource/Applications/lemon/lemon: 3.25% (0.9841 => 1.0161, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.57% (2.0321 => 2.0001, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.09% (16.8843 => 16.7003, std.dev.: 0.0455) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 174.52% (11.3687 => 31.2099, std.dev.: 0.4927) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7484, std.dev.: 0.0052) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0103) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.18% (0.0680 => 0.0960, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0050) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/15-trie/trie: 21.43% (0.0560 => 0.0680, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0193) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.02% (1.5601 => 1.7321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.57% (1.8161 => 2.0081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.72% (1.4401 => 1.5801, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.18% (1.6121 => 1.7601, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (1.0240 => 1.1120, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.4961 => 1.6241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.19% (1.6121 => 1.7441, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.00% (0.7000 => 0.7560, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (1.1160 => 1.1960, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.95% (1.7841 => 1.9081, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.4680 => 6.8640, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (11.6440 => 12.3200, std.dev.: 0.0892) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 5.48% (0.5840 => 0.6160, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0323) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (9.4842 => 9.9842, std.dev.: 0.0349) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.21% (0.7680 => 0.8080, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0252) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0090) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.7400 => 1.8160, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0191) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (6.5440 => 6.7960, std.dev.: 0.0395) MultiSource/Applications/JM/lencod/lencod: 3.70% (21.9606 => 22.7728, std.dev.: 0.0527) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (6.5080 => 6.7360, std.dev.: 0.0299) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (10.0443 => 10.3923, std.dev.: 0.0406) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.36% (50.0290 => 51.7090, std.dev.: 0.1022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.8440 => 1.9040, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0281) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.13% (1.6601 => 1.7121, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (2.3281 => 2.4002, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 3.02% (38.4046 => 39.5646, std.dev.: 0.0744) MultiSource/Applications/oggenc/oggenc: 2.98% (6.9844 => 7.1924, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 2.79% (2.5840 => 2.6560, std.dev.: 0.0276) MultiSource/Benchmarks/MallocBench/gs/gs: 2.69% (5.3600 => 5.5040, std.dev.: 0.0505) MultiSource/Applications/siod/siod: 2.50% (2.7162 => 2.7842, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.3483 => 16.7003, std.dev.: 0.0455) MultiSource/Applications/SPASS/SPASS: 2.15% (18.4404 => 18.8365, std.dev.: 0.0709) MultiSource/Applications/ClamAV/clamscan: 1.97% (19.0444 => 19.4204, std.dev.: 0.0610) MultiSource/Applications/d/make_dparser: 1.71% (3.9681 => 4.0361, std.dev.: 0.0202) MultiSource/Applications/kimwitu++/kc: 1.60% (19.6891 => 20.0051, std.dev.: 0.0374) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.46% (2.1401 => 2.4282, std.dev.: 0.0502) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0356) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.71% (3.9842 => 4.0523, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.17% (10.6247 => 2.0001, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.63% (2.9442 => 0.6880, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.85% (1.5641 => 0.6280, std.dev.: 0.0070) MultiSource/Applications/obsequi/Obsequi: -5.78% (1.8680 => 1.7600, std.dev.: 0.0219) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.36% (91.8497 => 49.2711, std.dev.: 10.3973) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.47% (26.0616 => 17.0771, std.dev.: 0.1684) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.19% (50.3031 => 33.1021, std.dev.: 0.1378) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.64% (42.1466 => 28.8098, std.dev.: 0.3795) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1067) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (1.3761 => 1.3521, std.dev.: 0.0085) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0111) MultiSource/Benchmarks/sim/sim: -1.34% (4.7883 => 4.7243, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 18:52:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 20:52:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412015233.A07172A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24565?compare_to=24563&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24565, Order: 206063, Start Time: 2014-04-11 21:13:16, End Time: 2014-04-12 01:59:00 To: 24563, Order: 206046, Start Time: 2014-04-11 19:30:39, End Time: 2014-04-12 00:11:33 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (89 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (1007 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray: 125.00% (0.0160 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 57.14% (0.0280 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 33.33% (0.0600 => 0.0800, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.98% (0.2120 => 0.2480, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.48% (1.1280 => 1.1560, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.78% (1.3521 => 1.3761, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/spiff/spiff: 3.59% (2.0081 => 2.0801, std.dev.: 0.0270) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0058) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0158) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0160) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.34% (1.1441 => 1.2281, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.23% (1.2721 => 1.3641, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0538) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0194) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0548) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0422) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0314) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0300) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0330) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0500) MultiSource/Applications/JM/lencod/lencod: 2.29% (17.6165 => 18.0205, std.dev.: 0.0487) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (2.1201 => 2.1641, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 1.83% (37.0925 => 37.7725, std.dev.: 0.0741) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0496) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0087) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.56% (48.1088 => 48.8609, std.dev.: 0.1045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0126) MultiSource/Applications/siod/siod: 1.09% (2.5721 => 2.6001, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0262) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (0.6000 => 0.6160, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0299) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 18:53:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 20:53:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412015337.872D32A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24566?compare_to=24554&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24566, Order: 206063, Start Time: 2014-04-11 21:12:57, End Time: 2014-04-12 02:00:00 To: 24554, Order: 206032, Start Time: 2014-04-11 16:05:58, End Time: 2014-04-11 20:52:56 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (0 on baseline) Performance Improvements: 3 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-18-LoopBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.58% (1.7761 => 1.8041, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 57.14% (0.0280 => 0.0440, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 33.33% (0.0840 => 0.1120, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.17% (3.0762 => 3.0402, std.dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: -1.13% (2.8282 => 2.7962, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.01% (17.0043 => 16.8323, std.dev.: 0.0502) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0106) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 19:22:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 21:22:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140412022227.9A6782A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24567?compare_to=24557&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24567, Order: 206070, Start Time: 2014-04-11 21:39:54, End Time: 2014-04-12 02:28:53 To: 24557, Order: 206033, Start Time: 2014-04-11 16:29:43, End Time: 2014-04-11 21:19:14 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (122 on baseline) Performance Improvements: 4 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 21.43% (0.0560 => 0.0680, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 21.05% (0.0760 => 0.0920, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.1040 => 0.1240, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 15.79% (0.0760 => 0.0880, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 5.21% (0.3840 => 0.4040, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.34% (1.5560 => 1.6080, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.36% (2.0521 => 2.0801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.22% (2.3001 => 2.3281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.15% (2.0881 => 2.1121, std.dev.: 0.0074) SingleSource/Benchmarks/Stanford/Puzzle: 1.11% (1.8081 => 1.8281, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.97% (0.2680 => 0.2520, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.87% (1.0721 => 1.0521, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: -1.06% (7.1924 => 7.1164, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.01% (17.0123 => 16.8403, std.dev.: 0.0449) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0073) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.94% (1.7321 => 2.1121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.78% (1.7081 => 2.0801, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.23% (1.6961 => 2.0561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.98% (1.7921 => 2.1681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.70% (1.7201 => 2.0761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.59% (1.7481 => 2.1081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.00% (1.7401 => 2.0881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.53% (1.9641 => 2.3281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.46% (1.8201 => 2.1561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.77% (1.9801 => 2.3121, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.00% (0.0800 => 0.0920, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.11% (0.1480 => 0.1600, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (1.6481 => 1.7321, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.68% (11.7880 => 12.3400, std.dev.: 0.0920) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.46% (6.7200 => 7.0200, std.dev.: 0.0529) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0153) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (9.9842 => 10.3762, std.dev.: 0.0432) MultiSource/Applications/lua/lua: 3.92% (4.7920 => 4.9800, std.dev.: 0.0283) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (2.0680 => 2.1480, std.dev.: 0.0224) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.6801 => 1.7441, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (6.8321 => 7.0641, std.dev.: 0.0235) MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.1440 => 1.1800, std.dev.: 0.0133) MultiSource/Applications/d/make_dparser: 3.13% (3.9641 => 4.0881, std.dev.: 0.0269) MultiSource/Applications/oggenc/oggenc: 2.95% (6.9124 => 7.1164, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (10.3203 => 10.5844, std.dev.: 0.0466) MultiSource/Applications/SPASS/SPASS: 2.53% (18.4924 => 18.9606, std.dev.: 0.0485) MultiSource/Applications/JM/lencod/lencod: 2.53% (22.6287 => 23.2007, std.dev.: 0.0757) MultiSource/Applications/treecc/treecc: 2.44% (2.6200 => 2.6840, std.dev.: 0.0210) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.08% (51.1089 => 52.1729, std.dev.: 0.0911) MultiSource/Benchmarks/Bullet/bullet: 2.02% (38.9366 => 39.7246, std.dev.: 0.1005) MultiSource/Benchmarks/MallocBench/gs/gs: 1.87% (5.5480 => 5.6520, std.dev.: 0.0374) MultiSource/Applications/ClamAV/clamscan: 1.84% (20.2445 => 20.6165, std.dev.: 0.0502) MultiSource/Applications/kimwitu++/kc: 1.48% (19.7371 => 20.0291, std.dev.: 0.0637) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (16.5963 => 16.8403, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (4.2203 => 4.2803, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (3.0122 => 3.0522, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0244 => 6.1044, std.dev.: 0.0291) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7722 => 2.8002, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.00% (25.1895 => 25.4415, std.dev.: 0.0297) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.74% (6.6644 => 17.1771, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.40% (1.0921 => 1.1401, std.dev.: 0.0158) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9604 => 6.0684, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.7563 => 4.8203, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.45% (10.9087 => 2.0241, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.94% (6.2884 => 1.3241, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.45% (3.1762 => 1.2561, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/recursive: -44.44% (0.0360 => 0.0200, std.dev.: 0.0062) SingleSource/Regression/C++/EH/ConditionalExpr: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -33.24% (2.6481 => 1.7680, std.dev.: 0.0197) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.58% (7.5041 => 6.2600, std.dev.: 0.0585) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.53% (7.4801 => 6.2440, std.dev.: 0.0260) SingleSource/UnitTests/Vector/multiplies: -14.63% (0.1640 => 0.1400, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/05-eks/eks: -7.65% (0.6800 => 0.6280, std.dev.: 0.0196) MultiSource/Benchmarks/mafft/pairlocalalign: -3.40% (13.5243 => 13.0643, std.dev.: 0.0321) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0068) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0180) MultiSource/Benchmarks/sim/sim: -1.92% (4.9883 => 4.8923, std.dev.: 0.0286) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: -1.30% (11.6527 => 11.5007, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.04% (8.8486 => 8.7565, std.dev.: 0.0138) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 19:22:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 21:22:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412022245.CABD62A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24568?compare_to=24565&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24568, Order: 206070, Start Time: 2014-04-11 21:50:17, End Time: 2014-04-12 02:29:12 To: 24565, Order: 206063, Start Time: 2014-04-11 21:13:16, End Time: 2014-04-12 01:59:00 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (80 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (1017 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-26-Shorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 62.50% (0.0320 => 0.0520, std.dev.: 0.0066) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.12% (0.1320 => 0.1480, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.85% (1.2641 => 1.3001, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 1.22% (1.3161 => 1.3321, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.82% (0.1560 => 0.1760, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.07% (1.1601 => 1.3001, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.66% (1.1481 => 1.2361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0614) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.56% (1.3681 => 1.4441, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (6.0160 => 6.3320, std.dev.: 0.0667) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.6840 => 0.7160, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0110) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0334) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (10.4082 => 10.7002, std.dev.: 0.0305) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.70% (8.1441 => 8.3641, std.dev.: 0.0660) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0411) MultiSource/Applications/JM/lencod/lencod: 2.41% (17.6165 => 18.0405, std.dev.: 0.0481) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8885, std.dev.: 0.0534) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0271) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (7.8562 => 7.9882, std.dev.: 0.0368) MultiSource/Applications/sqlite3/sqlite3: 1.45% (23.7574 => 24.1015, std.dev.: 0.0656) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.39% (48.1088 => 48.7770, std.dev.: 0.1127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0319) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 19:45:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 21:45:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140412024519.0D20D2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24569?compare_to=24560&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24569, Order: 206070, Start Time: 2014-04-11 22:00:58, End Time: 2014-04-12 02:51:46 To: 24560, Order: 206037, Start Time: 2014-04-11 16:50:39, End Time: 2014-04-11 21:41:38 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 17 (125 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (954 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-SignedArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_shift: 27.27% (0.0440 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1560 => 0.1760, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.9720 => 1.0240, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.2960 => 0.3080, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 3.82% (0.6280 => 0.6520, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.71% (0.9361 => 0.9521, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.57% (2.0441 => 2.0761, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 11.11% (0.1800 => 0.2000, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 1.47% (1.0921 => 1.1081, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.50% (17.6723 => 19.5283, std.dev.: 0.0630) MultiSource/Applications/sqlite3/sqlite3: 1411.77% (1.7001 => 25.7016, std.dev.: 0.0413) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.79% (50.1010 => 51.5010, std.dev.: 0.1331) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (11.3920 => 12.2640, std.dev.: 0.0773) SingleSource/Benchmarks/Misc/oourafft: 175.10% (11.3407 => 31.1979, std.dev.: 0.1094) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0643, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0137) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0135) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0039) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 55.56% (0.0360 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_shift: 40.00% (0.0400 => 0.0560, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0068) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.17% (2.1361 => 2.4602, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.61% (1.8601 => 2.0761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0132) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.88% (1.9481 => 2.1601, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.06% (0.6360 => 0.7000, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.00% (0.1200 => 0.1320, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0091) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.43% (6.4800 => 6.8320, std.dev.: 0.0471) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (2.9721 => 3.1322, std.dev.: 0.0272) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.95% (0.7280 => 0.7640, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4400 => 0.4600, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.06% (1.5760 => 1.6400, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (5.8281 => 6.0641, std.dev.: 0.0381) MultiSource/Applications/SIBsim4/SIBsim4: 4.04% (1.7841 => 1.8561, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.84% (1.5640 => 1.6240, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (6.5320 => 6.7480, std.dev.: 0.0364) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.25% (0.6160 => 0.6360, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 3.17% (10.2283 => 10.5524, std.dev.: 0.0432) MultiSource/Applications/treecc/treecc: 3.09% (2.5880 => 2.6680, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 2.67% (4.7920 => 4.9200, std.dev.: 0.0310) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (5.3960 => 5.5400, std.dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (2.3401 => 2.3961, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.39% (6.5360 => 6.6920, std.dev.: 0.0597) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (16.3003 => 16.6843, std.dev.: 0.0302) MultiSource/Benchmarks/Bullet/bullet: 2.31% (38.6366 => 39.5286, std.dev.: 0.0630) MultiSource/Applications/JM/lencod/lencod: 2.18% (22.2206 => 22.7047, std.dev.: 0.0565) MultiSource/Applications/SPASS/SPASS: 2.07% (18.5284 => 18.9125, std.dev.: 0.0555) MultiSource/Applications/oggenc/oggenc: 1.81% (7.0524 => 7.1804, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (3.0562 => 3.1082, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 1.61% (3.9761 => 4.0401, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.14% (4.2243 => 4.2723, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.23% (2.1201 => 2.4642, std.dev.: 0.0410) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 2.79% (1.2881 => 1.3241, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 2.18% (6.5964 => 6.7404, std.dev.: 0.0388) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -77.00% (2.9562 => 0.6800, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.74% (1.5881 => 0.5600, std.dev.: 0.0067) MultiSource/Applications/obsequi/Obsequi: -5.97% (1.8760 => 1.7640, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.37% (94.8339 => 48.9671, std.dev.: 10.2956) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.13% (49.9431 => 32.8981, std.dev.: 0.2307) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.42% (25.7136 => 17.1211, std.dev.: 0.0907) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.73% (37.0863 => 28.6578, std.dev.: 0.5228) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.47% (1.2681 => 1.2241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0153) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 19:45:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 21:45:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140412024546.149172A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24570?compare_to=24559&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24570, Order: 206070, Start Time: 2014-04-11 22:02:35, End Time: 2014-04-12 02:52:12 To: 24559, Order: 206033, Start Time: 2014-04-11 16:50:39, End Time: 2014-04-11 21:40:22 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (159 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.29% (0.1120 => 0.1280, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: 7.35% (0.2720 => 0.2920, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.87% (1.0680 => 1.1200, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 3.90% (0.3080 => 0.3200, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.06% (1.3601 => 1.3881, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/nestedloop: 1.81% (0.6640 => 0.6760, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 1.16% (5.5360 => 5.6000, std.dev.: 0.0222) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 23.81% (0.0840 => 0.1040, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.44% (1.3241 => 1.3961, std.dev.: 0.0240) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2012.50% (0.0320 => 0.6760, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0102) SingleSource/Regression/C/sumarray2d: 1033.33% (0.0360 => 0.4080, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 742.11% (0.0760 => 0.6400, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 600.00% (0.0040 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 398.45% (0.2520 => 1.2561, std.dev.: 0.0116) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 279.35% (0.2320 => 0.8801, std.dev.: 0.0076) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0069) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0050) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0036) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0056) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.00% (1.2321 => 1.5401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0069) MultiSource/Applications/obsequi/Obsequi: 21.84% (1.3920 => 1.6960, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0089) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.39% (1.1761 => 1.4041, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 18.37% (8.5802 => 10.1563, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.24% (1.1841 => 1.4001, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.89% (1.2521 => 1.4761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.57% (1.2521 => 1.4721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.77% (1.2881 => 1.5041, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 15.96% (0.3760 => 0.4360, std.dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: 14.88% (19.5406 => 22.4487, std.dev.: 0.0584) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.87% (5.3360 => 6.0761, std.dev.: 0.0400) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0147) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/05-eks/eks: 9.15% (0.6120 => 0.6680, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 8.71% (11.3843 => 12.3763, std.dev.: 0.0543) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (5.6680 => 6.1440, std.dev.: 0.0360) MultiSource/Applications/oggenc/oggenc: 8.21% (6.2844 => 6.8004, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.14% (11.4440 => 12.3760, std.dev.: 0.0682) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.89% (5.7280 => 6.1800, std.dev.: 0.0432) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (9.5802 => 10.2282, std.dev.: 0.0222) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 5.26% (0.8360 => 0.8800, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3040 => 0.3200, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 4.01% (5.3840 => 5.6000, std.dev.: 0.0222) MultiSource/Applications/lua/lua: 3.77% (4.7720 => 4.9520, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.75% (6.8280 => 7.0160, std.dev.: 0.0471) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.69% (49.1529 => 50.4769, std.dev.: 0.1225) MultiSource/Applications/ClamAV/clamscan: 2.37% (19.2243 => 19.6804, std.dev.: 0.0654) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.12% (24.7575 => 25.2815, std.dev.: 0.0414) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (2.7282 => 2.7802, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 1.68% (39.0726 => 39.7286, std.dev.: 0.0620) MultiSource/Applications/kimwitu++/kc: 1.44% (19.7491 => 20.0331, std.dev.: 0.0530) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 17.75% (0.9241 => 1.0881, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.63% (3.9842 => 4.2883, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 6.40% (1.3121 => 1.3961, std.dev.: 0.0240) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.00% (1.1001 => 1.1441, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.56% (4.0563 => 4.1603, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.63% (11.0207 => 2.0241, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.66% (3.4442 => 3.0082, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0611) MultiSource/Applications/siod/siod: -6.30% (2.9842 => 2.7962, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.92% (4.9963 => 4.9003, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.84% (4.1243 => 4.0483, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0212) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.0963 => 5.0363, std.dev.: 0.0161) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 20:04:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 22:04:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412030454.0DF972A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24571?compare_to=24568&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24571, Order: 206076, Start Time: 2014-04-11 22:28:09, End Time: 2014-04-12 03:11:19 To: 24568, Order: 206070, Start Time: 2014-04-11 21:50:17, End Time: 2014-04-12 02:29:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (98 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 11.54% (0.1040 => 0.1160, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 6.86% (0.4080 => 0.4360, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 6.25% (0.1920 => 0.2040, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 3.05% (0.7880 => 0.8120, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.91% (1.2361 => 1.2721, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.55% (1.2921 => 1.3121, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (8.3641 => 8.4761, std.dev.: 0.0384) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.30% (0.9201 => 0.9321, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 1.01% (18.9450 => 19.1370, std.dev.: 0.0418) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/rem: -11.76% (0.1360 => 0.1200, std.dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0038) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (10.6960 => 11.3920, std.dev.: 0.0851) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0174) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0173) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (8.1441 => 8.4761, std.dev.: 0.0384) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0216) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0401) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0446) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0406) MultiSource/Benchmarks/Bullet/bullet: 2.70% (37.0925 => 38.0926, std.dev.: 0.0570) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0122) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.26% (48.1088 => 49.1970, std.dev.: 0.0621) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0310) MultiSource/Applications/sqlite3/sqlite3: 1.99% (23.7574 => 24.2295, std.dev.: 0.0559) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0170) MultiSource/Applications/kimwitu++/kc: 1.70% (18.8170 => 19.1370, std.dev.: 0.0418) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.53% (0.3040 => 0.3360, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0390) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/lists: 2.89% (5.8164 => 5.9844, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (5.0123 => 5.1243, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/pi: -66.67% (0.0240 => 0.0080, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -1.81% (2.8802 => 2.8282, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 20:41:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Apr 2014 22:41:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412034152.079F32A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24572?compare_to=24571&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24572, Order: 206079, Start Time: 2014-04-11 23:06:49, End Time: 2014-04-12 03:48:17 To: 24571, Order: 206076, Start Time: 2014-04-11 22:28:09, End Time: 2014-04-12 03:11:19 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (100 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C/bigstack: 57.14% (0.0280 => 0.0440, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 37.50% (0.0640 => 0.0880, std.dev.: 0.0036) MultiSource/Applications/aha/aha: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.34% (0.2320 => 0.2560, std.dev.: 0.0072) SingleSource/UnitTests/SignlessTypes/rem: 10.00% (0.1200 => 0.1320, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.96% (0.5400 => 0.5560, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.99% (2.0120 => 2.0520, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.62% (0.2320 => 0.2520, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 6.31% (1.9641 => 2.0881, std.dev.: 0.0208) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -20.00% (0.0600 => 0.0480, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0070) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0084) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.44% (1.2361 => 1.3281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0765) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0526) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0321) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (4.9200 => 5.0400, std.dev.: 0.0408) MultiSource/Benchmarks/Bullet/bullet: 2.44% (37.0925 => 37.9966, std.dev.: 0.0465) MultiSource/Applications/JM/lencod/lencod: 2.18% (17.6165 => 18.0005, std.dev.: 0.0492) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0316) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0382) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.75% (48.1088 => 48.9489, std.dev.: 0.1142) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (7.8562 => 7.9882, std.dev.: 0.0306) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.89% (0.9321 => 1.1921, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0429) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.37% (1.6601 => 1.7161, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0098) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (5.0123 => 5.1243, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.68% (4.5203 => 4.5963, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0309) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -1.13% (1.0601 => 1.0481, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.08% (1.4881 => 1.4721, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 22:10:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 00:10:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412051055.C04722A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24573?compare_to=24572&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24573, Order: 206088, Start Time: 2014-04-12 00:36:04, End Time: 2014-04-12 05:17:21 To: 24572, Order: 206079, Start Time: 2014-04-11 23:06:49, End Time: 2014-04-12 03:48:17 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (91 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (1004 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0012) SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/div: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Quicksort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 6.33% (0.3160 => 0.3360, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2400 => 0.2520, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 3.51% (0.4560 => 0.4720, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.11% (1.3281 => 1.3561, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0064) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.82% (0.1560 => 0.1760, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.98% (0.3280 => 0.3640, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0083) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0619) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0302) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0163) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (10.4082 => 10.7242, std.dev.: 0.0342) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0518) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0427) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 2.37% (37.0925 => 37.9726, std.dev.: 0.0634) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0272) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0386) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0249, std.dev.: 0.0901) MultiSource/Applications/kimwitu++/kc: 1.38% (18.8170 => 19.0770, std.dev.: 0.0365) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 4.51% (6.6564 => 6.9564, std.dev.: 0.0428) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0396) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones/fhourstones: -9.09% (0.1760 => 0.1600, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -2.22% (2.8802 => 2.8162, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 23:46:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 01:46:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412064648.163A42A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24574?compare_to=24564&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24574, Order: 206095, Start Time: 2014-04-12 02:05:24, End Time: 2014-04-12 06:53:14 To: 24564, Order: 206063, Start Time: 2014-04-11 21:08:40, End Time: 2014-04-12 01:56:27 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 20 (142 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C++/pointer_method2: 133.33% (0.0120 => 0.0280, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/UnitTests/member-function-pointers: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 26.67% (0.0600 => 0.0760, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/exptree: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 3.39% (0.4720 => 0.4880, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.61% (1.7441 => 1.7721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.29% (1.5481 => 1.5681, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: 1.20% (2.0001 => 2.0241, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.17% (6.8640 => 6.9440, std.dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.39% (0.0920 => 0.1080, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.26% (0.4560 => 0.4800, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/health/health: 5.15% (0.3880 => 0.4080, std.dev.: 0.0071) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 173.86% (11.3687 => 31.1339, std.dev.: 0.0574) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0084) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4600 => 1.8401, std.dev.: 0.0082) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/UnitTests/Vector/build: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0064) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.02% (1.0240 => 1.1880, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 12.50% (0.2240 => 0.2520, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 11.90% (0.3360 => 0.3760, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.92% (1.6121 => 1.7721, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (1.5521 => 1.7041, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.46% (1.7761 => 1.9441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.20% (1.6521 => 1.8041, std.dev.: 0.0193) MultiSource/Benchmarks/McCat/05-eks/eks: 9.09% (0.6600 => 0.7200, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.78% (1.5481 => 1.6841, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.4961 => 1.6241, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.29% (1.4481 => 1.5681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.91% (1.4161 => 1.5281, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.81% (0.7680 => 0.8280, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.36% (6.4680 => 6.9440, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.95% (1.6121 => 1.7241, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0113) SingleSource/Regression/C/bigstack: 6.52% (0.1840 => 0.1960, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.42% (11.6440 => 12.3920, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (5.8121 => 6.1241, std.dev.: 0.0457) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (9.4842 => 9.9842, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (6.5440 => 6.8720, std.dev.: 0.0377) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0228) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0223) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.0443 => 10.4843, std.dev.: 0.0477) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.7480 => 0.7800, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0183) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0145) MultiSource/Applications/JM/lencod/lencod: 4.21% (21.9606 => 22.8848, std.dev.: 0.0575) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0115) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.90% (50.0290 => 51.9810, std.dev.: 0.0562) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.87% (0.7240 => 0.7520, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (6.5080 => 6.7560, std.dev.: 0.0606) MultiSource/Benchmarks/MallocBench/gs/gs: 3.81% (5.3600 => 5.5640, std.dev.: 0.0488) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0277) MultiSource/Applications/oggenc/oggenc: 3.38% (6.9844 => 7.2205, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0325) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 3.00% (38.4046 => 39.5566, std.dev.: 0.1090) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 2.86% (18.4404 => 18.9685, std.dev.: 0.0572) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (3.0282 => 3.1122, std.dev.: 0.0111) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.72% (1.3240 => 1.3600, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (16.3483 => 16.7883, std.dev.: 0.0449) MultiSource/Applications/ClamAV/clamscan: 2.46% (19.0444 => 19.5124, std.dev.: 0.0597) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0235) MultiSource/Applications/kimwitu++/kc: 2.32% (19.6891 => 20.1451, std.dev.: 0.0429) MultiSource/Applications/lemon/lemon: 1.08% (1.4881 => 1.5041, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0210) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0563 => 13.1883, std.dev.: 0.0293) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.08% (2.1401 => 2.4842, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0041 => 1.0281, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 1.50% (6.6684 => 6.7684, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.41% (3.9842 => 4.0403, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.41% (3.9922 => 4.0483, std.dev.: 0.0192) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.36% (2.9442 => 0.6960, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -60.87% (1.5641 => 0.6120, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: -5.78% (1.8680 => 1.7600, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.14% (91.8497 => 49.4711, std.dev.: 10.6591) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.32% (50.3031 => 33.0381, std.dev.: 0.1698) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.29% (26.0616 => 17.1251, std.dev.: 0.1371) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.86% (42.1466 => 28.2978, std.dev.: 0.2974) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1134) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.04% (2.7002 => 2.4562, std.dev.: 0.0870) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.06% (0.3400 => 0.3160, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0130) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 23:47:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 01:47:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412064708.AAD752A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24575?compare_to=24573&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24575, Order: 206096, Start Time: 2014-04-12 02:07:58, End Time: 2014-04-12 06:53:34 To: 24573, Order: 206088, Start Time: 2014-04-12 00:36:04, End Time: 2014-04-12 05:17:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (92 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/test_indvars: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/UnitTests/2003-08-11-VaListArg: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 26.67% (0.0600 => 0.0760, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 7.25% (0.2760 => 0.2960, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.49% (0.6560 => 0.6920, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/05-eks/eks: 3.45% (0.6960 => 0.7200, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.55% (1.2881 => 1.3081, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 19.05% (0.0840 => 0.1000, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: -13.04% (0.0920 => 0.0800, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0107) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0599) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0340) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0564) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0182) MultiSource/Applications/spiff/spiff: 4.05% (0.9880 => 1.0280, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0228) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0346) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0562) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 2.14% (23.7574 => 24.2655, std.dev.: 0.0334) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0346) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.02% (48.1088 => 49.0809, std.dev.: 0.0705) MultiSource/Benchmarks/Bullet/bullet: 2.00% (37.0925 => 37.8326, std.dev.: 0.0795) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0256) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0171) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 5.17% (6.6564 => 7.0004, std.dev.: 0.0305) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.9443 => 5.0003, std.dev.: 0.0193) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -15.79% (0.0760 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.94% (0.2520 => 0.2320, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0352) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 11 23:49:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 01:49:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412064932.4E9512A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24576?compare_to=24566&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24576, Order: 206096, Start Time: 2014-04-12 02:09:00, End Time: 2014-04-12 06:55:59 To: 24566, Order: 206063, Start Time: 2014-04-11 21:12:57, End Time: 2014-04-12 02:00:00 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1097 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 30.77% (0.0520 => 0.0680, std.dev.: 0.0057) SingleSource/UnitTests/SignlessTypes/Large/cast: 28.57% (0.0560 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Oscar: 26.67% (0.0600 => 0.0760, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.39% (0.0920 => 0.1080, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 11.54% (0.1040 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.45% (12.4320 => 12.6120, std.dev.: 0.0488) MultiSource/Applications/siod/siod: 1.29% (2.7802 => 2.8162, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.17% (1.7121 => 1.7321, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (16.8323 => 17.0243, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.02% (1.9521 => 1.9721, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0108) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 4.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 00:08:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 02:08:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412070801.A21572A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24577?compare_to=24575&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24577, Order: 206097, Start Time: 2014-04-12 02:34:56, End Time: 2014-04-12 07:14:27 To: 24575, Order: 206096, Start Time: 2014-04-12 02:07:58, End Time: 2014-04-12 06:53:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (95 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (1001 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.84% (0.0760 => 0.1040, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 12.12% (0.1320 => 0.1480, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 1.97% (1.6241 => 1.6561, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.74% (0.9201 => 0.9361, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.60% (1.2481 => 1.2681, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 1.47% (1.3641 => 1.3841, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.37% (1.4641 => 1.4841, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (0.2320 => 0.2480, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 1.64% (0.7320 => 0.7440, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0781) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0330) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.39% (1.2521 => 1.3321, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0399) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0355) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0422) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0461) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0222) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0353) MultiSource/Applications/JM/lencod/lencod: 2.88% (17.6165 => 18.1245, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0284) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0240) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.7120 => 0.7280, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.09% (23.7574 => 24.2535, std.dev.: 0.0498) MultiSource/Benchmarks/Bullet/bullet: 2.06% (37.0925 => 37.8565, std.dev.: 0.0676) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.85% (48.1088 => 49.0009, std.dev.: 0.1069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0127) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.6321 => 1.6561, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0517) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 5.53% (6.6564 => 7.0244, std.dev.: 0.0338) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0128) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 00:18:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 02:18:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140412071823.D23A62A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24578?compare_to=24567&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24578, Order: 206097, Start Time: 2014-04-12 02:34:38, End Time: 2014-04-12 07:24:53 To: 24567, Order: 206070, Start Time: 2014-04-11 21:39:54, End Time: 2014-04-12 02:28:53 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 27 (142 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1084 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/Vector/sumarray: 100.00% (0.0160 => 0.0320, std.dev.: 0.0030) SingleSource/Regression/C++/EH/class_hierarchy: 66.67% (0.0240 => 0.0400, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 27.78% (0.0720 => 0.0920, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 23.53% (0.0680 => 0.0840, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.53% (0.0680 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0800 => 0.0960, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.73% (0.2040 => 0.2320, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.17% (0.2360 => 0.2600, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.82% (0.3520 => 0.3760, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 6.37% (0.6280 => 0.6680, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/18-imp/imp: 6.19% (0.4520 => 0.4800, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/chomp: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.76% (0.3360 => 0.3520, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4400 => 0.4600, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 3.35% (0.8360 => 0.8640, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.09% (2.0720 => 2.1360, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.88% (7.0200 => 7.1520, std.dev.: 0.0400) MultiSource/Applications/JM/ldecod/ldecod: 1.28% (10.5844 => 10.7204, std.dev.: 0.0369) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (10.3762 => 10.4922, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.11% (2.1561 => 2.1801, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0522 => 3.0842, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/compare: -42.86% (0.0280 => 0.0160, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0058) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0085) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0160 => 0.0320, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/Vector/simple: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 36.17% (0.1880 => 0.2560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 35.29% (0.0680 => 0.0920, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 26.92% (0.1040 => 0.1320, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.31% (1.7641 => 2.1401, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.04% (1.6921 => 2.0481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.40% (1.9801 => 2.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.13% (1.8081 => 2.1721, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.00% (0.1400 => 0.1680, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.69% (1.8281 => 2.1881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.55% (1.8001 => 2.1521, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.96% (1.9601 => 2.3121, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.97% (1.9801 => 2.3161, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.81% (0.1480 => 0.1640, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.80% (0.6120 => 0.6720, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 9.68% (0.1240 => 0.1360, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.9920 => 1.0600, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.82% (0.3520 => 0.3760, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0400) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.38% (0.1880 => 0.2000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0073) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (11.7880 => 12.5040, std.dev.: 0.0697) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (1.6481 => 1.7321, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0265) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.09% (9.9842 => 10.4922, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.4800 => 0.5040, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.50% (2.0440 => 2.1360, std.dev.: 0.0156) MultiSource/Applications/Burg/burg: 4.36% (1.5600 => 1.6280, std.dev.: 0.0211) MultiSource/Applications/d/make_dparser: 4.34% (3.9641 => 4.1361, std.dev.: 0.0298) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0151) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0481) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.94% (1.5240 => 1.5840, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0206) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.92% (0.4080 => 0.4240, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 3.88% (10.3203 => 10.7204, std.dev.: 0.0369) MultiSource/Applications/oggenc/oggenc: 3.82% (6.9124 => 7.1764, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (6.8321 => 7.0881, std.dev.: 0.0329) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0098) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.56% (1.3480 => 1.3960, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0077) MultiSource/Applications/SPASS/SPASS: 3.09% (18.4924 => 19.0646, std.dev.: 0.0653) MultiSource/Applications/JM/lencod/lencod: 3.06% (22.6287 => 23.3208, std.dev.: 0.0781) MultiSource/Applications/treecc/treecc: 2.90% (2.6200 => 2.6960, std.dev.: 0.0254) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.72% (51.1089 => 52.5009, std.dev.: 0.1384) MultiSource/Benchmarks/Bullet/bullet: 2.68% (38.9366 => 39.9806, std.dev.: 0.0911) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.5480 => 5.6880, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (16.5963 => 17.0003, std.dev.: 0.0460) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 2.33% (19.7371 => 20.1971, std.dev.: 0.0499) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 1.86% (20.2445 => 20.6205, std.dev.: 0.0782) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 1.52% (25.1895 => 25.5736, std.dev.: 0.0460) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0137) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (29.4578 => 29.7939, std.dev.: 0.0413) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0118) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.85% (4.7563 => 4.8443, std.dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.74% (4.1323 => 4.2043, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0272) MultiSource/Applications/lua/lua: 1.55% (21.6534 => 21.9894, std.dev.: 0.0593) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0093) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4041 => 1.4201, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.63% (6.2884 => 1.3441, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.99% (1.5881 => 0.5560, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.70% (3.1762 => 1.2481, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: -32.78% (2.6481 => 1.7800, std.dev.: 0.0177) MultiSource/Applications/sgefa/sgefa: -26.84% (0.7600 => 0.5560, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -17.07% (0.1640 => 0.1360, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.26% (7.4801 => 6.2640, std.dev.: 0.0453) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.05% (7.5041 => 6.3000, std.dev.: 0.0287) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: -2.66% (13.5243 => 13.1643, std.dev.: 0.0385) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -15.03% (7.8005 => 6.6284, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0421) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.22% (2.6202 => 2.5882, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 00:41:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 02:41:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140412074130.AA2BA2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24579?compare_to=24570&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24579, Order: 206100, Start Time: 2014-04-12 02:57:58, End Time: 2014-04-12 07:47:56 To: 24570, Order: 206070, Start Time: 2014-04-11 22:02:35, End Time: 2014-04-12 02:52:12 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 11 (151 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: 14.29% (0.0840 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 11.11% (0.1800 => 0.2000, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.89% (1.2280 => 1.2880, std.dev.: 0.0199) MultiSource/Applications/lua/lua: 1.62% (4.9520 => 5.0320, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.01% (16.7123 => 16.8803, std.dev.: 0.0637) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0102) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 752.63% (0.0760 => 0.6480, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 395.28% (0.2520 => 1.2481, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/nestedloop: 274.18% (0.2320 => 0.8681, std.dev.: 0.0102) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0078) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0065) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0059) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: 31.58% (0.1520 => 0.2000, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: 31.25% (0.0640 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.87% (1.2401 => 1.5361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.00% (1.2001 => 1.4761, std.dev.: 0.0119) MultiSource/Applications/obsequi/Obsequi: 22.99% (1.3920 => 1.7120, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.29% (1.2921 => 1.5801, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.84% (1.3001 => 1.5841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.52% (1.2281 => 1.4801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.42% (1.1361 => 1.3681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 19.72% (1.1561 => 1.3841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.08% (1.1321 => 1.3481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 18.93% (8.5802 => 10.2043, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 15.97% (19.5406 => 22.6607, std.dev.: 0.0494) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.17% (5.3360 => 6.0921, std.dev.: 0.0389) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.26% (1.7400 => 1.9360, std.dev.: 0.0281) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0068) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0085) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 9.21% (11.3843 => 12.4323, std.dev.: 0.0454) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.70% (11.4440 => 12.4400, std.dev.: 0.0347) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.45% (5.7280 => 6.2120, std.dev.: 0.0353) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.11% (0.1480 => 0.1600, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.26% (9.5802 => 10.2762, std.dev.: 0.0338) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.85% (5.6680 => 6.0560, std.dev.: 0.0612) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0150) MultiSource/Applications/lua/lua: 5.45% (4.7720 => 5.0320, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.82% (0.3320 => 0.3480, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0260) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.4760 => 1.5440, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.55% (1.2320 => 1.2880, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.04% (6.8280 => 7.1040, std.dev.: 0.0363) MultiSource/Benchmarks/MallocBench/gs/gs: 3.79% (5.3840 => 5.5880, std.dev.: 0.0338) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.63% (1.3240 => 1.3720, std.dev.: 0.0171) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.36% (49.1529 => 50.8049, std.dev.: 0.1225) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.6961 => 1.7521, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: 3.00% (19.2243 => 19.8004, std.dev.: 0.0422) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.7600 => 1.8120, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (2.7282 => 2.8002, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 2.57% (24.7575 => 25.3935, std.dev.: 0.0398) MultiSource/Benchmarks/Bullet/bullet: 1.84% (39.0726 => 39.7926, std.dev.: 0.0677) MultiSource/Applications/kimwitu++/kc: 1.78% (19.7491 => 20.1011, std.dev.: 0.0415) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0124 => 6.1004, std.dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.19% (29.3298 => 29.6779, std.dev.: 0.0600) MultiSource/Applications/SPASS/SPASS: 1.17% (18.7966 => 19.0165, std.dev.: 0.0602) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.03% (16.7083 => 16.8803, std.dev.: 0.0637) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.74% (6.6644 => 17.1771, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.83% (3.9842 => 4.2963, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0228) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 2.82% (6.8204 => 7.0124, std.dev.: 0.0348) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0400) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 1.97% (4.0563 => 4.1363, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0088) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0650) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0258) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0158) MultiSource/Benchmarks/sim/sim: -1.60% (4.9963 => 4.9163, std.dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0158) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 00:42:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 02:42:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140412074221.E93F72A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24580?compare_to=24569&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24580, Order: 206100, Start Time: 2014-04-12 02:57:32, End Time: 2014-04-12 07:48:49 To: 24569, Order: 206070, Start Time: 2014-04-11 22:00:58, End Time: 2014-04-12 02:51:46 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (131 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (949 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-09-18-BitFieldTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C++/BuiltinTypeInfo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/EH/simple_rethrow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0039) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.33% (0.2400 => 0.2600, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 2.34% (0.8560 => 0.8760, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7802 => 2.8162, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 11.54% (0.1040 => 0.1160, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.20% (17.6723 => 19.6524, std.dev.: 0.0474) MultiSource/Applications/sqlite3/sqlite3: 1420.71% (1.7001 => 25.8536, std.dev.: 0.0460) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.37% (50.1010 => 51.7890, std.dev.: 0.1017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.94% (11.3920 => 12.2960, std.dev.: 0.0689) SingleSource/Benchmarks/Misc/oourafft: 175.20% (11.3407 => 31.2099, std.dev.: 0.1161) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0483, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0080) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.28% (1.8201 => 2.0801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.90% (1.8921 => 2.1361, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: 11.54% (0.1040 => 0.1160, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.32% (1.9001 => 2.0961, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.8361 => 2.0241, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.67% (2.0681 => 2.2681, std.dev.: 0.0179) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.52% (0.1680 => 0.1840, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.81% (0.6360 => 0.6920, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (6.4800 => 6.8640, std.dev.: 0.0644) MultiSource/Applications/SIBsim4/SIBsim4: 5.83% (1.7841 => 1.8881, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 5.51% (1.0160 => 1.0720, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.7280 => 0.7680, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (1.6960 => 1.7800, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0220) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.50% (9.6042 => 10.0362, std.dev.: 0.0448) MultiSource/Applications/Burg/burg: 4.45% (1.5280 => 1.5960, std.dev.: 0.0203) MultiSource/Applications/hbd/hbd: 4.40% (1.7280 => 1.8040, std.dev.: 0.0267) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (5.8281 => 6.0761, std.dev.: 0.0313) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0177) MultiSource/Applications/JM/ldecod/ldecod: 4.03% (10.2283 => 10.6404, std.dev.: 0.0400) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (6.5320 => 6.7720, std.dev.: 0.0564) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0200) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0267) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (6.5360 => 6.7400, std.dev.: 0.0437) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (16.3003 => 16.7843, std.dev.: 0.0580) MultiSource/Applications/JM/lencod/lencod: 2.81% (22.2206 => 22.8448, std.dev.: 0.0707) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (2.3401 => 2.4002, std.dev.: 0.0113) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0221) MultiSource/Benchmarks/Bullet/bullet: 2.33% (38.6366 => 39.5366, std.dev.: 0.0756) MultiSource/Applications/SPASS/SPASS: 2.31% (18.5284 => 18.9565, std.dev.: 0.0605) MultiSource/Benchmarks/MallocBench/gs/gs: 2.15% (5.3960 => 5.5120, std.dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (3.0562 => 3.1122, std.dev.: 0.0141) MultiSource/Applications/kimwitu++/kc: 1.21% (19.8291 => 20.0691, std.dev.: 0.0511) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0440) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0334) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (4.0003 => 4.0963, std.dev.: 0.0244) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.58% (6.5964 => 6.7004, std.dev.: 0.0375) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.46% (2.9562 => 0.6960, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0072) MultiSource/Applications/obsequi/Obsequi: -5.54% (1.8760 => 1.7720, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.08% (94.8339 => 49.2391, std.dev.: 10.4146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.08% (49.9431 => 32.9221, std.dev.: 0.1212) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.81% (25.7136 => 17.0211, std.dev.: 0.1347) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.94% (37.0863 => 28.5778, std.dev.: 0.5054) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.92% (7.8165 => 6.7284, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 00:52:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 02:52:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412075243.150E62A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24581?compare_to=24577&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24581, Order: 206101, Start Time: 2014-04-12 03:15:39, End Time: 2014-04-12 07:59:08 To: 24577, Order: 206097, Start Time: 2014-04-12 02:34:56, End Time: 2014-04-12 07:14:27 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (91 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (1005 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/nestedloop: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 36.36% (0.0440 => 0.0600, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.88% (0.3400 => 0.3600, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.76% (0.5320 => 0.5520, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0090) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0134) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0702) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (6.0160 => 6.3640, std.dev.: 0.0432) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0207) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0226) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0229) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.03% (8.1441 => 8.4721, std.dev.: 0.0444) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0507) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0443) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0229) MultiSource/Applications/JM/lencod/lencod: 2.68% (17.6165 => 18.0885, std.dev.: 0.0697) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (4.9200 => 5.0360, std.dev.: 0.0437) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0300) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0389) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.85% (48.1088 => 48.9969, std.dev.: 0.0602) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.70% (2.1201 => 2.1561, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: 1.68% (37.0925 => 37.7166, std.dev.: 0.0912) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0479) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0111) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (5.0123 => 5.1243, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/perlin: -22.22% (0.0720 => 0.0560, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0012) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 02:17:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 04:17:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412091741.82B212A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24582?compare_to=24581&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24582, Order: 206103, Start Time: 2014-04-12 04:42:36, End Time: 2014-04-12 09:24:02 To: 24581, Order: 206101, Start Time: 2014-04-12 03:15:39, End Time: 2014-04-12 07:59:08 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (90 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (1005 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: 3.65% (0.7680 => 0.7960, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (1.7000 => 1.7560, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.75% (1.3721 => 1.3961, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (2.1561 => 2.1801, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 1.22% (1.3161 => 1.3321, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.08% (1.4881 => 1.4721, std.dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.82% (0.1560 => 0.1760, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0480) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0274) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0128) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2320 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0206) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0447) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0303) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0292) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.05% (37.0925 => 37.8526, std.dev.: 0.0708) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0329) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.76% (48.1088 => 48.9570, std.dev.: 0.0733) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0433) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0470) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/lists: 2.68% (5.8164 => 5.9724, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0293) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.00% (21.1533 => 21.3653, std.dev.: 0.0526) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/bmm/bmm: -19.05% (0.0840 => 0.0680, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.08% (1.4881 => 1.4721, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 02:55:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 04:55:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412095527.438D42A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24583?compare_to=24582&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24583, Order: 206104, Start Time: 2014-04-12 05:21:02, End Time: 2014-04-12 10:01:52 To: 24582, Order: 206103, Start Time: 2014-04-12 04:42:36, End Time: 2014-04-12 09:24:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (92 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/testtrace: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 17.95% (0.1560 => 0.1840, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 6.25% (0.3200 => 0.3400, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.63% (0.4320 => 0.4520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.35% (0.4600 => 0.4800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.27% (1.2561 => 1.2721, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (0.5920 => 0.6120, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (0.9721 => 0.9961, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0707) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0167) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0647) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0259) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.8000 => 5.9600, std.dev.: 0.0490) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0206) MultiSource/Applications/JM/lencod/lencod: 2.43% (17.6165 => 18.0445, std.dev.: 0.0585) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0351) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0281) MultiSource/Benchmarks/Bullet/bullet: 1.84% (37.0925 => 37.7766, std.dev.: 0.0673) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0047) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.72% (48.1088 => 48.9369, std.dev.: 0.1074) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 1.25% (18.8170 => 19.0530, std.dev.: 0.0278) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0347) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 04:35:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 06:35:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412113540.87DE92A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24584?compare_to=24583&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24584, Order: 206105, Start Time: 2014-04-12 06:56:47, End Time: 2014-04-12 11:42:06 To: 24583, Order: 206104, Start Time: 2014-04-12 05:21:02, End Time: 2014-04-12 10:01:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 5 (85 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1107 (1011 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 15.62% (0.1280 => 0.1480, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.11% (0.1480 => 0.1600, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0065) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0135) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0613) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0511) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0364) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (8.1441 => 8.4321, std.dev.: 0.0681) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0442) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/moments: 2.78% (0.4320 => 0.4440, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0458) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0490) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0547) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (2.1201 => 2.1641, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 2.07% (23.7574 => 24.2495, std.dev.: 0.0627) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0352) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.72% (48.1088 => 48.9370, std.dev.: 0.0790) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.69% (37.0925 => 37.7205, std.dev.: 0.0605) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.11% (6.6564 => 6.9964, std.dev.: 0.0369) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0227) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0193) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 04:37:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 06:37:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412113753.9B42D312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/24585?compare_to=24574&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24585, Order: 206105, Start Time: 2014-04-12 06:56:29, End Time: 2014-04-12 11:44:21 To: 24574, Order: 206095, Start Time: 2014-04-12 02:05:24, End Time: 2014-04-12 06:53:14 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 14 (125 on baseline) Performance Improvements: 3 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (958 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: 200.00% (0.0080 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.00% (0.0800 => 0.0960, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/ary3: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.54% (0.1040 => 0.1160, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.33% (0.1440 => 0.1560, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3040 => 0.3240, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 3.92% (0.6120 => 0.6360, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.27% (1.3761 => 1.4761, std.dev.: 0.0360) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/build: -50.00% (0.0240 => 0.0120, std.dev.: 0.0038) SingleSource/UnitTests/2003-08-05-CastFPToUint: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.61% (6.9440 => 6.8320, std.dev.: 0.0355) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: 173.40% (11.3687 => 31.0819, std.dev.: 0.0933) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0090) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0100) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 25.81% (0.1240 => 0.1560, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.17% (0.2360 => 0.2600, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.80% (0.2040 => 0.2240, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.43% (0.4240 => 0.4640, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.75% (1.5481 => 1.6681, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.59% (1.5281 => 1.6441, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.22% (1.1640 => 1.2480, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.41% (1.4361 => 1.5281, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.01% (11.6440 => 12.3440, std.dev.: 0.0616) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.65% (1.4161 => 1.4961, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.63% (6.4680 => 6.8320, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2160 => 0.2280, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.40% (9.4842 => 9.9962, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.29% (1.7401 => 1.8321, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.5480 => 1.6240, std.dev.: 0.0283) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.82% (5.8121 => 6.0921, std.dev.: 0.0399) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: 4.51% (1.5080 => 1.5760, std.dev.: 0.0252) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.0443 => 10.4763, std.dev.: 0.0416) MultiSource/Applications/JM/lencod/lencod: 4.24% (21.9606 => 22.8928, std.dev.: 0.0594) MultiSource/Benchmarks/MallocBench/gs/gs: 4.18% (5.3600 => 5.5840, std.dev.: 0.0263) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5440 => 6.8160, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (6.5080 => 6.7680, std.dev.: 0.0495) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.72% (2.0440 => 2.1200, std.dev.: 0.0275) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.56% (50.0290 => 51.8090, std.dev.: 0.0935) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (2.3281 => 2.4082, std.dev.: 0.0125) MultiSource/Applications/lua/lua: 3.43% (4.7880 => 4.9520, std.dev.: 0.0192) MultiSource/Applications/oggenc/oggenc: 3.04% (6.9844 => 7.1964, std.dev.: 0.0251) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0158) MultiSource/Applications/treecc/treecc: 2.94% (2.5840 => 2.6600, std.dev.: 0.0235) MultiSource/Benchmarks/Bullet/bullet: 2.91% (38.4046 => 39.5206, std.dev.: 0.0706) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (1.7320 => 1.7800, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (16.3483 => 16.7963, std.dev.: 0.0818) MultiSource/Applications/SPASS/SPASS: 2.73% (18.4404 => 18.9446, std.dev.: 0.0486) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.64% (3.0282 => 3.1082, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0151) MultiSource/Applications/ClamAV/clamscan: 2.21% (19.0444 => 19.4644, std.dev.: 0.0484) MultiSource/Applications/d/make_dparser: 2.12% (3.9681 => 4.0521, std.dev.: 0.0243) MultiSource/Applications/kimwitu++/kc: 1.77% (19.6891 => 20.0371, std.dev.: 0.0539) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 28.57% (0.9241 => 1.1881, std.dev.: 0.0357) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0507) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 8.21% (1.3641 => 1.4761, std.dev.: 0.0360) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (3.9922 => 4.0723, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9562 => 3.9962, std.dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.63% (2.9442 => 0.6880, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -59.34% (1.5641 => 0.6360, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -31.25% (0.0640 => 0.0440, std.dev.: 0.0064) MultiSource/Applications/obsequi/Obsequi: -6.21% (1.8680 => 1.7520, std.dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.10% (91.8497 => 49.5071, std.dev.: 10.3200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.20% (26.0616 => 17.1491, std.dev.: 0.1230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.17% (50.3031 => 33.1141, std.dev.: 0.1758) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.83% (42.1466 => 28.3098, std.dev.: 0.5319) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1107) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.21% (7.7845 => 6.7564, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.06% (0.3400 => 0.3160, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (4.8083 => 4.6483, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: -2.21% (2.3561 => 2.3041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (1.3761 => 1.3521, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0109) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.17% (2.7442 => 2.7122, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 04:39:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 06:39:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412113918.22F60312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/24586?compare_to=24576&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24586, Order: 206105, Start Time: 2014-04-12 06:59:18, End Time: 2014-04-12 11:45:45 To: 24576, Order: 206096, Start Time: 2014-04-12 02:09:00, End Time: 2014-04-12 06:55:59 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1095 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/printargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 60.00% (0.0400 => 0.0640, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0058) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 21.05% (0.0760 => 0.0920, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0061) MultiSource/Applications/viterbi/viterbi: 10.91% (0.2200 => 0.2440, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.78% (0.2360 => 0.2520, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 6.58% (0.3040 => 0.3240, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.41% (0.8160 => 0.8520, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/matrix: 4.17% (0.2880 => 0.3000, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.03% (6.2320 => 6.2960, std.dev.: 0.0221) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.07% (0.2920 => 0.3360, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.57% (1.7841 => 1.7561, std.dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0096) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 4.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 05:11:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 07:11:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140412121149.4B951312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/24587?compare_to=24578&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24587, Order: 206105, Start Time: 2014-04-12 07:28:06, End Time: 2014-04-12 12:18:15 To: 24578, Order: 206097, Start Time: 2014-04-12 02:34:38, End Time: 2014-04-12 07:24:53 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 19 (130 on baseline) Performance Improvements: 2 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/treeadd/treeadd: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Regression/C/sumarray: 18.75% (0.0640 => 0.0760, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.39% (0.0920 => 0.1080, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 17.24% (0.1160 => 0.1360, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.34% (0.1160 => 0.1280, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.89% (0.1800 => 0.1960, std.dev.: 0.0062) SingleSource/Benchmarks/SmallPT/smallpt: 8.11% (0.1480 => 0.1600, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 7.50% (0.3200 => 0.3440, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3320 => 0.3520, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 4.13% (0.4840 => 0.5040, std.dev.: 0.0049) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.01% (1.3960 => 1.4240, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.4880 => 0.5000, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.31% (17.0531 => 17.2771, std.dev.: 0.0824) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -21.74% (0.0920 => 0.0720, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -20.00% (0.0800 => 0.0640, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0088) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/dt: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.04% (1.6921 => 2.0481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.42% (1.7241 => 2.0761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.00% (0.1400 => 0.1680, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.68% (1.7681 => 2.1161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.57% (1.6961 => 2.0281, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.62% (1.8041 => 2.1401, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.60% (1.8281 => 2.1681, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.53% (1.7481 => 2.0721, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0052) SingleSource/Benchmarks/SmallPT/smallpt: 11.11% (0.1440 => 0.1600, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.42% (0.1920 => 0.2120, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.89% (3.5002 => 3.7762, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/oourafft: 7.50% (0.3200 => 0.3440, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (11.7880 => 12.6120, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (0.8601 => 0.9161, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 6.14% (0.4560 => 0.4840, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.68% (0.3520 => 0.3720, std.dev.: 0.0062) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.64% (1.3480 => 1.4240, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.48% (6.7200 => 7.0880, std.dev.: 0.0535) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.4160 => 1.4880, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0156) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.61% (9.9842 => 10.4442, std.dev.: 0.0422) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.44% (0.7200 => 0.7520, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (1.6481 => 1.7201, std.dev.: 0.0127) MultiSource/Applications/lua/lua: 4.34% (4.7920 => 5.0000, std.dev.: 0.0386) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.1440 => 1.1880, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (6.8321 => 7.0841, std.dev.: 0.0402) MultiSource/Applications/JM/ldecod/ldecod: 3.53% (10.3203 => 10.6844, std.dev.: 0.0380) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 3.24% (6.9124 => 7.1364, std.dev.: 0.0306) MultiSource/Applications/d/make_dparser: 3.23% (3.9641 => 4.0921, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.5000 => 0.5160, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 3.15% (22.6287 => 23.3408, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0192) MultiSource/Applications/SPASS/SPASS: 3.12% (18.4924 => 19.0685, std.dev.: 0.0459) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.7400 => 0.7600, std.dev.: 0.0078) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.33% (51.1089 => 52.3009, std.dev.: 0.0864) MultiSource/Benchmarks/Bullet/bullet: 2.06% (38.9366 => 39.7406, std.dev.: 0.0285) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (16.5963 => 16.9003, std.dev.: 0.0863) MultiSource/Applications/ClamAV/clamscan: 1.80% (20.2445 => 20.6085, std.dev.: 0.0526) MultiSource/Applications/kimwitu++/kc: 1.78% (19.7371 => 20.0891, std.dev.: 0.0449) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2203 => 4.2843, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (3.0122 => 3.0562, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 1.21% (25.1895 => 25.4935, std.dev.: 0.0531) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7722 => 2.8002, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0164) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.33% (3.4842 => 3.6002, std.dev.: 0.0300) MultiSource/Applications/minisat/minisat: 2.82% (6.8204 => 7.0124, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/whetstone: 1.95% (1.4361 => 1.4641, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.68% (21.6534 => 22.0174, std.dev.: 0.0566) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (4.7563 => 4.8203, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -78.75% (6.2884 => 1.3361, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/nestedloop: -64.91% (2.9642 => 1.0401, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -64.49% (1.5881 => 0.5640, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: -60.83% (3.1762 => 1.2441, std.dev.: 0.0107) MultiSource/Applications/obsequi/Obsequi: -33.39% (2.6481 => 1.7640, std.dev.: 0.0304) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.70% (7.4801 => 6.1560, std.dev.: 0.0716) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.10% (7.5041 => 6.2960, std.dev.: 0.0464) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0072) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -3.08% (13.5243 => 13.1083, std.dev.: 0.0380) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0271) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.04% (8.8486 => 8.7565, std.dev.: 0.0170) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 05:35:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 07:35:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140412123543.D8F73312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/24588?compare_to=24579&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24588, Order: 206105, Start Time: 2014-04-12 07:52:54, End Time: 2014-04-12 12:42:09 To: 24579, Order: 206100, Start Time: 2014-04-12 02:57:58, End Time: 2014-04-12 07:47:56 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (155 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: 38.46% (0.0520 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.43% (0.1400 => 0.1560, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: 8.11% (0.1480 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.38% (0.1880 => 0.2000, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.10% (0.3280 => 0.3480, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.78% (6.0560 => 6.1640, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.73% (1.3841 => 1.4081, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: -11.54% (0.1040 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.52% (1.5841 => 1.5601, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2000.00% (0.0320 => 0.6720, std.dev.: 0.0070) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0088) SingleSource/Regression/C/sumarray2d: 1033.33% (0.0360 => 0.4080, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 747.37% (0.0760 => 0.6440, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 392.10% (0.2520 => 1.2401, std.dev.: 0.0143) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 281.08% (0.2320 => 0.8841, std.dev.: 0.0082) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0091) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0063) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0073) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0068) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 53.85% (0.1040 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0113) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: 22.13% (1.3920 => 1.7000, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/puzzle: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.79% (1.1321 => 1.3561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.73% (1.1761 => 1.4081, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 19.07% (8.5802 => 10.2163, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.31% (1.1361 => 1.3441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.78% (0.1800 => 0.2120, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 15.48% (19.5406 => 22.5647, std.dev.: 0.0552) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.39% (5.3360 => 6.1041, std.dev.: 0.0302) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.56% (1.7400 => 1.9760, std.dev.: 0.0168) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.36% (0.1760 => 0.1960, std.dev.: 0.0058) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (11.3843 => 12.3963, std.dev.: 0.0337) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.75% (5.6680 => 6.1640, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 8.27% (6.2844 => 6.8044, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3480 => 0.3760, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.54% (5.7280 => 6.1600, std.dev.: 0.0426) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.41% (0.3240 => 0.3480, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.31% (11.4440 => 12.2800, std.dev.: 0.0991) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.64% (9.5802 => 10.2162, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.38% (0.1880 => 0.2000, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (5.3840 => 5.6280, std.dev.: 0.0231) MultiSource/Applications/lua/lua: 4.53% (4.7720 => 4.9880, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0200) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (1.3400 => 1.3840, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (6.8280 => 7.0480, std.dev.: 0.0552) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.05% (49.1529 => 50.6529, std.dev.: 0.0818) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.7600 => 1.8120, std.dev.: 0.0201) MultiSource/Applications/ClamAV/clamscan: 2.83% (19.2243 => 19.7684, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (2.0920 => 2.1480, std.dev.: 0.0186) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 2.28% (24.7575 => 25.3215, std.dev.: 0.0564) MultiSource/Applications/kimwitu++/kc: 1.44% (19.7491 => 20.0331, std.dev.: 0.0433) MultiSource/Benchmarks/Bullet/bullet: 1.28% (39.0726 => 39.5726, std.dev.: 0.0635) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.04% (29.3298 => 29.6339, std.dev.: 0.0571) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.74% (6.6644 => 17.1771, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0141) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.83% (3.3122 => 3.4722, std.dev.: 0.0367) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.93% (6.8204 => 7.0204, std.dev.: 0.0308) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 2.17% (4.0563 => 4.1443, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.63% (11.0207 => 2.0241, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0050) SingleSource/Benchmarks/Linpack/linpack-pc: -15.73% (7.8605 => 6.6244, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -8.64% (3.4722 => 3.1722, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0709) SingleSource/Benchmarks/BenchmarkGame/n-body: -6.07% (1.7121 => 1.6081, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0197) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 05:42:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 07:42:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140412124217.518F42A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24589?compare_to=24580&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24589, Order: 206105, Start Time: 2014-04-12 07:57:28, End Time: 2014-04-12 12:48:42 To: 24580, Order: 206100, Start Time: 2014-04-12 02:57:32, End Time: 2014-04-12 07:48:49 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 12 (138 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 57.14% (0.0280 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.43% (0.1400 => 0.1560, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 10.71% (0.2240 => 0.2480, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.00% (0.1200 => 0.1320, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.26% (2.1280 => 2.1760, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.12% (6.7720 => 6.8480, std.dev.: 0.0236) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.84% (17.6723 => 19.5884, std.dev.: 0.0534) MultiSource/Applications/sqlite3/sqlite3: 1417.65% (1.7001 => 25.8016, std.dev.: 0.0435) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.60% (50.1010 => 51.9050, std.dev.: 0.0770) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (1.0520 => 1.1080, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.20% (11.3920 => 12.4400, std.dev.: 0.0560) SingleSource/Benchmarks/Misc/oourafft: 175.13% (11.3407 => 31.2020, std.dev.: 0.0741) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0443, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3521, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0113) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 322.25% (0.4320 => 1.8241, std.dev.: 0.0075) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0040) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0062) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Towers: 23.08% (0.0520 => 0.0640, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.1280 => 0.1560, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.71% (1.8761 => 2.1521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.76% (1.8601 => 2.1161, std.dev.: 0.0194) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.68% (1.9241 => 2.1681, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.55% (1.9121 => 2.1521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4122, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.55% (2.1121 => 2.3561, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.50% (1.8081 => 2.0161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.43% (0.1400 => 0.1560, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.53% (1.9001 => 2.1001, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.8361 => 2.0241, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 7.14% (0.6160 => 0.6600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.2240 => 0.2400, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0460) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0160) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.4760 => 0.5040, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0084) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (6.5320 => 6.8480, std.dev.: 0.0236) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (9.6042 => 10.0402, std.dev.: 0.0399) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (1.0840 => 1.1320, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.2283 => 10.6764, std.dev.: 0.0324) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (5.8281 => 6.0681, std.dev.: 0.0207) MultiSource/Applications/Burg/burg: 3.93% (1.5280 => 1.5880, std.dev.: 0.0221) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0126) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (5.3960 => 5.5960, std.dev.: 0.0448) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3360 => 0.3480, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 3.55% (2.5880 => 2.6800, std.dev.: 0.0247) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0092) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.25% (0.6160 => 0.6360, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 3.24% (1.7280 => 1.7840, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (16.3003 => 16.8083, std.dev.: 0.0487) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0428) MultiSource/Applications/JM/lencod/lencod: 2.88% (22.2206 => 22.8608, std.dev.: 0.0557) MultiSource/Applications/lua/lua: 2.75% (4.7920 => 4.9240, std.dev.: 0.0305) MultiSource/Applications/SPASS/SPASS: 2.55% (18.5284 => 19.0006, std.dev.: 0.0495) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (2.1240 => 2.1760, std.dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 2.38% (7.0524 => 7.2205, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 2.21% (38.6366 => 39.4886, std.dev.: 0.0741) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 1.53% (19.8291 => 20.1331, std.dev.: 0.0354) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (4.2243 => 4.2843, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0519) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0295) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.62% (1.6561 => 1.7161, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: 2.54% (2.0441 => 2.0961, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: 1.64% (6.5964 => 6.7044, std.dev.: 0.0324) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0167) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -76.05% (2.9562 => 0.7080, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -65.49% (1.5881 => 0.5480, std.dev.: 0.0108) MultiSource/Applications/obsequi/Obsequi: -5.12% (1.8760 => 1.7800, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.33% (94.8339 => 49.0031, std.dev.: 10.2369) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.06% (49.9431 => 32.9301, std.dev.: 0.2317) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.93% (25.7136 => 16.9891, std.dev.: 0.1577) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.12% (37.0863 => 28.5138, std.dev.: 0.4710) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.92% (3.0722 => 2.3681, std.dev.: 0.1093) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.1563 => 5.0963, std.dev.: 0.0188) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 09:30:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 11:30:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412163006.8044B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24590?compare_to=24585&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24590, Order: 206106, Start Time: 2014-04-12 11:56:43, End Time: 2014-04-12 16:36:22 To: 24585, Order: 206105, Start Time: 2014-04-12 06:56:29, End Time: 2014-04-12 11:44:21 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 3 (1 on baseline) Performance Regressions: 22 (139 on baseline) Performance Improvements: 3 (20 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 0 (2 on baseline) Unchanged Tests: 1084 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: -0.85% (51.8090 => 51.3690, std.dev.: 0.1079) SingleSource/Benchmarks/Misc/oourafft: -97.92% (31.0819 => 0.6480, std.dev.: 0.0067) New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -100.00% (6.7364 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-14-AtExit: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 66.05% (0.6360 => 1.0561, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 36.36% (0.0440 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 33.14% (0.6880 => 0.9160, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.00% (0.0960 => 0.1200, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: 15.98% (1.7520 => 2.0320, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 14.29% (0.0840 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0075) MultiSource/Applications/aha/aha: 13.33% (0.1200 => 0.1360, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.64% (0.3760 => 0.4160, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.33% (0.1920 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.14% (0.3440 => 0.3720, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.7200 => 0.7760, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 3.94% (0.5080 => 0.5280, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.86% (0.4200 => 0.4320, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.01% (1.1960 => 1.2200, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.46% (1.6441 => 1.6681, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4326 => 0.0000) MultiSource/Applications/oggenc/oggenc: -11.11% (0.1440 => 0.1280, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.46% (1.1401 => 1.1121, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/7zip/7zip-benchmark: 2.68% (50.0290 => 51.3690, std.dev.: 0.1079) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0119) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-14-AtExit: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 36.36% (0.0880 => 0.1200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.14% (1.0240 => 1.2200, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.81% (0.3240 => 0.3720, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.3640 => 0.4160, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0075) SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.23% (0.7040 => 0.7760, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.45% (1.7361 => 1.9001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (1.0240 => 1.1160, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.89% (1.4401 => 1.5681, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0123) MultiSource/Applications/obsequi/Obsequi: 8.78% (1.8680 => 2.0320, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.68% (1.6121 => 1.7521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.62% (1.4841 => 1.6121, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.29% (1.4961 => 1.6201, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.72% (1.5480 => 1.6520, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0126) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.00% (6.4680 => 6.8560, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.91% (11.6440 => 12.3320, std.dev.: 0.0559) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (2.0440 => 2.1560, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0190) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.23% (9.4842 => 9.9802, std.dev.: 0.0312) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.92% (0.2440 => 0.2560, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 4.76% (0.5040 => 0.5280, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (10.0443 => 10.4883, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.7400 => 1.8160, std.dev.: 0.0289) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2760 => 0.2880, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0241) MultiSource/Applications/JM/lencod/lencod: 4.14% (21.9606 => 22.8688, std.dev.: 0.0576) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (6.5440 => 6.8040, std.dev.: 0.0311) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (6.5080 => 6.7640, std.dev.: 0.0425) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (5.8121 => 6.0361, std.dev.: 0.0516) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0161) MultiSource/Applications/lua/lua: 3.59% (4.7880 => 4.9600, std.dev.: 0.0188) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (5.3600 => 5.5520, std.dev.: 0.0308) MultiSource/Applications/hexxagon/hexxagon: 3.55% (1.1280 => 1.1680, std.dev.: 0.0149) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0158) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (2.3281 => 2.4002, std.dev.: 0.0115) MultiSource/Applications/treecc/treecc: 2.94% (2.5840 => 2.6600, std.dev.: 0.0225) MultiSource/Applications/SPASS/SPASS: 2.86% (18.4404 => 18.9684, std.dev.: 0.0441) MultiSource/Benchmarks/Bullet/bullet: 2.68% (38.4046 => 39.4326, std.dev.: 0.0594) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (16.3483 => 16.7843, std.dev.: 0.0498) MultiSource/Applications/ClamAV/clamscan: 2.46% (19.0444 => 19.5124, std.dev.: 0.0472) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (3.0282 => 3.1002, std.dev.: 0.0166) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.1843 => 4.2763, std.dev.: 0.0156) MultiSource/Applications/kimwitu++/kc: 1.73% (19.6891 => 20.0291, std.dev.: 0.0498) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (13.0563 => 13.1923, std.dev.: 0.0231) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0487) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.12% (1.6521 => 1.7201, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: 2.91% (7.4205 => 7.6365, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.44% (6.6684 => 6.7644, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.89% (2.9442 => 0.9160, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.48% (1.5641 => 1.0561, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4566 => 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.18% (91.8497 => 49.4351, std.dev.: 9.8404) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.61% (50.3031 => 32.8941, std.dev.: 0.2223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.38% (26.0616 => 17.1011, std.dev.: 0.1729) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.71% (42.1466 => 28.3618, std.dev.: 0.5306) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1132) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.74% (1.3761 => 1.3521, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.09% (4.0283 => 3.9842, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -94.30% (11.3687 => 0.6480, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 09:31:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 11:31:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412163125.DA85B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24591?compare_to=24584&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24591, Order: 206106, Start Time: 2014-04-12 11:56:52, End Time: 2014-04-12 16:37:49 To: 24584, Order: 206105, Start Time: 2014-04-12 06:56:47, End Time: 2014-04-12 11:42:06 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (84 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (1010 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 400.00% (0.0040 => 0.0200, std.dev.: 0.0018) SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/lowercase: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C++/EH/class_hierarchy: 66.67% (0.0240 => 0.0400, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.33% (0.0360 => 0.0480, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.56% (0.2360 => 0.2680, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 13.51% (0.1480 => 0.1680, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.60% (0.6160 => 0.6320, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.83% (1.3081 => 1.3321, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.82% (1.3201 => 1.3441, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.50% (1.3321 => 1.3521, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.20% (6.3480 => 6.4240, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.12% (4.9840 => 5.0400, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.5880 => 0.6160, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.49% (3.9002 => 4.0363, std.dev.: 0.0405) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.94% (1.0881 => 1.1201, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -33.33% (0.0480 => 0.0320, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0609) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.39% (1.2521 => 1.3321, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0325) MultiSource/Applications/spiff/spiff: 4.05% (0.9880 => 1.0280, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0221) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0269) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0183) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0348) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.48% (37.0925 => 37.6406, std.dev.: 0.0854) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0113) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.36% (48.1088 => 48.7609, std.dev.: 0.1093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0461) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0117) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0120) MultiSource/Benchmarks/Fhourstones/fhourstones: -15.91% (0.1760 => 0.1480, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 09:37:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 11:37:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412163720.2E2E019BE001@llvm.org> http://llvm.org/perf/db_default/v4/nts/24592?compare_to=24586&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24592, Order: 206106, Start Time: 2014-04-12 11:56:42, End Time: 2014-04-12 16:43:39 To: 24586, Order: 206105, Start Time: 2014-04-12 06:59:18, End Time: 2014-04-12 11:45:45 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1098 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 98.67% (0.5920 => 1.1761, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 60.00% (0.0200 => 0.0320, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/mst/mst: 21.87% (0.1280 => 0.1560, std.dev.: 0.0087) SingleSource/Regression/C/test_indvars: 21.74% (0.0920 => 0.1120, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: 17.46% (1.7640 => 2.0720, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout/nestedloop: 12.54% (1.1161 => 1.2561, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.04% (1.3281 => 1.4481, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.36% (5.4123 => 5.5403, std.dev.: 0.0426) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -37.62% (1.3081 => 0.8160, std.dev.: 0.0150) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 09:41:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 11:41:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412164154.E550D19BE001@llvm.org> http://llvm.org/perf/db_default/v4/nts/24593?compare_to=24591&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24593, Order: 206107, Start Time: 2014-04-12 12:07:23, End Time: 2014-04-12 16:48:20 To: 24591, Order: 206106, Start Time: 2014-04-12 11:56:52, End Time: 2014-04-12 16:37:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (84 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (1012 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-06-IntOverflow: 200.00% (0.0080 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.41% (0.0680 => 0.0880, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/matrix: 7.58% (0.2640 => 0.2840, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.35% (1.5320 => 1.5680, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.27% (1.2361 => 1.2641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.80% (1.3321 => 1.3561, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.44% (1.3841 => 1.4041, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: -100.00% (0.0160 => 0.0000, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.27% (1.1561 => 1.2401, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (10.6960 => 11.3000, std.dev.: 0.0931) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0247) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (8.1441 => 8.4641, std.dev.: 0.0542) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0232) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0333) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (5.8000 => 5.9720, std.dev.: 0.0617) MultiSource/Applications/JM/lencod/lencod: 2.79% (17.6165 => 18.1085, std.dev.: 0.0472) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.58% (1.7080 => 1.7520, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: 2.22% (1.2640 => 1.2920, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0276) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0054) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.65% (48.1088 => 48.9009, std.dev.: 0.1099) MultiSource/Benchmarks/Bullet/bullet: 1.60% (37.0925 => 37.6846, std.dev.: 0.0586) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.05% (1.1480 => 1.1600, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 5.41% (6.6564 => 7.0164, std.dev.: 0.0329) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.37% (1.6601 => 1.7161, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) SingleSource/Benchmarks/SmallPT/smallpt: 1.23% (14.0009 => 14.1729, std.dev.: 0.0300) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 10:06:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 12:06:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140412170612.9EB2B2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24594?compare_to=24587&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24594, Order: 206107, Start Time: 2014-04-12 12:22:42, End Time: 2014-04-12 17:12:40 To: 24587, Order: 206105, Start Time: 2014-04-12 07:28:06, End Time: 2014-04-12 12:18:15 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (125 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (952 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 108.53% (0.5640 => 1.1761, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/exptree: 26.09% (0.0920 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/almabench: 22.22% (0.0720 => 0.0880, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: 17.91% (1.7640 => 2.0800, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout/lists: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/nestedloop: 12.69% (1.0401 => 1.1721, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.97% (1.2441 => 1.3681, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.17% (1.2600 => 1.3000, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.11% (0.1800 => 0.2000, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.30% (5.3963 => 5.5203, std.dev.: 0.0421) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.05% (4.6843 => 4.7803, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout/hash: 1.32% (4.2523 => 4.3083, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -35.33% (1.3361 => 0.8640, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0089) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0065) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/exptree: 26.09% (0.0920 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.00% (1.7401 => 2.0881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.86% (1.6921 => 2.0281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.64% (1.8881 => 2.2401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0187) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0081) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.14% (11.7880 => 12.5120, std.dev.: 0.0704) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.00% (0.2000 => 0.2120, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.36% (6.7200 => 7.0800, std.dev.: 0.0482) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0117) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (1.2400 => 1.3000, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.5240 => 1.5960, std.dev.: 0.0173) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.45% (9.9842 => 10.4282, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0267) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (1.6481 => 1.7201, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0062) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.86% (1.3480 => 1.4000, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (6.8321 => 7.0841, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3480 => 0.3600, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 3.41% (6.9124 => 7.1484, std.dev.: 0.0239) MultiSource/Applications/JM/ldecod/ldecod: 3.37% (10.3203 => 10.6684, std.dev.: 0.0473) MultiSource/Applications/SPASS/SPASS: 3.29% (18.4924 => 19.1005, std.dev.: 0.0549) MultiSource/Applications/d/make_dparser: 3.13% (3.9641 => 4.0881, std.dev.: 0.0334) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 2.80% (1.1440 => 1.1760, std.dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 2.72% (22.6287 => 23.2447, std.dev.: 0.0624) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.32% (51.1089 => 52.2929, std.dev.: 0.1138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (16.5963 => 16.9403, std.dev.: 0.0671) MultiSource/Applications/ClamAV/clamscan: 2.04% (20.2445 => 20.6565, std.dev.: 0.0793) MultiSource/Benchmarks/Bullet/bullet: 1.93% (38.9366 => 39.6886, std.dev.: 0.0759) MultiSource/Applications/kimwitu++/kc: 1.86% (19.7371 => 20.1051, std.dev.: 0.0497) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (3.0122 => 3.0602, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.49% (25.1895 => 25.5656, std.dev.: 0.0271) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.33% (4.2203 => 4.2763, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0244 => 6.1004, std.dev.: 0.0198) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.86% (6.6644 => 17.1851, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.72% (0.9281 => 1.1761, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0123) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.39% (1.6521 => 1.7081, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.21% (3.4842 => 3.5962, std.dev.: 0.0317) MultiSource/Applications/minisat/minisat: 2.70% (6.8204 => 7.0044, std.dev.: 0.0416) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.95% (1.4361 => 1.4641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 1.44% (21.6534 => 21.9654, std.dev.: 0.0874) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.43% (4.7563 => 4.8243, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/hash: 1.13% (4.2603 => 4.3083, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.26% (6.2884 => 0.8640, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0356) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0072) MultiSource/Applications/obsequi/Obsequi: -21.45% (2.6481 => 2.0800, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.01% (7.4801 => 6.2080, std.dev.: 0.0483) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.53% (7.5041 => 6.2640, std.dev.: 0.0486) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0076) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: -3.16% (13.5243 => 13.0963, std.dev.: 0.0458) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.39% (5.8884 => 5.5123, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7603 => 4.6763, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0154) MultiSource/Benchmarks/sim/sim: -1.68% (4.9883 => 4.9043, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.35% (3.8442 => 3.7922, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.22% (2.6202 => 2.5882, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.04% (8.8486 => 8.7565, std.dev.: 0.0156) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (2.3401 => 2.3161, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 10:29:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 12:29:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140412172959.6B4982A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24595?compare_to=24588&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24595, Order: 206107, Start Time: 2014-04-12 12:46:39, End Time: 2014-04-12 17:36:26 To: 24588, Order: 206105, Start Time: 2014-04-12 07:52:54, End Time: 2014-04-12 12:42:09 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (157 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/short_circuit_dtor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/Vector/sumarray-dbl: 133.33% (0.0120 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 29.21% (0.6440 => 0.8321, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0560 => 0.0720, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/nestedloop: 17.86% (0.6720 => 0.7920, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: 16.00% (1.7000 => 1.9720, std.dev.: 0.0216) MultiSource/Benchmarks/Olden/em3d/em3d: 15.69% (0.2040 => 0.2360, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/nestedloop: 12.67% (0.8841 => 0.9961, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.11% (0.1480 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.81% (0.2560 => 0.2760, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.04% (1.5441 => 1.5601, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 16.00% (0.1000 => 0.1160, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.98% (0.9401 => 0.9681, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -38.71% (1.2401 => 0.7600, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0104) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0078) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 994.87% (0.0760 => 0.8321, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: 329.35% (0.2320 => 0.9961, std.dev.: 0.0115) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0107) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0052) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0047) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0069) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 48.86% (0.7040 => 1.0480, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0044) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: 41.67% (1.3920 => 1.9720, std.dev.: 0.0216) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.67% (1.2321 => 1.5361, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.75% (1.2481 => 1.5321, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.73% (1.1761 => 1.4081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 18.65% (8.5802 => 10.1803, std.dev.: 0.0449) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 18.31% (1.1361 => 1.3441, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 15.72% (19.5406 => 22.6127, std.dev.: 0.0489) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.32% (5.3360 => 6.1001, std.dev.: 0.0375) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.64% (0.1760 => 0.2000, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0055) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary: 10.00% (0.2800 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.52% (0.2520 => 0.2760, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 9.38% (11.3843 => 12.4523, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.75% (5.6680 => 6.1640, std.dev.: 0.0315) MultiSource/Benchmarks/McCat/05-eks/eks: 8.50% (0.6120 => 0.6640, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.45% (5.7280 => 6.2120, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.35% (11.4440 => 12.4000, std.dev.: 0.0325) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 8.15% (6.2844 => 6.7964, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (9.5802 => 10.2122, std.dev.: 0.0333) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.76% (0.7640 => 0.8080, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.69% (1.1240 => 1.1880, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0074) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.9800 => 1.0280, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/gs/gs: 3.57% (5.3840 => 5.5760, std.dev.: 0.0394) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 3.27% (4.7720 => 4.9280, std.dev.: 0.0354) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.21% (49.1529 => 50.7289, std.dev.: 0.0776) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.7600 => 1.8080, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: 2.56% (19.2243 => 19.7164, std.dev.: 0.0558) MultiSource/Applications/sqlite3/sqlite3: 2.39% (24.7575 => 25.3495, std.dev.: 0.0393) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (2.7282 => 2.7802, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: 1.60% (19.7491 => 20.0651, std.dev.: 0.0429) MultiSource/Benchmarks/Bullet/bullet: 1.35% (39.0726 => 39.6006, std.dev.: 0.0520) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.00% (0.2400 => 0.2640, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.05% (0.9881 => 1.0281, std.dev.: 0.0107) MultiSource/Applications/minisat/minisat: 2.82% (6.8204 => 7.0124, std.dev.: 0.0310) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.17% (4.0563 => 4.1443, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0162) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0079) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -9.10% (3.4722 => 3.1562, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0852) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0096) MultiSource/Applications/siod/siod: -5.76% (2.9842 => 2.8122, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.04% (4.1243 => 4.0403, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -1.84% (4.9963 => 4.9043, std.dev.: 0.0151) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3401 => 2.3041, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0232) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 10:30:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 12:30:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140412173009.503CC2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24596?compare_to=24589&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24596, Order: 206107, Start Time: 2014-04-12 12:53:10, End Time: 2014-04-12 17:36:32 To: 24589, Order: 206105, Start Time: 2014-04-12 07:57:28, End Time: 2014-04-12 12:48:42 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Failures: 3 (0 on baseline) New Passes: 0 (8 on baseline) Performance Regressions: 17 (139 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 0 (3 on baseline) Unchanged Tests: 1091 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: -0.69% (51.9050 => 51.5450, std.dev.: 0.1056) SingleSource/Benchmarks/Misc/oourafft: -97.96% (31.2020 => 0.6360, std.dev.: 0.0100) New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -100.00% (6.7284 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C/2008-01-07-LongDouble: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/Vector/divides: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 94.18% (0.5480 => 1.0641, std.dev.: 0.0066) SingleSource/Regression/C/sumarray: 66.67% (0.0240 => 0.0400, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.51% (0.7080 => 0.9240, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 13.71% (1.7800 => 2.0240, std.dev.: 0.0299) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 7.89% (0.1520 => 0.1640, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.4440 => 0.4640, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.51% (0.4560 => 0.4720, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.13% (2.1161 => 2.1401, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.00% (0.7200 => 0.7560, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4326 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: 11.09% (17.6723 => 19.6324, std.dev.: 0.0513) MultiSource/Applications/sqlite3/sqlite3: 1418.83% (1.7001 => 25.8216, std.dev.: 0.0419) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (1.0520 => 1.0840, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.95% (11.3920 => 12.4120, std.dev.: 0.0466) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0603, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0162) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0053) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0024) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.05% (1.8601 => 2.1401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.20% (1.9721 => 2.2521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.01% (1.8561 => 2.1161, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.93% (1.9521 => 2.2241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.53% (1.8921 => 2.1481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.49% (2.1361 => 2.4242, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.76% (1.9121 => 2.1561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.87% (1.9201 => 2.1481, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (1.9761 => 2.2041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (0.1800 => 0.2000, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0141) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/09-vor/vor: 10.64% (0.3760 => 0.4160, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.43% (0.6360 => 0.6960, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.21% (0.3040 => 0.3320, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: 7.89% (1.8760 => 2.0240, std.dev.: 0.0299) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 7.14% (0.6160 => 0.6600, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0101) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (6.4800 => 6.8520, std.dev.: 0.0372) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.26% (1.7480 => 1.8400, std.dev.: 0.0194) MultiSource/Applications/Burg/burg: 5.24% (1.5280 => 1.6080, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4400 => 0.4600, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (9.6042 => 10.0282, std.dev.: 0.0344) MultiSource/Applications/hbd/hbd: 4.40% (1.7280 => 1.8040, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.4760 => 0.4960, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.05% (0.2960 => 0.3080, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.2283 => 10.6324, std.dev.: 0.0361) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (6.5320 => 6.7880, std.dev.: 0.0479) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (5.8281 => 6.0521, std.dev.: 0.0345) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.7841 => 1.8521, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (5.3960 => 5.5960, std.dev.: 0.0425) MultiSource/Applications/lua/lua: 3.67% (4.7920 => 4.9680, std.dev.: 0.0253) MultiSource/Applications/hexxagon/hexxagon: 3.53% (1.1320 => 1.1720, std.dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.06% (6.5360 => 6.7360, std.dev.: 0.0524) MultiSource/Applications/JM/lencod/lencod: 3.04% (22.2206 => 22.8967, std.dev.: 0.0457) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (16.3003 => 16.7923, std.dev.: 0.0386) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: 2.68% (18.5284 => 19.0245, std.dev.: 0.0312) MultiSource/Benchmarks/Bullet/bullet: 2.52% (38.6366 => 39.6086, std.dev.: 0.0585) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.5040 => 1.5360, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0096) MultiSource/Applications/d/make_dparser: 1.71% (3.9761 => 4.0441, std.dev.: 0.0226) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2243 => 4.2923, std.dev.: 0.0140) MultiSource/Applications/kimwitu++/kc: 1.53% (19.8291 => 20.1331, std.dev.: 0.0588) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.72% (2.1201 => 2.4322, std.dev.: 0.0407) MultiSource/Applications/siod/siod: 5.45% (2.8642 => 3.0202, std.dev.: 0.0274) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.00% (0.7200 => 0.7560, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 2.36% (6.5964 => 6.7524, std.dev.: 0.0393) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (4.0003 => 4.0683, std.dev.: 0.0206) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.63% (3.9442 => 4.0083, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.74% (2.9562 => 0.9240, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.96% (94.8339 => 49.3471, std.dev.: 10.4923) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.21% (49.9431 => 32.8581, std.dev.: 0.2257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.84% (25.7136 => 17.0131, std.dev.: 0.1471) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.92% (3.0722 => 2.3681, std.dev.: 0.1105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.21% (37.0863 => 28.8498, std.dev.: 0.5137) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.78% (5.6124 => 5.5123, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 2.88% (50.1010 => 51.5450, std.dev.: 0.1056) SingleSource/Benchmarks/Misc/oourafft: -94.39% (11.3407 => 0.6360, std.dev.: 0.0100) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 12:20:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 14:20:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412192057.939FF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24597?compare_to=24593&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24597, Order: 206109, Start Time: 2014-04-12 14:43:45, End Time: 2014-04-12 19:27:20 To: 24593, Order: 206107, Start Time: 2014-04-12 12:07:23, End Time: 2014-04-12 16:48:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (104 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 9.09% (0.2200 => 0.2400, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.4280 => 0.4400, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.24% (1.2481 => 1.2761, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.8961 => 0.9161, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.86% (1.2881 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.59% (11.3000 => 11.4800, std.dev.: 0.0630) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.48% (5.9320 => 6.0200, std.dev.: 0.0317) MultiSource/Applications/lemon/lemon: 1.47% (1.3601 => 1.3801, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.09% (0.1760 => 0.1920, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4641 => 1.4801, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.57% (0.3680 => 0.4400, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0630) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0479) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0628) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0218) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0352) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0173) MultiSource/Applications/JM/lencod/lencod: 3.43% (17.6165 => 18.2205, std.dev.: 0.0549) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0386) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0374) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0167) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.12% (48.1088 => 49.1290, std.dev.: 0.0658) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0419) MultiSource/Benchmarks/Bullet/bullet: 1.93% (37.0925 => 37.8086, std.dev.: 0.0925) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0113) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0191) MultiSource/Applications/kimwitu++/kc: 1.17% (18.8170 => 19.0370, std.dev.: 0.0390) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0449) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0112) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0200) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 2.82% (5.8164 => 5.9804, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0136) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0025) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0264) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -4.90% (0.4080 => 0.3880, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 13:37:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 15:37:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412203705.102992A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24598?compare_to=24597&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24598, Order: 206111, Start Time: 2014-04-12 15:57:24, End Time: 2014-04-12 20:43:31 To: 24597, Order: 206109, Start Time: 2014-04-12 14:43:45, End Time: 2014-04-12 19:27:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (104 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.41% (0.3520 => 0.3640, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.81% (1.3241 => 1.3481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.54% (1.2961 => 1.3161, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.18% (1.3521 => 1.3681, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 1.10% (8.0122 => 8.1002, std.dev.: 0.0335) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 12.16% (0.2960 => 0.3320, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.00% (0.1000 => 0.1120, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0059) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0032) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0052) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.97% (1.1361 => 1.2721, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.40% (1.2281 => 1.3681, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0660) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.14% (0.2800 => 0.3000, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0269) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0262) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0276) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.59% (4.9000 => 5.0760, std.dev.: 0.0279) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0182) MultiSource/Applications/JM/lencod/lencod: 3.45% (17.6165 => 18.2245, std.dev.: 0.0573) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (7.8562 => 8.1002, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0502) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0509) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.8000 => 5.9600, std.dev.: 0.0593) MultiSource/Applications/sqlite3/sqlite3: 2.21% (23.7574 => 24.2815, std.dev.: 0.0326) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8486, std.dev.: 0.0540) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0127) MultiSource/Applications/treecc/treecc: 1.96% (2.4480 => 2.4960, std.dev.: 0.0137) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.92% (48.1088 => 49.0329, std.dev.: 0.0772) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.0800 => 0.0920, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 5.17% (6.6564 => 7.0004, std.dev.: 0.0453) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 3.17% (0.5040 => 0.5200, std.dev.: 0.0050) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 14:21:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 16:21:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412212129.472AE2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24599?compare_to=24598&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24599, Order: 206112, Start Time: 2014-04-12 16:48:45, End Time: 2014-04-12 21:27:54 To: 24598, Order: 206111, Start Time: 2014-04-12 15:57:24, End Time: 2014-04-12 20:43:31 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (88 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (1002 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Oscar: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 19.05% (0.0840 => 0.1000, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.14% (0.2800 => 0.3000, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.08% (0.2360 => 0.2480, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 3.28% (0.4880 => 0.5040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.92% (1.2481 => 1.2721, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (1.3681 => 1.3401, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0090) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0131) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0472) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.24% (10.6960 => 11.2560, std.dev.: 0.1027) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0309) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0353) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0177) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0467) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0394) SingleSource/Benchmarks/Shootout-C++/hash2: 2.44% (0.4920 => 0.5040, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8966, std.dev.: 0.0718) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0459) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0368) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.86% (48.1088 => 49.0049, std.dev.: 0.1238) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0215) MultiSource/Applications/kimwitu++/kc: 1.21% (18.8170 => 19.0450, std.dev.: 0.0689) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0522) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0234) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0361) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 2.68% (5.8164 => 5.9724, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 14:28:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 16:28:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412212851.282092A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24600?compare_to=24590&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24600, Order: 206112, Start Time: 2014-04-12 16:55:07, End Time: 2014-04-12 21:35:21 To: 24590, Order: 206106, Start Time: 2014-04-12 11:56:43, End Time: 2014-04-12 16:36:22 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 17 (140 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (2 on baseline) Unchanged Tests: 1092 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/15-trie/trie: 26.67% (0.0600 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (0.1800 => 0.2000, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 8.41% (0.4280 => 0.4640, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 6.25% (0.1920 => 0.2040, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.96% (0.5400 => 0.5560, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.53% (0.6320 => 0.6480, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.98% (1.6201 => 1.6521, std.dev.: 0.0100) MultiSource/Applications/siod/siod: 1.75% (2.7482 => 2.7962, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.66% (6.0361 => 6.1361, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.20% (2.0001 => 2.0241, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.08% (1.8441 => 1.8641, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/oggenc/oggenc: 9.38% (0.1280 => 0.1400, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.70% (1.1921 => 1.2481, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.88% (1.1121 => 1.1441, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 0.33% (51.3690 => 51.5410, std.dev.: 0.1113) SingleSource/Benchmarks/Misc/oourafft: -2.47% (0.6480 => 0.6320, std.dev.: 0.0138) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/7zip/7zip-benchmark: 3.02% (50.0290 => 51.5410, std.dev.: 0.1113) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0129) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0060) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.86% (0.1120 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/random: 12.50% (0.2240 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.2360 => 0.2640, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.45% (1.8161 => 2.0241, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0037) SingleSource/Regression/C/bigstack: 10.87% (0.1840 => 0.2040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.43% (1.4961 => 1.6521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.95% (1.5281 => 1.6801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (1.5521 => 1.7041, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/em3d/em3d: 9.62% (0.2080 => 0.2280, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0123) MultiSource/Applications/obsequi/Obsequi: 8.78% (1.8680 => 2.0320, std.dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.30% (1.7841 => 1.9321, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: 8.26% (0.4840 => 0.5240, std.dev.: 0.0122) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.20% (1.0240 => 1.1080, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.82% (1.4841 => 1.6001, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.13% (1.7401 => 1.8641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (11.6440 => 12.3800, std.dev.: 0.0559) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (5.8121 => 6.1361, std.dev.: 0.0253) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.57% (9.4842 => 10.0122, std.dev.: 0.0383) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0171) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/moments: 5.45% (0.4400 => 0.4640, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0262) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.95% (6.5440 => 6.8680, std.dev.: 0.0350) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 4.74% (10.0443 => 10.5203, std.dev.: 0.0301) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0094) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 4.35% (21.9606 => 22.9168, std.dev.: 0.0520) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (2.0440 => 2.1320, std.dev.: 0.0236) MultiSource/Applications/treecc/treecc: 4.02% (2.5840 => 2.6880, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (6.5080 => 6.7680, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (5.3600 => 5.5480, std.dev.: 0.0297) MultiSource/Benchmarks/Bullet/bullet: 3.43% (38.4046 => 39.7206, std.dev.: 0.0657) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0141) MultiSource/Applications/oggenc/oggenc: 3.09% (6.9844 => 7.2005, std.dev.: 0.0172) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0290) MultiSource/Applications/SPASS/SPASS: 3.02% (18.4404 => 18.9966, std.dev.: 0.0326) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (16.3483 => 16.7483, std.dev.: 0.0480) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0274) MultiSource/Applications/ClamAV/clamscan: 2.23% (19.0444 => 19.4684, std.dev.: 0.0683) MultiSource/Applications/kimwitu++/kc: 1.79% (19.6891 => 20.0411, std.dev.: 0.0570) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (13.0563 => 13.2163, std.dev.: 0.0309) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.02% (2.1401 => 2.4402, std.dev.: 0.0389) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0130) MultiSource/Applications/siod/siod: 5.45% (2.8602 => 3.0162, std.dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.51% (3.9842 => 4.0443, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.38% (6.6684 => 6.7604, std.dev.: 0.0255) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.99% (10.6247 => 2.0201, std.dev.: 0.0371) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.16% (2.9442 => 0.9080, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4566 => 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.46% (91.8497 => 49.1751, std.dev.: 10.5451) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.75% (50.3031 => 32.8221, std.dev.: 0.2338) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.29% (26.0616 => 17.1251, std.dev.: 0.1073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.27% (42.1466 => 28.5458, std.dev.: 0.5547) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1135) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0122) MultiSource/Benchmarks/sim/sim: -1.34% (4.7883 => 4.7243, std.dev.: 0.0118) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -94.44% (11.3687 => 0.6320, std.dev.: 0.0138) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 14:43:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 16:43:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140412214331.0B0112A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24601?compare_to=24592&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24601, Order: 206112, Start Time: 2014-04-12 17:02:22, End Time: 2014-04-12 21:49:58 To: 24592, Order: 206106, Start Time: 2014-04-12 11:56:42, End Time: 2014-04-12 16:43:39 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-LoadShorts: 200.00% (0.0080 => 0.0240, std.dev.: 0.0054) SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 17.24% (0.1160 => 0.1360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Applications/obsequi/Obsequi: 2.12% (2.0720 => 2.1160, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.41% (1.7041 => 1.7281, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.23% (2.2841 => 2.3121, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 13.95% (0.1720 => 0.1960, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.03% (0.5960 => 0.6200, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.24% (4.4683 => 4.5683, std.dev.: 0.0307) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 4.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 15:15:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 17:15:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140412221501.0B0182A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24602?compare_to=24594&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24602, Order: 206112, Start Time: 2014-04-12 17:31:27, End Time: 2014-04-12 22:21:30 To: 24594, Order: 206107, Start Time: 2014-04-12 12:22:42, End Time: 2014-04-12 17:12:40 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (133 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.52% (0.1080 => 0.1280, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 17.86% (0.1120 => 0.1320, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 14.00% (0.2000 => 0.2280, std.dev.: 0.0082) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.58% (0.2640 => 0.2840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.17% (0.2320 => 0.2440, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 4.27% (0.4680 => 0.4880, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.66% (0.7640 => 0.7920, std.dev.: 0.0095) SingleSource/Regression/C/sumarray2d: 2.48% (0.6440 => 0.6600, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (1.0161 => 1.0321, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.34% (2.0841 => 2.1121, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/FloatMM: -33.33% (0.0480 => 0.0320, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0092) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0027) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0056) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.94% (1.7321 => 2.1121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.58% (1.6681 => 2.0281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.99% (1.6961 => 2.0521, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.53% (1.7921 => 2.1601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.36% (1.7481 => 2.1041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.13% (1.8081 => 2.1721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0214) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0080) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.15% (0.2600 => 0.2760, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (11.7880 => 12.4880, std.dev.: 0.0786) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.81% (1.2400 => 1.3120, std.dev.: 0.0151) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (6.7200 => 7.1080, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.24% (0.9920 => 1.0440, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.17% (0.2320 => 0.2440, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.76% (0.7560 => 0.7920, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (2.0680 => 2.1640, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (9.9842 => 10.4322, std.dev.: 0.0447) MultiSource/Applications/lua/lua: 4.42% (4.7920 => 5.0040, std.dev.: 0.0334) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.41% (0.2720 => 0.2840, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0168) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.94% (1.5240 => 1.5840, std.dev.: 0.0229) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.86% (1.3480 => 1.4000, std.dev.: 0.0164) MultiSource/Applications/d/make_dparser: 3.83% (3.9641 => 4.1161, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (6.8321 => 7.0841, std.dev.: 0.0280) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (10.3203 => 10.6884, std.dev.: 0.0426) MultiSource/Applications/oggenc/oggenc: 3.53% (6.9124 => 7.1564, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 3.12% (18.4924 => 19.0685, std.dev.: 0.0599) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.90% (2.6200 => 2.6960, std.dev.: 0.0179) MultiSource/Applications/JM/lencod/lencod: 2.90% (22.6287 => 23.2848, std.dev.: 0.0533) MultiSource/Applications/ClamAV/clamscan: 2.37% (20.2445 => 20.7245, std.dev.: 0.0505) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (5.5480 => 5.6720, std.dev.: 0.0300) MultiSource/Benchmarks/Bullet/bullet: 2.21% (38.9366 => 39.7966, std.dev.: 0.1167) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.16% (51.1089 => 52.2129, std.dev.: 0.1399) MultiSource/Applications/kimwitu++/kc: 2.03% (19.7371 => 20.1371, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (16.5963 => 16.9203, std.dev.: 0.0541) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0147) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.56% (25.1895 => 25.5816, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0244 => 6.1164, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (3.0122 => 3.0562, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Treesort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 26.29% (0.9281 => 1.1721, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0120) MultiSource/Applications/minisat/minisat: 3.23% (6.8204 => 7.0404, std.dev.: 0.0439) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.74% (4.1323 => 4.2043, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.68% (4.7563 => 4.8363, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (4.2443 => 4.3003, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0171) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/nestedloop: -60.19% (2.9642 => 1.1801, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.55% (3.1762 => 1.3801, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: -21.91% (2.6481 => 2.0680, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.47% (7.4801 => 6.2480, std.dev.: 0.0333) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.89% (7.5041 => 6.3120, std.dev.: 0.0561) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -3.31% (13.5243 => 13.0763, std.dev.: 0.0476) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0218) MultiSource/Applications/obsequi/Obsequi: -1.88% (2.1281 => 2.0881, std.dev.: 0.0148) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.04% (8.8486 => 8.7565, std.dev.: 0.0355) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 15:32:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 17:32:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140412223204.B38602A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24603?compare_to=24596&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24603, Order: 206112, Start Time: 2014-04-12 17:55:17, End Time: 2014-04-12 22:38:31 To: 24596, Order: 206107, Start Time: 2014-04-12 12:53:10, End Time: 2014-04-12 17:36:32 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (8 on baseline) Performance Regressions: 13 (136 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (3 on baseline) Unchanged Tests: 1096 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3040 => 0.3240, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.15% (0.7760 => 0.8160, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.12% (1.8760 => 1.9720, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 2.09% (0.7640 => 0.7800, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.30% (2.1561 => 2.1841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.18% (2.3721 => 2.4001, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.2560 => 0.2720, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 0.05% (51.5450 => 51.5730, std.dev.: 0.1001) SingleSource/Benchmarks/Misc/oourafft: 1.26% (0.6360 => 0.6440, std.dev.: 0.0079) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: 11.07% (17.6723 => 19.6284, std.dev.: 0.0533) MultiSource/Applications/sqlite3/sqlite3: 1415.53% (1.7001 => 25.7656, std.dev.: 0.0471) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0289) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.29% (11.3920 => 12.3360, std.dev.: 0.0716) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0443, std.dev.: 0.0297) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0035) SingleSource/Regression/C/sumarray2d: 120.00% (0.0200 => 0.0440, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.63% (1.8281 => 2.1321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.45% (1.9161 => 2.2121, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.76% (1.9241 => 2.2081, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.64% (2.1121 => 2.4001, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.83% (1.8081 => 2.0401, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.93% (1.8441 => 2.0641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.80% (2.0681 => 2.3121, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0138) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0139) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: 7.46% (1.8760 => 2.0160, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.8440 => 1.9720, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.78% (0.7080 => 0.7560, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2360 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (1.6960 => 1.8080, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (6.4800 => 6.8880, std.dev.: 0.0309) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: 6.12% (0.1960 => 0.2080, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 5.45% (0.4400 => 0.4640, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.4480 => 0.4720, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.1320 => 1.1920, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: 4.97% (1.5280 => 1.6040, std.dev.: 0.0225) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (9.6042 => 10.0482, std.dev.: 0.0252) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.2283 => 10.6884, std.dev.: 0.0248) MultiSource/Applications/hbd/hbd: 4.40% (1.7280 => 1.8040, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0250) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (6.5360 => 6.7960, std.dev.: 0.0270) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (6.5320 => 6.7880, std.dev.: 0.0410) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (5.8281 => 6.0561, std.dev.: 0.0468) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3960 => 5.5760, std.dev.: 0.0542) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (16.3003 => 16.7883, std.dev.: 0.0284) MultiSource/Applications/JM/lencod/lencod: 2.99% (22.2206 => 22.8847, std.dev.: 0.0432) MultiSource/Applications/lua/lua: 2.92% (4.7920 => 4.9320, std.dev.: 0.0430) MultiSource/Benchmarks/Bullet/bullet: 2.85% (38.6366 => 39.7366, std.dev.: 0.0615) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0144) MultiSource/Applications/oggenc/oggenc: 2.61% (7.0524 => 7.2365, std.dev.: 0.0163) MultiSource/Applications/SPASS/SPASS: 2.55% (18.5284 => 19.0006, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: 1.75% (19.8291 => 20.1771, std.dev.: 0.0308) MultiSource/Applications/d/make_dparser: 1.61% (3.9761 => 4.0401, std.dev.: 0.0204) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (2.1201 => 2.4842, std.dev.: 0.0492) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0380) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.24% (0.7400 => 0.7640, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: 2.15% (2.0441 => 2.0881, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.87% (3.2082 => 3.2682, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.58% (6.5964 => 6.7004, std.dev.: 0.0286) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (3.9442 => 4.0042, std.dev.: 0.0122) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.74% (1.5881 => 1.0681, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.03% (94.8339 => 49.2831, std.dev.: 10.2883) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.82% (49.9431 => 33.0501, std.dev.: 0.2101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.65% (25.7136 => 17.0611, std.dev.: 0.1180) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.00% (37.0863 => 28.9258, std.dev.: 0.3171) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.64% (5.6124 => 5.5203, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0158) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 2.94% (50.1010 => 51.5730, std.dev.: 0.1001) SingleSource/Benchmarks/Misc/oourafft: -94.32% (11.3407 => 0.6440, std.dev.: 0.0079) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 15:38:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 17:38:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140412223829.1FE6C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24604?compare_to=24595&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24604, Order: 206112, Start Time: 2014-04-12 17:55:00, End Time: 2014-04-12 22:44:54 To: 24595, Order: 206107, Start Time: 2014-04-12 12:46:39, End Time: 2014-04-12 17:36:26 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (151 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 23.53% (0.0680 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.09% (0.2200 => 0.2400, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 5.66% (0.2120 => 0.2240, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 5.39% (0.8160 => 0.8600, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.44% (1.0800 => 1.1280, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.7440 => 0.7720, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 3.60% (0.4440 => 0.4600, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.56% (0.6240 => 0.6400, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 4.15% (0.9641 => 1.0041, std.dev.: 0.0134) MultiSource/Applications/obsequi/Obsequi: 1.53% (2.0921 => 2.1241, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: -80.00% (0.0200 => 0.0040, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0093) SingleSource/Benchmarks/Stanford/Puzzle: 1206.53% (0.1240 => 1.6201, std.dev.: 0.0080) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0069) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0106) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0138) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0053) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0098) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0062) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0051) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: 43.97% (1.3920 => 2.0040, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0102) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.77% (1.1761 => 1.4321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.42% (1.1361 => 1.3681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.73% (1.1761 => 1.4081, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 18.98% (8.5802 => 10.2083, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 15.41% (19.5406 => 22.5527, std.dev.: 0.0411) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0165) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.09% (5.3360 => 6.0881, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0079) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/neural/neural: 12.00% (0.2000 => 0.2240, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/oourafft: 9.33% (0.3000 => 0.3280, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.32% (5.6680 => 6.1960, std.dev.: 0.0337) MultiSource/Benchmarks/mafft/pairlocalalign: 9.31% (11.3843 => 12.4443, std.dev.: 0.0364) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0097) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.31% (5.7280 => 6.2040, std.dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.25% (11.4440 => 12.3880, std.dev.: 0.0490) MultiSource/Applications/oggenc/oggenc: 7.83% (6.2844 => 6.7764, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.14% (0.2240 => 0.2400, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.93% (9.5802 => 10.1482, std.dev.: 0.0453) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 4.09% (5.3840 => 5.6040, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.08% (0.9800 => 1.0200, std.dev.: 0.0132) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.7440 => 0.7720, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.30% (1.0920 => 1.1280, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0197) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.95% (49.1529 => 50.6009, std.dev.: 0.1082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.81% (6.8280 => 7.0200, std.dev.: 0.0557) MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (2.7282 => 2.8042, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (2.0920 => 2.1480, std.dev.: 0.0150) MultiSource/Applications/ClamAV/clamscan: 2.66% (19.2243 => 19.7364, std.dev.: 0.0564) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.44% (0.4920 => 0.5040, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.38% (24.7575 => 25.3455, std.dev.: 0.0425) MultiSource/Benchmarks/Bullet/bullet: 1.79% (39.0726 => 39.7726, std.dev.: 0.0628) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.63% (2.2081 => 2.2441, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 1.50% (19.7491 => 20.0451, std.dev.: 0.0394) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.1001 => 1.1401, std.dev.: 0.0112) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0358) MultiSource/Applications/sqlite3/sqlite3: 2.76% (4.0563 => 4.1683, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4041 => 1.4241, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0269) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0071) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0053) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0570) MultiSource/Applications/siod/siod: -6.03% (2.9842 => 2.8042, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 16:12:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 18:12:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412231232.9D7052A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24605?compare_to=24599&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24605, Order: 206115, Start Time: 2014-04-12 18:38:01, End Time: 2014-04-12 23:18:58 To: 24599, Order: 206112, Start Time: 2014-04-12 16:48:45, End Time: 2014-04-12 21:27:54 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (97 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.38% (0.1040 => 0.1200, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2160 => 0.2400, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.28% (0.6760 => 0.7320, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.59% (0.4640 => 0.4760, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.50% (1.3361 => 1.3561, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.12% (2.8602 => 2.8922, std.dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 1.22% (1.3161 => 1.3321, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0206) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0604) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0536) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0115) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0356) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0160) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0343) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0295) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0469) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0309) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0108) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.99% (48.1088 => 49.0650, std.dev.: 0.0968) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0483) MultiSource/Benchmarks/Bullet/bullet: 1.83% (37.0925 => 37.7726, std.dev.: 0.0959) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 1.47% (18.8170 => 19.0930, std.dev.: 0.0298) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0348) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0136) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.69% (6.6564 => 6.9684, std.dev.: 0.0429) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0249) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.04% (4.5203 => 4.6123, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/bmm/bmm: -14.29% (0.0840 => 0.0720, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 16:48:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 18:48:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140412234832.BA01D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24606?compare_to=24605&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24606, Order: 206117, Start Time: 2014-04-12 19:13:22, End Time: 2014-04-12 23:54:58 To: 24605, Order: 206115, Start Time: 2014-04-12 18:38:01, End Time: 2014-04-12 23:18:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (104 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 30.00% (0.0400 => 0.0520, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.13% (0.6520 => 0.6920, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.55% (1.2881 => 1.3081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.19% (1.3441 => 1.3601, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.41% (1.2961 => 1.3921, std.dev.: 0.0369) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.75% (1.2281 => 1.3601, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0724) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0208) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (5.8000 => 6.0640, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/football/football: 3.80% (0.9480 => 0.9840, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0166) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0433) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0147) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0715) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0522) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (4.9200 => 5.0360, std.dev.: 0.0427) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0105) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1169, std.dev.: 0.0745) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8485, std.dev.: 0.1053) MultiSource/Applications/sqlite3/sqlite3: 1.99% (23.7574 => 24.2295, std.dev.: 0.0520) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0377) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0353) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.9443 => 5.0003, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 1.06% (21.1533 => 21.3773, std.dev.: 0.0849) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9762 => 4.0163, std.dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0067) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 19:12:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 21:12:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413021204.73A242A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24607?compare_to=24600&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24607, Order: 206119, Start Time: 2014-04-12 21:38:43, End Time: 2014-04-13 02:18:28 To: 24600, Order: 206112, Start Time: 2014-04-12 16:55:07, End Time: 2014-04-12 21:35:21 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (158 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (2 on baseline) Unchanged Tests: 1102 (927 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.21% (0.2120 => 0.2400, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.48% (0.4840 => 0.4960, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.55% (1.5441 => 1.5681, std.dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: 1.31% (1.8281 => 1.8521, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: -0.05% (51.5410 => 51.5130, std.dev.: 0.1132) SingleSource/Benchmarks/Misc/oourafft: 1.27% (0.6320 => 0.6400, std.dev.: 0.0083) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/7zip/7zip-benchmark: 2.97% (50.0290 => 51.5130, std.dev.: 0.1132) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0089) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0058) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0033) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/objinst: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.84% (1.0240 => 1.1760, std.dev.: 0.0194) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.1080 => 0.1240, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.19% (0.3640 => 0.4120, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.2360 => 0.2640, std.dev.: 0.0106) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0164) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.92% (1.6121 => 1.7721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.42% (1.5281 => 1.6721, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 9.09% (0.2200 => 0.2400, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 9.09% (0.6600 => 0.7200, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: 8.78% (1.8680 => 2.0320, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.73% (1.4201 => 1.5441, std.dev.: 0.0082) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.29% (1.4481 => 1.5681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4600 => 0.4960, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.46% (0.2680 => 0.2880, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.03% (1.0240 => 1.0960, std.dev.: 0.0245) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.02% (0.2280 => 0.2440, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0136) MultiSource/Applications/Burg/burg: 6.10% (1.5080 => 1.6000, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (11.6440 => 12.3400, std.dev.: 0.0681) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (6.4680 => 6.8520, std.dev.: 0.0509) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.90% (9.4842 => 10.0442, std.dev.: 0.0482) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (5.8121 => 6.1481, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.21% (0.7680 => 0.8080, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0129) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.5600 => 1.6360, std.dev.: 0.0217) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 4.48% (21.9606 => 22.9448, std.dev.: 0.0459) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.0443 => 10.4683, std.dev.: 0.0385) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0250) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (5.3600 => 5.5760, std.dev.: 0.0399) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (2.0440 => 2.1240, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (6.5440 => 6.8000, std.dev.: 0.0541) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 3.59% (4.7880 => 4.9600, std.dev.: 0.0291) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (6.5080 => 6.7240, std.dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (2.3281 => 2.4042, std.dev.: 0.0141) MultiSource/Applications/hbd/hbd: 3.23% (1.7360 => 1.7920, std.dev.: 0.0185) MultiSource/Applications/oggenc/oggenc: 3.15% (6.9844 => 7.2044, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 3.14% (38.4046 => 39.6086, std.dev.: 0.0935) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0138) MultiSource/Applications/SPASS/SPASS: 3.04% (18.4404 => 19.0006, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (16.3483 => 16.8083, std.dev.: 0.0336) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5284, std.dev.: 0.0607) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (3.0282 => 3.1002, std.dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: 2.03% (19.6891 => 20.0891, std.dev.: 0.0488) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (13.0563 => 13.2523, std.dev.: 0.0226) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7922 => 2.8242, std.dev.: 0.0098) MultiSource/Applications/lemon/lemon: 1.08% (1.4881 => 1.5041, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.54% (0.9241 => 1.1601, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.09% (2.1401 => 2.4202, std.dev.: 0.0538) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0322) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4566 => 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.07% (91.8497 => 49.5311, std.dev.: 10.5992) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.64% (26.0616 => 17.0331, std.dev.: 0.1055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.26% (50.3031 => 33.0701, std.dev.: 0.1400) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.06% (42.1466 => 28.6338, std.dev.: 0.3105) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.1046) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.21% (7.7845 => 6.7564, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.49% (4.8083 => 4.6403, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0115) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0152) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -94.37% (11.3687 => 0.6400, std.dev.: 0.0083) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 19:25:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 21:25:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413022556.818F12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24608?compare_to=24606&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24608, Order: 206119, Start Time: 2014-04-12 21:47:26, End Time: 2014-04-13 02:32:21 To: 24606, Order: 206117, Start Time: 2014-04-12 19:13:22, End Time: 2014-04-12 23:54:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (98 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) MultiSource/Benchmarks/llubenchmark/llu: 40.00% (0.0400 => 0.0560, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 5.63% (0.2840 => 0.3000, std.dev.: 0.0055) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 19.05% (0.1680 => 0.2000, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: 2.30% (2.0841 => 2.1321, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.5482 => 3.5082, std.dev.: 0.0129) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0022) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0143) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0687) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0402) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (1.5200 => 1.6160, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0090) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0248) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (10.4082 => 10.8122, std.dev.: 0.0250) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0599) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0184) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0435) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0383) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0124) MultiSource/Applications/JM/lencod/lencod: 2.52% (17.6165 => 18.0605, std.dev.: 0.0581) MultiSource/Benchmarks/Bullet/bullet: 2.29% (37.0925 => 37.9405, std.dev.: 0.0704) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0277) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0359) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.02% (48.1088 => 49.0810, std.dev.: 0.0747) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.89% (2.1201 => 2.1601, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0621) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 1.28% (18.8170 => 19.0570, std.dev.: 0.0361) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0478) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.04% (0.9321 => 1.1841, std.dev.: 0.0224) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 4.93% (6.6564 => 6.9844, std.dev.: 0.0361) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0105) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: 2.41% (5.8164 => 5.9564, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0232) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0224) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/mason/mason: -15.79% (0.0760 => 0.0640, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -14.29% (0.1120 => 0.0960, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.5522 => 3.5082, std.dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 19:34:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 21:34:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413023423.8C8862A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24609?compare_to=24601&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24609, Order: 206119, Start Time: 2014-04-12 21:53:20, End Time: 2014-04-13 02:40:53 To: 24601, Order: 206112, Start Time: 2014-04-12 17:02:22, End Time: 2014-04-12 21:49:58 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1098 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/UnitTests/2003-08-05-CastFPToUint: 133.33% (0.0120 => 0.0280, std.dev.: 0.0035) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/matrixTranspose: 100.00% (0.0160 => 0.0320, std.dev.: 0.0055) SingleSource/UnitTests/2003-05-26-Shorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/methcall: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 17.65% (0.0680 => 0.0800, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 5.15% (0.3880 => 0.4080, std.dev.: 0.0071) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.80% (1.3680 => 1.4200, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (1.2880 => 1.3320, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.42% (7.0560 => 7.1560, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.36% (1.7641 => 1.7881, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 19:39:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 21:39:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413023900.EF5222A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24610?compare_to=24608&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24610, Order: 206120, Start Time: 2014-04-12 22:06:05, End Time: 2014-04-13 02:45:27 To: 24608, Order: 206119, Start Time: 2014-04-12 21:47:26, End Time: 2014-04-13 02:32:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 19 (107 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct-bitfield-init: 200.00% (0.0080 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/Vector/sumarray: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: 30.77% (0.0520 => 0.0680, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 25.00% (0.0800 => 0.1000, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0960 => 0.1120, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.95% (1.2321 => 1.2561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.61% (1.2401 => 1.2601, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.58% (2.0240 => 2.0560, std.dev.: 0.0108) MultiSource/Applications/lua/lua: 1.54% (4.6640 => 4.7360, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: 2.50% (1.2801 => 1.3121, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary3: 1.03% (3.5082 => 3.5442, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0821) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0297) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.28% (1.3641 => 1.4361, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.26% (1.3681 => 1.4401, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0108) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0231) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0539) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0205) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0359) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0473) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.7360 => 1.7880, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0554) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0387) SingleSource/Benchmarks/Shootout-C++/hash2: 2.44% (0.4920 => 0.5040, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9246, std.dev.: 0.0616) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0480) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.06% (48.1088 => 49.1010, std.dev.: 0.0624) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (4.9000 => 4.9920, std.dev.: 0.0323) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0128) MultiSource/Applications/siod/siod: 1.24% (2.5721 => 2.6041, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0334) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/lists: 2.75% (5.8164 => 5.9764, std.dev.: 0.0107) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.20% (1.0921 => 1.1161, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.06% (21.1533 => 21.3773, std.dev.: 0.0663) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/mason/mason: -15.79% (0.0760 => 0.0640, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: -11.36% (0.1760 => 0.1560, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: -1.73% (1.3841 => 1.3601, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0193) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3361 => 2.3001, std.dev.: 0.0114) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 20:08:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 22:08:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140413030820.2F0792A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24611?compare_to=24602&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24611, Order: 206120, Start Time: 2014-04-12 22:24:53, End Time: 2014-04-13 03:14:48 To: 24602, Order: 206112, Start Time: 2014-04-12 17:31:27, End Time: 2014-04-12 22:21:30 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (139 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-06-IntOverflow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/FloatMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 40.00% (0.0400 => 0.0560, std.dev.: 0.0054) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 33.33% (0.0600 => 0.0800, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.08% (0.1040 => 0.1280, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0060) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.59% (1.3880 => 1.4240, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.20% (1.4560 => 1.4880, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.04% (0.5880 => 0.6000, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 301.78% (0.4560 => 1.8321, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/simple_throw: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.88% (1.7241 => 2.0841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.82% (1.8361 => 2.2001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.72% (1.7241 => 2.0641, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.30% (1.7201 => 2.0521, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.53% (1.9641 => 2.3281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.96% (1.9601 => 2.3121, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0043) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0261) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.5560 => 0.6000, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4600 => 0.4960, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2080 => 0.2240, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.66% (3.5002 => 3.7682, std.dev.: 0.0065) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (11.7880 => 12.4840, std.dev.: 0.0860) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (6.7200 => 7.1160, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.79% (1.7280 => 1.8280, std.dev.: 0.0232) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.24% (0.9920 => 1.0440, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.4160 => 1.4880, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.84% (0.2480 => 0.2600, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (9.9842 => 10.4522, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3480 => 0.3640, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0069) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0205) MultiSource/Applications/lua/lua: 4.42% (4.7920 => 5.0040, std.dev.: 0.0259) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0205) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.79% (1.3720 => 1.4240, std.dev.: 0.0124) MultiSource/Applications/d/make_dparser: 3.53% (3.9641 => 4.1041, std.dev.: 0.0323) MultiSource/Applications/oggenc/oggenc: 3.53% (6.9124 => 7.1564, std.dev.: 0.0207) MultiSource/Applications/JM/ldecod/ldecod: 3.49% (10.3203 => 10.6804, std.dev.: 0.0348) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (6.8321 => 7.0681, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 3.09% (18.4924 => 19.0646, std.dev.: 0.0641) MultiSource/Applications/JM/lencod/lencod: 3.02% (22.6287 => 23.3128, std.dev.: 0.0473) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (2.0440 => 2.1040, std.dev.: 0.0228) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.8440 => 0.8680, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: 2.75% (2.6200 => 2.6920, std.dev.: 0.0267) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.63% (51.1089 => 52.4529, std.dev.: 0.1090) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (5.5480 => 5.6920, std.dev.: 0.0302) MultiSource/Benchmarks/Bullet/bullet: 2.50% (38.9366 => 39.9086, std.dev.: 0.0916) MultiSource/Applications/kimwitu++/kc: 2.49% (19.7371 => 20.2291, std.dev.: 0.0333) MultiSource/Applications/ClamAV/clamscan: 2.47% (20.2445 => 20.7445, std.dev.: 0.0571) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (16.5963 => 16.9083, std.dev.: 0.0696) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0089) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: 1.72% (25.1895 => 25.6216, std.dev.: 0.0358) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0244 => 6.1004, std.dev.: 0.0217) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 27.58% (0.9281 => 1.1841, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 2.93% (6.8204 => 7.0204, std.dev.: 0.0484) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/perlin: 1.95% (5.9604 => 6.0764, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (4.2403 => 4.3163, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (4.7563 => 4.8323, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0160) MultiSource/Applications/lua/lua: 1.50% (21.6534 => 21.9774, std.dev.: 0.1064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.58% (6.2884 => 0.8440, std.dev.: 0.0188) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/nestedloop: -60.32% (2.9642 => 1.1761, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.55% (3.1762 => 1.3801, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.19% (1.5881 => 1.1721, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.58% (7.5041 => 6.2600, std.dev.: 0.0542) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (7.4801 => 6.2520, std.dev.: 0.0566) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0075) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -2.84% (13.5243 => 13.1403, std.dev.: 0.0389) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -14.97% (7.8005 => 6.6324, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (5.1603 => 5.0403, std.dev.: 0.0196) MultiSource/Applications/JM/lencod/lencod: -1.73% (8.3085 => 8.1645, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -1.27% (11.6527 => 11.5047, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 20:17:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 22:17:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140413031743.E286F2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24612?compare_to=24603&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24612, Order: 206120, Start Time: 2014-04-12 22:42:06, End Time: 2014-04-13 03:24:11 To: 24603, Order: 206112, Start Time: 2014-04-12 17:55:17, End Time: 2014-04-12 22:38:31 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (8 on baseline) Performance Regressions: 6 (135 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (3 on baseline) Unchanged Tests: 1103 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 45.45% (0.0440 => 0.0640, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: 18.75% (0.0640 => 0.0760, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.57% (0.1400 => 0.1520, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.67% (0.3600 => 0.3840, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 0.11% (51.5730 => 51.6290, std.dev.: 0.0929) SingleSource/Benchmarks/Misc/oourafft: - (0.6440 => 0.6440, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: 10.98% (17.6723 => 19.6123, std.dev.: 0.0789) MultiSource/Applications/sqlite3/sqlite3: 1419.77% (1.7001 => 25.8376, std.dev.: 0.0259) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.15% (11.3920 => 12.3200, std.dev.: 0.0961) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 166.67% (0.0120 => 0.0320, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 33.33% (0.0600 => 0.0800, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.15% (1.8081 => 2.1001, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.97% (1.8281 => 2.1201, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.17% (2.1361 => 2.4602, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 14.29% (0.1400 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.94% (0.3400 => 0.3840, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.40% (1.8601 => 2.0721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0109) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.8760 => 2.0560, std.dev.: 0.0192) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.96% (0.2680 => 0.2920, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 8.13% (0.4920 => 0.5320, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 7.79% (0.6160 => 0.6640, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.16% (6.4800 => 6.9440, std.dev.: 0.0426) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.67% (0.1800 => 0.1920, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.60% (2.9721 => 3.1682, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.09% (0.7880 => 0.8360, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.68% (0.7040 => 0.7440, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0286) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.4480 => 0.4720, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (5.8281 => 6.1081, std.dev.: 0.0325) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4400 => 0.4600, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0159) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (9.6042 => 10.0322, std.dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0228) MultiSource/Applications/JM/ldecod/ldecod: 4.34% (10.2283 => 10.6724, std.dev.: 0.0380) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (6.5320 => 6.7880, std.dev.: 0.0551) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (6.5360 => 6.7880, std.dev.: 0.0573) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0149) MultiSource/Applications/Burg/burg: 3.40% (1.5280 => 1.5800, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 3.17% (4.7920 => 4.9440, std.dev.: 0.0287) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.08% (1.3000 => 1.3400, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (16.3003 => 16.8003, std.dev.: 0.0272) MultiSource/Benchmarks/Bullet/bullet: 2.94% (38.6366 => 39.7726, std.dev.: 0.0559) MultiSource/Applications/JM/lencod/lencod: 2.83% (22.2206 => 22.8487, std.dev.: 0.0836) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0187) MultiSource/Applications/SPASS/SPASS: 2.72% (18.5284 => 19.0325, std.dev.: 0.0464) MultiSource/Applications/treecc/treecc: 2.63% (2.5880 => 2.6560, std.dev.: 0.0258) MultiSource/Applications/oggenc/oggenc: 2.61% (7.0524 => 7.2365, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (5.3960 => 5.5280, std.dev.: 0.0475) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (3.0562 => 3.1122, std.dev.: 0.0113) MultiSource/Applications/kimwitu++/kc: 1.51% (19.8291 => 20.1291, std.dev.: 0.0502) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.36% (2.1201 => 2.4882, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 5.31% (2.8642 => 3.0162, std.dev.: 0.0214) MultiSource/Benchmarks/llubenchmark/llu: 4.74% (5.0603 => 5.3003, std.dev.: 0.0784) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 2.48% (1.2881 => 1.3201, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (3.9442 => 4.0042, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.30% (4.0003 => 4.0523, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.50% (10.4007 => 2.0281, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.69% (2.9562 => 0.8960, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.87% (94.8339 => 49.4391, std.dev.: 7.6591) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.16% (49.9431 => 32.8821, std.dev.: 0.2587) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.57% (25.7136 => 17.0811, std.dev.: 0.1735) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.57% (3.0722 => 2.3481, std.dev.: 0.1118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.55% (37.0863 => 28.3538, std.dev.: 0.4865) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -1.25% (4.7883 => 4.7283, std.dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0225) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 3.05% (50.1010 => 51.6290, std.dev.: 0.0929) SingleSource/Benchmarks/Misc/oourafft: -94.32% (11.3407 => 0.6440, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 20:31:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Apr 2014 22:31:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140413033143.8E38F2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24613?compare_to=24604&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24613, Order: 206120, Start Time: 2014-04-12 22:48:23, End Time: 2014-04-13 03:38:10 To: 24604, Order: 206112, Start Time: 2014-04-12 17:55:00, End Time: 2014-04-12 22:44:54 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (152 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/cast-bug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.81% (0.1480 => 0.1640, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.65% (0.4560 => 0.5000, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.36% (0.2240 => 0.2360, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: 3.70% (0.3240 => 0.3360, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (10.1482 => 10.2562, std.dev.: 0.0281) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/viterbi/viterbi: 3.67% (2.6162 => 2.7122, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -6.72% (0.5360 => 0.5000, std.dev.: 0.0137) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2412.81% (0.0320 => 0.8041, std.dev.: 0.0074) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0092) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0106) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0047) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0115) SingleSource/UnitTests/Vector/multiplies: 228.57% (0.0280 => 0.0920, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0151) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0084) SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0047) SingleSource/Regression/C/sumarraymalloc: 77.78% (0.0360 => 0.0640, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0060) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.00% (0.7040 => 1.0560, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0050) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0271) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 31.58% (0.0760 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/dt: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.02% (1.2321 => 1.5281, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.54% (1.3001 => 1.5801, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.13% (1.2521 => 1.5041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 18.56% (8.5802 => 10.1723, std.dev.: 0.0367) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 15.41% (19.5406 => 22.5527, std.dev.: 0.0633) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.69% (5.3360 => 6.1201, std.dev.: 0.0282) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0160) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 9.42% (11.3843 => 12.4563, std.dev.: 0.0241) MultiSource/Applications/oggenc/oggenc: 8.40% (6.2844 => 6.8124, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.26% (5.6680 => 6.1360, std.dev.: 0.0367) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.7280 => 6.1960, std.dev.: 0.0391) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0094) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.2200 => 0.2360, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.10% (11.4440 => 12.2560, std.dev.: 0.0983) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.06% (9.5802 => 10.2562, std.dev.: 0.0281) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0252) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0173) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (6.8280 => 7.0920, std.dev.: 0.0406) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 3.79% (5.3840 => 5.5880, std.dev.: 0.0322) MultiSource/Applications/lua/lua: 3.60% (4.7720 => 4.9440, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.57% (1.2320 => 1.2760, std.dev.: 0.0165) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.36% (49.1529 => 50.8049, std.dev.: 0.1160) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.32% (1.3240 => 1.3680, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.4320 => 1.4760, std.dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0205) MultiSource/Applications/ClamAV/clamscan: 2.85% (19.2243 => 19.7724, std.dev.: 0.0594) MultiSource/Applications/sqlite3/sqlite3: 2.50% (24.7575 => 25.3775, std.dev.: 0.0442) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: 2.00% (39.0726 => 39.8526, std.dev.: 0.0570) MultiSource/Benchmarks/PAQ8p/paq8p: 1.76% (2.7282 => 2.7762, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 1.66% (19.7491 => 20.0771, std.dev.: 0.0542) MultiSource/Applications/SPASS/SPASS: 1.17% (18.7966 => 19.0166, std.dev.: 0.0282) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 17.75% (0.9241 => 1.0881, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0209) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.24% (0.9881 => 1.0201, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: 3.23% (6.8204 => 7.0404, std.dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.60% (3.2362 => 3.3202, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0212) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9724 => 6.0684, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-10-13-BadLoad: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0956) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.0963 => 5.0323, std.dev.: 0.0240) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 22:48:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 00:48:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413054805.E6FC52A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24614?compare_to=24610&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24614, Order: 206123, Start Time: 2014-04-13 01:11:01, End Time: 2014-04-13 05:54:30 To: 24610, Order: 206120, Start Time: 2014-04-12 22:06:05, End Time: 2014-04-13 02:45:27 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (96 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.31% (0.2080 => 0.2440, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.2480 => 0.2640, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 3.09% (1.6840 => 1.7360, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.22% (1.4401 => 1.4721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.95% (1.4361 => 1.4641, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 20.69% (0.1160 => 0.1400, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/mst/mst: 15.38% (0.1040 => 0.1200, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.24% (1.2521 => 1.2801, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -5.56% (0.5040 => 0.4760, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: -17.65% (0.0680 => 0.0560, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0585) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.09% (1.2481 => 1.3241, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0393) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0215) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0399) MultiSource/Applications/hbd/hbd: 3.33% (1.6800 => 1.7360, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0278) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.36% (23.7574 => 24.3175, std.dev.: 0.0325) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0320) MultiSource/Benchmarks/Bullet/bullet: 2.25% (37.0925 => 37.9286, std.dev.: 0.0827) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0100) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.81% (48.1088 => 48.9809, std.dev.: 0.1209) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 1.38% (18.8170 => 19.0770, std.dev.: 0.0326) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0268) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0268) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.77% (4.5203 => 4.6003, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9762 => 4.0163, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 12 23:55:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 01:55:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413065552.3F4C12A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24615?compare_to=24607&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24615, Order: 206123, Start Time: 2014-04-13 02:21:47, End Time: 2014-04-13 07:01:43 To: 24607, Order: 206119, Start Time: 2014-04-12 21:38:43, End Time: 2014-04-13 02:18:28 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (149 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (2 on baseline) Unchanged Tests: 1102 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Regression/C/badidx: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Regression/C/test_indvars: 17.39% (0.0920 => 0.1080, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.80% (0.3160 => 0.3280, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 5.15% (0.3880 => 0.4080, std.dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 0.09% (51.5130 => 51.5570, std.dev.: 0.0821) SingleSource/Benchmarks/Misc/oourafft: 0.63% (0.6400 => 0.6440, std.dev.: 0.0101) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/7zip/7zip-benchmark: 3.05% (50.0290 => 51.5570, std.dev.: 0.0821) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0093) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0063) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0074) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C/badidx: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0058) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0059) SingleSource/Regression/C/test_indvars: 17.39% (0.0920 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/whetstone: 11.11% (0.1440 => 0.1600, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.02% (1.5601 => 1.7321, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0121) MultiSource/Applications/obsequi/Obsequi: 9.85% (1.8680 => 2.0520, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.26% (0.2160 => 0.2360, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0114) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0069) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.68% (1.6121 => 1.7521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.00% (0.7000 => 0.7560, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0100) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (6.4680 => 6.8920, std.dev.: 0.0464) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.45% (0.3720 => 0.3960, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (1.7400 => 1.8480, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0136) MultiSource/Applications/Burg/burg: 6.10% (1.5080 => 1.6000, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.08% (11.6440 => 12.3520, std.dev.: 0.0843) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.71% (5.8121 => 6.1441, std.dev.: 0.0310) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.48% (9.4842 => 10.0042, std.dev.: 0.0297) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 5.36% (1.7921 => 1.8881, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.05% (1.5841 => 1.6641, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.89% (6.5440 => 6.8640, std.dev.: 0.0295) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0104) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.0443 => 10.4923, std.dev.: 0.0342) MultiSource/Applications/JM/lencod/lencod: 4.28% (21.9606 => 22.9008, std.dev.: 0.0476) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (6.5080 => 6.7600, std.dev.: 0.0412) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (5.3600 => 5.5440, std.dev.: 0.0434) MultiSource/Applications/SPASS/SPASS: 3.43% (18.4404 => 19.0725, std.dev.: 0.0395) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0145) MultiSource/Applications/lua/lua: 3.26% (4.7880 => 4.9440, std.dev.: 0.0401) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 3.18% (38.4046 => 39.6246, std.dev.: 0.1049) MultiSource/Applications/ClamAV/clamscan: 2.86% (19.0444 => 19.5884, std.dev.: 0.0308) MultiSource/Applications/oggenc/oggenc: 2.81% (6.9844 => 7.1804, std.dev.: 0.0256) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (4.1843 => 4.3003, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.64% (3.0282 => 3.1082, std.dev.: 0.0127) MultiSource/Applications/treecc/treecc: 2.63% (2.5840 => 2.6520, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (16.3483 => 16.7603, std.dev.: 0.0386) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (1.1000 => 1.1240, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 2.07% (19.6891 => 20.0971, std.dev.: 0.0521) MultiSource/Applications/d/make_dparser: 1.81% (3.9681 => 4.0401, std.dev.: 0.0235) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (13.0563 => 13.2243, std.dev.: 0.0189) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0253) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.96% (2.1401 => 2.4602, std.dev.: 0.0439) MultiSource/Applications/siod/siod: 5.31% (2.8602 => 3.0122, std.dev.: 0.0261) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.15% (1.6521 => 1.7041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.72% (4.5603 => 4.6843, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.8481 => 0.8641, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.14% (10.6247 => 2.0041, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.43% (2.9442 => 0.9000, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4566 => 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.22% (91.8497 => 49.3991, std.dev.: 10.1039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.40% (26.0616 => 17.0971, std.dev.: 0.1325) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.20% (50.3031 => 33.0981, std.dev.: 0.1280) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.99% (42.1466 => 28.6618, std.dev.: 0.4544) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1089) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.99% (1.4041 => 1.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.07% (4.1243 => 4.0803, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -94.34% (11.3687 => 0.6440, std.dev.: 0.0101) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 00:16:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 02:16:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413071640.240AE2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24616?compare_to=24614&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24616, Order: 206124, Start Time: 2014-04-13 02:41:56, End Time: 2014-04-13 07:22:49 To: 24614, Order: 206123, Start Time: 2014-04-13 01:11:01, End Time: 2014-04-13 05:54:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (100 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 6.52% (0.3680 => 0.3920, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.82% (0.7560 => 0.8000, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.9001 => 0.9241, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.42% (1.3241 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.45% (1.3801 => 1.4001, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.15% (1.3881 => 1.4041, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0080) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.84% (0.6640 => 0.7360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.8561 => 0.9241, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0698) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0349) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.71% (0.7640 => 0.8000, std.dev.: 0.0138) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0623) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0150) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (4.9200 => 5.1240, std.dev.: 0.0389) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0570) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0767) MultiSource/Applications/sqlite3/sqlite3: 2.39% (23.7574 => 24.3255, std.dev.: 0.0296) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0498) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 2.07% (37.0925 => 37.8606, std.dev.: 0.0661) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.03% (48.1088 => 49.0849, std.dev.: 0.1021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0209) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0851, std.dev.: 0.0398) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0327) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 4.75% (6.6564 => 6.9724, std.dev.: 0.0652) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0102) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: 1.93% (2.0681 => 2.1081, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0244) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.28% (4.0643 => 4.1163, std.dev.: 0.0179) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0069) SingleSource/UnitTests/SignlessTypes/div: -33.33% (0.0360 => 0.0240, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -1.94% (2.8802 => 2.8242, std.dev.: 0.0175) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 00:21:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 02:21:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413072130.6458F2A6C03C@llvm.org> http://llvm.org/perf/db_default/v4/nts/24617?compare_to=24616&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24617, Order: 206125, Start Time: 2014-04-13 02:45:59, End Time: 2014-04-13 07:27:56 To: 24616, Order: 206124, Start Time: 2014-04-13 02:41:56, End Time: 2014-04-13 07:22:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (99 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 200.00% (0.0080 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 13.04% (0.0920 => 0.1040, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.61% (1.2401 => 1.2601, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.48% (1.3481 => 1.3681, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.33% (0.0360 => 0.0480, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 4.96% (2.0161 => 2.1161, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/pi: 1.65% (0.7280 => 0.7400, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.62% (5.4283 => 5.5163, std.dev.: 0.0301) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 29.63% (0.1080 => 0.1400, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0124) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0418) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.02% (10.6960 => 11.3400, std.dev.: 0.0771) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0683) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0192) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0486) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (10.4082 => 10.8162, std.dev.: 0.0369) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0360) MultiSource/Applications/JM/lencod/lencod: 2.97% (17.6165 => 18.1405, std.dev.: 0.0633) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0365) MultiSource/Applications/sqlite3/sqlite3: 2.41% (23.7574 => 24.3295, std.dev.: 0.0560) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.24% (48.1088 => 49.1850, std.dev.: 0.0624) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8485, std.dev.: 0.0676) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1131, std.dev.: 0.0362) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0169) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0516) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 4.69% (6.6564 => 6.9684, std.dev.: 0.0331) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0095) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 2.48% (5.8164 => 5.9604, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (4.0643 => 4.1363, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.4080 => 0.3720, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.70% (2.0561 => 1.9801, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -2.08% (2.8802 => 2.8202, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 00:25:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 02:25:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413072518.E88C02A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24618?compare_to=24609&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24618, Order: 206124, Start Time: 2014-04-13 02:44:19, End Time: 2014-04-13 07:31:43 To: 24609, Order: 206119, Start Time: 2014-04-12 21:53:20, End Time: 2014-04-13 02:40:53 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1094 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 10.71% (0.1120 => 0.1240, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 9.68% (0.1240 => 0.1360, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: 4.88% (0.3280 => 0.3440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (0.3240 => 0.3360, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.50% (1.8641 => 1.8921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.37% (1.7561 => 1.7801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.28% (1.8721 => 1.8961, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 1.13% (7.0724 => 7.1524, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 18.46% (0.2600 => 0.3080, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.01% (1.0481 => 1.1321, std.dev.: 0.0268) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/ccc: -37.50% (0.0320 => 0.0200, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 01:01:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 03:01:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140413080143.B2CE42A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24619?compare_to=24611&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24619, Order: 206125, Start Time: 2014-04-13 03:17:55, End Time: 2014-04-13 08:08:09 To: 24611, Order: 206120, Start Time: 2014-04-12 22:24:53, End Time: 2014-04-13 03:14:48 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (135 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 400.00% (0.0040 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: 28.57% (0.0560 => 0.0720, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 6.67% (0.2400 => 0.2560, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.28% (0.4880 => 0.5040, std.dev.: 0.0053) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.81% (0.6640 => 0.6760, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.7521 => 1.7761, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0060) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 36.17% (0.1880 => 0.2560, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.11% (1.7241 => 2.0881, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.11% (1.8001 => 2.1801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.06% (1.8041 => 2.1841, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.04% (1.7681 => 2.1401, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.99% (1.6961 => 2.0521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.76% (1.8881 => 2.2801, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.40% (1.9801 => 2.3841, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.36% (1.7481 => 2.1041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.22% (1.8201 => 2.1881, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.86% (1.6921 => 2.0281, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.82% (1.8361 => 2.2001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.57% (1.6761 => 2.0041, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.98% (1.9601 => 2.3321, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.94% (1.9641 => 2.3361, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.82% (1.9761 => 2.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.18% (1.9801 => 2.3401, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.64% (0.1880 => 0.2080, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.89% (3.5002 => 3.7762, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.27% (0.4400 => 0.4720, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.18% (0.7800 => 0.8360, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.8120 => 0.8680, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (11.7880 => 12.5280, std.dev.: 0.0597) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.19% (6.7200 => 7.1360, std.dev.: 0.0354) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 5.71% (1.8201 => 1.9241, std.dev.: 0.0145) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.29% (0.7560 => 0.7960, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (9.9842 => 10.4562, std.dev.: 0.0388) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0240) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0129) MultiSource/Applications/lua/lua: 4.51% (4.7920 => 5.0080, std.dev.: 0.0279) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.5240 => 1.5920, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0212) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3040 => 0.3160, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 3.93% (6.9124 => 7.1844, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0192) MultiSource/Applications/JM/ldecod/ldecod: 3.84% (10.3203 => 10.7164, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (6.8321 => 7.0841, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.47% (1.0361 => 1.0721, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 3.36% (2.6200 => 2.7080, std.dev.: 0.0250) MultiSource/Applications/JM/lencod/lencod: 3.34% (22.6287 => 23.3848, std.dev.: 0.0598) MultiSource/Applications/SPASS/SPASS: 3.33% (18.4924 => 19.1086, std.dev.: 0.0528) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0135) MultiSource/Applications/d/make_dparser: 3.23% (3.9641 => 4.0921, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.8440 => 0.8680, std.dev.: 0.0065) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.70% (51.1089 => 52.4889, std.dev.: 0.1109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0119) MultiSource/Applications/ClamAV/clamscan: 2.33% (20.2445 => 20.7165, std.dev.: 0.0443) MultiSource/Applications/kimwitu++/kc: 2.29% (19.7371 => 20.1891, std.dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (2.1560 => 2.2040, std.dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: 2.12% (38.9366 => 39.7606, std.dev.: 0.0845) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0093) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 1.76% (25.1895 => 25.6336, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (16.5963 => 16.8523, std.dev.: 0.0745) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0244 => 6.1164, std.dev.: 0.0245) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 26.29% (0.9281 => 1.1721, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.51% (1.2681 => 1.4521, std.dev.: 0.0419) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0119) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.55% (21.6534 => 21.9894, std.dev.: 0.1222) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.47% (1.0881 => 1.1041, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.43% (4.7563 => 4.8243, std.dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (4.2443 => 4.3043, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.58% (6.2884 => 0.8440, std.dev.: 0.0100) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/nestedloop: -60.19% (2.9642 => 1.1801, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0096) MultiSource/Applications/obsequi/Obsequi: -20.70% (2.6481 => 2.1000, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.79% (7.4801 => 6.2240, std.dev.: 0.0436) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.89% (7.5041 => 6.3120, std.dev.: 0.0380) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0037) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: -5.41% (0.2960 => 0.2800, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -2.66% (13.5243 => 13.1643, std.dev.: 0.0424) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0243) MultiSource/Benchmarks/sim/sim: -1.76% (4.9883 => 4.9003, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -1.10% (11.6527 => 11.5247, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.07% (3.3602 => 3.3242, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 6.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 01:04:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 03:04:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140413080422.E75342A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24620?compare_to=24612&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24620, Order: 206126, Start Time: 2014-04-13 03:27:27, End Time: 2014-04-13 08:10:48 To: 24612, Order: 206120, Start Time: 2014-04-12 22:42:06, End Time: 2014-04-13 03:24:11 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (8 on baseline) Performance Regressions: 8 (138 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (3 on baseline) Unchanged Tests: 1101 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 28.57% (0.0560 => 0.0720, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/em3d/em3d: 18.37% (0.1960 => 0.2320, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.90% (0.2320 => 0.2480, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.81% (0.6640 => 0.6760, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.17% (0.9481 => 1.0161, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: -0.09% (51.6290 => 51.5810, std.dev.: 0.0882) SingleSource/Benchmarks/Misc/oourafft: - (0.6440 => 0.6440, std.dev.: 0.0084) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: 11.20% (17.6723 => 19.6524, std.dev.: 0.0698) MultiSource/Applications/sqlite3/sqlite3: 1418.12% (1.7001 => 25.8096, std.dev.: 0.0386) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.80% (1.0520 => 1.0920, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (11.3920 => 12.3600, std.dev.: 0.0610) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0082) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0045) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.36% (2.1361 => 2.4642, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 12.90% (0.1240 => 0.1400, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.82% (0.1560 => 0.1760, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.55% (1.9761 => 2.2241, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.00% (1.9001 => 2.1281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.98% (2.1041 => 2.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.50% (2.0521 => 2.2881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.18% (1.8601 => 2.0681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.88% (1.9481 => 2.1601, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8881 => 0.9601, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: 7.25% (1.8760 => 2.0120, std.dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.67% (0.1800 => 0.1920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.67% (0.2400 => 0.2560, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (1.6960 => 1.8080, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0186) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.21% (0.7080 => 0.7520, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.61% (1.2120 => 1.2800, std.dev.: 0.0227) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0420) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.48% (0.2920 => 0.3080, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.43% (6.4800 => 6.8320, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0202) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.03% (1.7480 => 1.8360, std.dev.: 0.0160) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (9.6042 => 10.0722, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.78% (6.5320 => 6.8440, std.dev.: 0.0341) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0131) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: 4.45% (1.5280 => 1.5960, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.2283 => 10.6684, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (5.8281 => 6.0681, std.dev.: 0.0509) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (6.5360 => 6.7880, std.dev.: 0.0321) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0075) MultiSource/Applications/treecc/treecc: 3.71% (2.5880 => 2.6840, std.dev.: 0.0197) MultiSource/Applications/hbd/hbd: 3.70% (1.7280 => 1.7920, std.dev.: 0.0226) MultiSource/Applications/lua/lua: 3.09% (4.7920 => 4.9400, std.dev.: 0.0333) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (16.3003 => 16.7683, std.dev.: 0.0424) MultiSource/Applications/oggenc/oggenc: 2.78% (7.0524 => 7.2485, std.dev.: 0.0220) MultiSource/Applications/JM/lencod/lencod: 2.77% (22.2206 => 22.8367, std.dev.: 0.0663) MultiSource/Benchmarks/Bullet/bullet: 2.54% (38.6366 => 39.6166, std.dev.: 0.0681) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.3960 => 5.5320, std.dev.: 0.0508) MultiSource/Applications/SPASS/SPASS: 2.48% (18.5284 => 18.9885, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.86% (1.5040 => 1.5320, std.dev.: 0.0108) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (13.0363 => 13.2283, std.dev.: 0.0308) MultiSource/Applications/kimwitu++/kc: 1.39% (19.8291 => 20.1051, std.dev.: 0.0540) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.66% (2.1201 => 2.4522, std.dev.: 0.0335) MultiSource/Applications/siod/siod: 5.03% (2.8642 => 3.0082, std.dev.: 0.0416) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0033) MultiSource/Applications/obsequi/Obsequi: 2.35% (2.0441 => 2.0921, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: 2.24% (6.5964 => 6.7444, std.dev.: 0.0213) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (3.9442 => 4.0042, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (3.7442 => 3.7962, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.54% (10.4007 => 2.0241, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.74% (0.6880 => 0.6760, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.05% (94.8339 => 49.2631, std.dev.: 10.3581) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.84% (25.7136 => 17.0131, std.dev.: 0.2165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.80% (49.9431 => 33.0621, std.dev.: 0.1277) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.65% (37.0863 => 28.3138, std.dev.: 0.6328) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.57% (3.0722 => 2.3481, std.dev.: 0.1167) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.83% (2.8442 => 2.7922, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.58% (1.2681 => 1.2481, std.dev.: 0.0070) MultiSource/Benchmarks/BitBench/five11/five11: -1.36% (2.3521 => 2.3201, std.dev.: 0.0098) MultiSource/Benchmarks/sim/sim: -1.09% (4.7883 => 4.7363, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 2.95% (50.1010 => 51.5810, std.dev.: 0.0882) SingleSource/Benchmarks/Misc/oourafft: -94.32% (11.3407 => 0.6440, std.dev.: 0.0084) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 01:05:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 03:05:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413080529.81D1A2A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24621?compare_to=24617&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24621, Order: 206126, Start Time: 2014-04-13 03:26:08, End Time: 2014-04-13 08:11:59 To: 24617, Order: 206125, Start Time: 2014-04-13 02:45:59, End Time: 2014-04-13 07:27:56 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (105 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.98% (0.1720 => 0.1840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.28% (1.2521 => 1.2681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.26% (1.2721 => 1.2881, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 27.27% (0.0880 => 0.1120, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.39% (1.0841 => 1.2401, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/health/health: 6.45% (0.3720 => 0.3960, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 6.28% (0.9561 => 1.0161, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.06% (0.3160 => 0.3320, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/simul/simul: -15.79% (0.0760 => 0.0640, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0032) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0071) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.8561 => 0.9241, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0627) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.05% (0.6240 => 0.6680, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0439) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0240) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0287) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0191) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0413) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0483) MultiSource/Applications/hbd/hbd: 3.33% (1.6800 => 1.7360, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0336) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0656) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0526) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0363) MultiSource/Applications/sqlite3/sqlite3: 2.39% (23.7574 => 24.3255, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0103) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.05% (48.1088 => 49.0969, std.dev.: 0.0668) MultiSource/Benchmarks/Bullet/bullet: 1.94% (37.0925 => 37.8126, std.dev.: 0.0680) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0097) MultiSource/Applications/SPASS/SPASS: 1.39% (17.5484 => 17.7924, std.dev.: 0.0457) MultiSource/Applications/kimwitu++/kc: 1.36% (18.8170 => 19.0730, std.dev.: 0.0532) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 26.61% (0.9321 => 1.1801, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 9.15% (1.1361 => 1.2401, std.dev.: 0.0194) MultiSource/Applications/minisat/minisat: 4.81% (6.6564 => 6.9764, std.dev.: 0.0285) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/lists: 2.54% (5.8164 => 5.9644, std.dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: 2.31% (5.0123 => 5.1283, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 01:25:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 03:25:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140413082508.8068C2A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24622?compare_to=24613&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24622, Order: 206126, Start Time: 2014-04-13 03:41:27, End Time: 2014-04-13 08:31:35 To: 24613, Order: 206120, Start Time: 2014-04-12 22:48:23, End Time: 2014-04-13 03:38:10 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (149 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/compare: 250.00% (0.0080 => 0.0280, std.dev.: 0.0039) SingleSource/UnitTests/2002-05-02-CastTest2: 200.00% (0.0080 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C/ConstructorDestructorAttributes: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2005-05-12-Int64ToFP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 80.00% (0.0200 => 0.0360, std.dev.: 0.0030) SingleSource/UnitTests/2002-12-13-MishaTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.96% (0.8161 => 0.8321, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.14% (12.2560 => 12.3960, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.09% (1.4681 => 1.4841, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 11.76% (0.2720 => 0.3040, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.61% (0.2640 => 0.2920, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2437.81% (0.0320 => 0.8121, std.dev.: 0.0066) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 994.87% (0.0760 => 0.8321, std.dev.: 0.0037) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0085) SingleSource/Regression/C/ConstructorDestructorAttributes: 400.00% (0.0040 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0150) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0197) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0041) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0038) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0045) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0081) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0148) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) MultiSource/Applications/obsequi/Obsequi: 43.39% (1.3920 => 1.9960, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0076) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.00% (1.2001 => 1.4761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.63% (1.1841 => 1.4521, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.05% (0.1520 => 0.1840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.69% (1.1601 => 1.4001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.45% (1.2321 => 1.4841, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.17% (1.3681 => 1.6441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 18.98% (8.5802 => 10.2083, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.21% (1.2521 => 1.4801, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0087) MultiSource/Applications/sgefa/sgefa: 16.96% (0.4480 => 0.5240, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 15.70% (19.5406 => 22.6087, std.dev.: 0.0694) MultiSource/Benchmarks/nbench/nbench: 15.09% (1.3521 => 1.5561, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: 14.89% (0.3760 => 0.4320, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.54% (5.3360 => 6.1121, std.dev.: 0.0349) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0210) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.71% (0.3360 => 0.3720, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 9.49% (11.3843 => 12.4643, std.dev.: 0.0400) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0142) MultiSource/Applications/oggenc/oggenc: 8.78% (6.2844 => 6.8364, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.38% (5.7280 => 6.2080, std.dev.: 0.0537) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.32% (11.4440 => 12.3960, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.69% (5.6680 => 6.1040, std.dev.: 0.0596) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.2200 => 0.2360, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (9.5802 => 10.2282, std.dev.: 0.0533) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0213) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (1.1240 => 1.1840, std.dev.: 0.0184) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0061) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 4.53% (4.7720 => 4.9880, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0108) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (6.8280 => 7.0880, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/gs/gs: 3.57% (5.3840 => 5.5760, std.dev.: 0.0346) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.34% (49.1529 => 50.7969, std.dev.: 0.0663) MultiSource/Applications/ClamAV/clamscan: 3.16% (19.2243 => 19.8324, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0108) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 2.76% (24.7575 => 25.4415, std.dev.: 0.0293) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 1.74% (19.7491 => 20.0931, std.dev.: 0.0422) MultiSource/Benchmarks/Bullet/bullet: 1.73% (39.0726 => 39.7486, std.dev.: 0.0442) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0124 => 6.1004, std.dev.: 0.0233) MultiSource/Applications/SPASS/SPASS: 1.15% (18.7966 => 19.0125, std.dev.: 0.0625) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.80% (6.6644 => 17.1811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 18.18% (0.9241 => 1.0921, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0379) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.72% (3.2362 => 3.3242, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.3085 => 7.4765, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.60% (11.0207 => 2.0281, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -8.52% (3.4722 => 3.1762, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0953) MultiSource/Applications/siod/siod: -5.90% (2.9842 => 2.8082, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (4.1243 => 4.0443, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -1.84% (4.9963 => 4.9043, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.0963 => 5.0363, std.dev.: 0.0228) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 01:59:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 03:59:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413085909.875B32A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24623?compare_to=24621&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24623, Order: 206127, Start Time: 2014-04-13 04:26:08, End Time: 2014-04-13 09:05:34 To: 24621, Order: 206126, Start Time: 2014-04-13 03:26:08, End Time: 2014-04-13 08:11:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (108 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.00% (0.1000 => 0.1240, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 14.63% (0.1640 => 0.1880, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: 4.60% (0.3480 => 0.3640, std.dev.: 0.0049) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.59% (1.2240 => 1.2680, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.23% (0.3720 => 0.3840, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.10% (0.9521 => 0.9721, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.60% (1.2481 => 1.2681, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.32% (6.3720 => 6.4560, std.dev.: 0.0281) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.90% (1.2401 => 1.0801, std.dev.: 0.0574) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0708) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.2560 => 0.2720, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.67% (0.9880 => 1.0440, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0342) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0333) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.2200 => 1.2680, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0231) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0353) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0114) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 3.27% (17.6165 => 18.1925, std.dev.: 0.0440) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (7.8562 => 8.0922, std.dev.: 0.0269) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0305) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0726) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0470) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1210, std.dev.: 0.0623) MultiSource/Benchmarks/Bullet/bullet: 1.92% (37.0925 => 37.8045, std.dev.: 0.0847) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0124) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 1.36% (18.8170 => 19.0730, std.dev.: 0.0400) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0198) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0573) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 5.05% (6.6564 => 6.9924, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.33% (4.5603 => 4.7123, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (0.6000 => 0.6160, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.95% (4.5203 => 4.6083, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 03:43:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 05:43:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413104305.064472A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24624?compare_to=24623&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24624, Order: 206129, Start Time: 2014-04-13 06:07:14, End Time: 2014-04-13 10:49:30 To: 24623, Order: 206127, Start Time: 2014-04-13 04:26:08, End Time: 2014-04-13 09:05:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (105 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.09% (0.3960 => 0.4320, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.67% (0.1800 => 0.1920, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 6.59% (0.3640 => 0.3880, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2160 => 0.2280, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.63% (1.2281 => 1.2481, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.83% (0.0960 => 0.1160, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: 6.32% (0.3800 => 0.4040, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (1.2641 => 1.2921, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 29.63% (0.1080 => 0.1400, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0136) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.7400 => 0.7920, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0387) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0664) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.67% (0.9880 => 1.0440, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (8.1441 => 8.5921, std.dev.: 0.0278) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0198) MultiSource/Applications/hexxagon/hexxagon: 4.98% (1.1240 => 1.1800, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.7080 => 1.7840, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0493) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (10.4082 => 10.8282, std.dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0071) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 3.34% (17.6165 => 18.2045, std.dev.: 0.0394) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0444) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0258) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0403) MultiSource/Benchmarks/Bullet/bullet: 2.58% (37.0925 => 38.0485, std.dev.: 0.0941) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.43% (48.1088 => 49.2769, std.dev.: 0.0935) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (5.8400 => 5.9640, std.dev.: 0.0415) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 2.08% (18.8170 => 19.2091, std.dev.: 0.0541) MultiSource/Applications/sqlite3/sqlite3: 1.99% (23.7574 => 24.2295, std.dev.: 0.0323) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0145) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.46% (0.9321 => 1.1881, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 4.87% (6.6564 => 6.9804, std.dev.: 0.0248) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/lists: 2.61% (5.8164 => 5.9684, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.54% (1.2601 => 1.2921, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.86% (4.5203 => 4.6043, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.61% (3.2242 => 3.2762, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.84% (7.7485 => 6.6764, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: -1.34% (2.3841 => 2.3521, std.dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 04:48:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 06:48:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413114854.1420B2A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24625?compare_to=24615&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24625, Order: 206130, Start Time: 2014-04-13 07:15:01, End Time: 2014-04-13 11:55:19 To: 24615, Order: 206123, Start Time: 2014-04-13 02:21:47, End Time: 2014-04-13 07:01:43 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 14 (162 on baseline) Performance Improvements: 2 (28 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (2 on baseline) Unchanged Tests: 1093 (917 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 12.12% (0.1320 => 0.1480, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.26% (0.1560 => 0.1720, std.dev.: 0.0054) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.07% (0.6440 => 0.6960, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary3: 5.26% (0.3040 => 0.3200, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 5.05% (0.3960 => 0.4160, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.18% (1.6881 => 1.7081, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (0.6040 => 0.6240, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.0443 => 4.1203, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.41% (1.7041 => 1.7281, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.70% (2.8242 => 2.7762, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.27% (4.0803 => 4.0283, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: -0.06% (51.5570 => 51.5250, std.dev.: 0.0986) SingleSource/Benchmarks/Misc/oourafft: 0.62% (0.6440 => 0.6480, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/7zip/7zip-benchmark: 2.99% (50.0290 => 51.5250, std.dev.: 0.0986) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 400.00% (0.0040 => 0.0200, std.dev.: 0.0048) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0060) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0060) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0053) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.55% (0.2920 => 0.3520, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.65% (0.2040 => 0.2400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 17.24% (0.1160 => 0.1360, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0164) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.80% (1.4241 => 1.5921, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0095) SingleSource/Regression/C/bigstack: 10.87% (0.1840 => 0.2040, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.34% (1.5481 => 1.7081, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.23% (0.7040 => 0.7760, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0071) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0044) MultiSource/Applications/obsequi/Obsequi: 8.78% (1.8680 => 2.0320, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0156) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.7841 => 1.9361, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary2: 8.22% (0.2920 => 0.3160, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.9800 => 1.0600, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary3: 8.11% (0.2960 => 0.3200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.05% (1.5401 => 1.6641, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0121) MultiSource/Applications/Burg/burg: 7.43% (1.5080 => 1.6200, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/matrix: 7.25% (0.2760 => 0.2960, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.87% (1.1640 => 1.2440, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: 6.74% (1.1280 => 1.2040, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.45% (0.3720 => 0.3960, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.41% (1.4361 => 1.5281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (11.6440 => 12.3800, std.dev.: 0.0762) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.22% (1.4801 => 1.5721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0146) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.2600 => 0.2760, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (6.4680 => 6.8400, std.dev.: 0.0726) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (9.4842 => 10.0202, std.dev.: 0.0506) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.36% (0.2240 => 0.2360, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (5.8121 => 6.1201, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0201) MultiSource/Benchmarks/McCat/09-vor/vor: 5.05% (0.3960 => 0.4160, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (1.7921 => 1.8801, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.82% (1.6601 => 1.7401, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.61% (6.5080 => 6.8080, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0267) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.52% (6.5440 => 6.8400, std.dev.: 0.0413) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.0443 => 10.4683, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 4.00% (38.4046 => 39.9406, std.dev.: 0.0662) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0227) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 3.75% (21.9606 => 22.7848, std.dev.: 0.0759) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 3.38% (6.9844 => 7.2205, std.dev.: 0.0179) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (5.3600 => 5.5400, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 2.89% (18.4404 => 18.9726, std.dev.: 0.0417) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0151) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0103) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0365) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5283, std.dev.: 0.0494) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (4.1843 => 4.2843, std.dev.: 0.0182) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (16.3483 => 16.7283, std.dev.: 0.0586) MultiSource/Applications/kimwitu++/kc: 1.95% (19.6891 => 20.0731, std.dev.: 0.0344) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (13.0563 => 13.2123, std.dev.: 0.0328) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (6.1044 => 6.1764, std.dev.: 0.0146) MultiSource/Benchmarks/PAQ8p/paq8p: 1.00% (2.7922 => 2.8202, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 24.67% (0.9241 => 1.1521, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.21% (2.1401 => 2.4442, std.dev.: 0.0397) MultiSource/Benchmarks/llubenchmark/llu: 6.42% (5.1123 => 5.4403, std.dev.: 0.0980) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 3.92% (2.8602 => 2.9722, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 3.42% (3.9842 => 4.1203, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 3.13% (7.4205 => 7.6525, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: 2.34% (2.0521 => 2.1001, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (3.9922 => 4.0603, std.dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0112) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.00% (0.0640 => 0.0480, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4566 => 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.00% (91.8497 => 49.5991, std.dev.: 10.0554) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.60% (50.3031 => 32.8981, std.dev.: 0.2011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.38% (26.0616 => 17.1011, std.dev.: 0.0926) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.19% (42.1466 => 28.5778, std.dev.: 0.6146) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1119) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -7.05% (0.6240 => 0.5800, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.33% (4.1243 => 4.0283, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.71% (1.4041 => 1.3801, std.dev.: 0.0092) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -1.50% (4.7883 => 4.7163, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -94.30% (11.3687 => 0.6480, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 05:10:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 07:10:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413121052.0DC712A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24626?compare_to=24624&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24626, Order: 206130, Start Time: 2014-04-13 07:35:49, End Time: 2014-04-13 12:17:21 To: 24624, Order: 206129, Start Time: 2014-04-13 06:07:14, End Time: 2014-04-13 10:49:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (94 on baseline) Performance Improvements: 5 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (1000 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.56% (0.2360 => 0.2680, std.dev.: 0.0104) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.33% (0.2400 => 0.2600, std.dev.: 0.0064) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (1.1000 => 1.1480, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.70% (0.4440 => 0.4560, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 17.19% (0.2560 => 0.3000, std.dev.: 0.0123) MultiSource/Applications/siod/siod: 3.97% (2.8242 => 2.9362, std.dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -3.67% (6.9804 => 6.7244, std.dev.: 0.0374) MultiSource/Benchmarks/sim/sim: -1.78% (4.7243 => 4.6403, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.52% (3.9402 => 3.8802, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.48% (2.9682 => 2.9242, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -1.17% (4.1003 => 4.0523, std.dev.: 0.0156) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0093) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.42% (1.2401 => 1.3321, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0069) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0694) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0574) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.59% (0.4360 => 0.4560, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0547) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0217) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0360) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0248) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0303) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 3.34% (17.6165 => 18.2045, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0279) MultiSource/Applications/lua/lua: 2.92% (4.5200 => 4.6520, std.dev.: 0.0408) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 2.42% (37.0925 => 37.9885, std.dev.: 0.0582) MultiSource/Applications/sqlite3/sqlite3: 2.16% (23.7574 => 24.2695, std.dev.: 0.0237) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0380) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.83% (48.1088 => 48.9889, std.dev.: 0.1199) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 1.08% (18.8170 => 19.0210, std.dev.: 0.0507) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0211) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0100) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.30% (4.5203 => 4.6243, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.86% (3.2242 => 3.2842, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.23% (21.1533 => 21.4133, std.dev.: 0.0936) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0082) SingleSource/UnitTests/SignlessTypes/div: -44.44% (0.0360 => 0.0200, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0098) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 05:25:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 07:25:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413122518.B9D202A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24627?compare_to=24618&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24627, Order: 206130, Start Time: 2014-04-13 07:44:29, End Time: 2014-04-13 12:31:48 To: 24618, Order: 206124, Start Time: 2014-04-13 02:44:19, End Time: 2014-04-13 07:31:43 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1091 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-LocalTypeTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/short_circuit_dtor: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-6: 30.00% (0.0400 => 0.0520, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 8.47% (0.2360 => 0.2560, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 8.47% (0.2360 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.16% (0.1960 => 0.2120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2400 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 6.56% (0.4880 => 0.5200, std.dev.: 0.0122) MultiSource/Benchmarks/sim/sim: 6.25% (0.3840 => 0.4080, std.dev.: 0.0066) SingleSource/Regression/C++/ofstream_ctor: 4.92% (0.2440 => 0.2560, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 1.13% (4.9760 => 5.0320, std.dev.: 0.0203) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.95% (0.1720 => 0.1960, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 8.98% (0.6680 => 0.7280, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 06:00:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 08:00:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140413130019.F139E2A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24628?compare_to=24620&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24628, Order: 206130, Start Time: 2014-04-13 08:23:36, End Time: 2014-04-13 13:06:49 To: 24620, Order: 206126, Start Time: 2014-04-13 03:27:27, End Time: 2014-04-13 08:10:48 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (8 on baseline) Performance Regressions: 10 (143 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (3 on baseline) Unchanged Tests: 1097 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.79% (0.2280 => 0.2640, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.76% (0.2520 => 0.2640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 4.72% (0.5080 => 0.5320, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: 4.71% (0.3400 => 0.3560, std.dev.: 0.0055) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.79% (1.2920 => 1.3280, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.11% (3.7962 => 3.8762, std.dev.: 0.0277) MultiSource/Benchmarks/Olden/tsp/tsp: 1.85% (1.2961 => 1.3201, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.70% (2.8162 => 2.7682, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.27% (4.1003 => 4.0483, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 0.15% (51.5810 => 51.6570, std.dev.: 0.0762) SingleSource/Benchmarks/Misc/oourafft: -1.86% (0.6440 => 0.6320, std.dev.: 0.0126) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: 10.89% (17.6723 => 19.5963, std.dev.: 0.0724) MultiSource/Applications/sqlite3/sqlite3: 1418.36% (1.7001 => 25.8136, std.dev.: 0.0362) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.74% (11.3920 => 12.3880, std.dev.: 0.0605) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0563, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3521, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0059) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) SingleSource/UnitTests/Vector/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.51% (1.9601 => 2.2641, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.62% (1.8601 => 2.1321, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.61% (1.9161 => 2.1961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.74% (1.8921 => 2.1521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.06% (2.1441 => 2.4242, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.01% (1.8761 => 2.1201, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (1.9761 => 2.2041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (0.1800 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.64% (2.0681 => 2.2881, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2280 => 0.2520, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: 8.74% (1.8760 => 2.0400, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2440 => 0.2640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 8.13% (0.4920 => 0.5320, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.11% (0.1480 => 0.1600, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.11% (0.7400 => 0.8000, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.55% (0.6360 => 0.6840, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0093) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (6.4800 => 6.8800, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.7280 => 0.7720, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sieve: 5.95% (0.3360 => 0.3560, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0225) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0078) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.19% (0.6160 => 0.6480, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.03% (1.7480 => 1.8360, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (6.5320 => 6.8480, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (5.8281 => 6.0681, std.dev.: 0.0313) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.2283 => 10.6484, std.dev.: 0.0309) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.68% (0.5440 => 0.5640, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0096) MultiSource/Applications/Burg/burg: 3.66% (1.5280 => 1.5840, std.dev.: 0.0208) MultiSource/Benchmarks/Bullet/bullet: 3.30% (38.6366 => 39.9126, std.dev.: 0.0607) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (6.5360 => 6.7440, std.dev.: 0.0476) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (2.1600 => 2.2280, std.dev.: 0.0193) MultiSource/Applications/treecc/treecc: 2.94% (2.5880 => 2.6640, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 2.77% (22.2206 => 22.8368, std.dev.: 0.0388) MultiSource/Applications/lua/lua: 2.75% (4.7920 => 4.9240, std.dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (2.3401 => 2.4042, std.dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 2.66% (18.5284 => 19.0206, std.dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (1.0840 => 1.1120, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (16.3003 => 16.7083, std.dev.: 0.0594) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0248) MultiSource/Applications/siod/siod: 1.74% (2.7522 => 2.8002, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 1.61% (19.8291 => 20.1491, std.dev.: 0.0431) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7842 => 2.8202, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.85% (2.1201 => 2.4562, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0112) MultiSource/Applications/siod/siod: 3.77% (2.8642 => 2.9722, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.53% (3.7442 => 3.8762, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 2.48% (1.2881 => 1.3201, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 2.36% (6.5964 => 6.7524, std.dev.: 0.0304) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.93% (94.8339 => 49.3791, std.dev.: 10.3257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.72% (49.9431 => 33.1021, std.dev.: 0.2380) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.67% (25.7136 => 17.0571, std.dev.: 0.1010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.15% (37.0863 => 28.5018, std.dev.: 0.4523) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.1079) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (4.1123 => 4.0483, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 3.11% (50.1010 => 51.6570, std.dev.: 0.0762) SingleSource/Benchmarks/Misc/oourafft: -94.43% (11.3407 => 0.6320, std.dev.: 0.0126) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 06:04:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 08:04:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140413130442.5B0602A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24629?compare_to=24619&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24629, Order: 206130, Start Time: 2014-04-13 08:20:58, End Time: 2014-04-13 13:11:11 To: 24619, Order: 206125, Start Time: 2014-04-13 03:17:55, End Time: 2014-04-13 08:08:09 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (135 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/tls: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.56% (0.1800 => 0.2080, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.17% (0.4360 => 0.4760, std.dev.: 0.0100) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3800 => 0.3960, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.4520 => 0.4680, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 3.27% (0.8560 => 0.8840, std.dev.: 0.0103) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.30% (1.3920 => 1.4240, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: 1.07% (39.7606 => 40.1846, std.dev.: 0.0341) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/treeadd/treeadd: 8.93% (0.2240 => 0.2440, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.87% (0.3560 => 0.3840, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (5.5603 => 5.7084, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.22% (3.7922 => 3.8762, std.dev.: 0.0170) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.41% (9.6246 => 9.7606, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7121 => 1.7321, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0123) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0067) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/dt: 35.71% (0.0560 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.15% (1.7401 => 2.1081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.11% (1.8001 => 2.1801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.84% (1.8041 => 2.1801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.59% (1.7681 => 2.1321, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.42% (1.7241 => 2.0761, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.05% (1.6761 => 2.0121, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.69% (1.8281 => 2.1881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.08% (1.9081 => 2.2721, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0107) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.46% (0.2080 => 0.2360, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.42% (0.6120 => 0.6880, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0052) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.18% (0.4400 => 0.4760, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4360 => 0.4680, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.14% (0.7840 => 0.8400, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.7800 => 0.8320, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0394) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.7200 => 0.7640, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.04% (11.7880 => 12.5000, std.dev.: 0.0621) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.59% (0.6440 => 0.6800, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.54% (1.7320 => 1.8280, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0215) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (9.9842 => 10.4722, std.dev.: 0.0290) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (2.0680 => 2.1520, std.dev.: 0.0286) MultiSource/Applications/lua/lua: 3.92% (4.7920 => 4.9800, std.dev.: 0.0423) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.79% (1.3720 => 1.4240, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 3.70% (6.9124 => 7.1684, std.dev.: 0.0173) MultiSource/Applications/d/make_dparser: 3.53% (3.9641 => 4.1041, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (2.0440 => 2.1120, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (6.8321 => 7.0561, std.dev.: 0.0347) MultiSource/Applications/minisat/minisat: 3.27% (0.8560 => 0.8840, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 3.21% (38.9366 => 40.1846, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 3.01% (18.4924 => 19.0485, std.dev.: 0.0530) MultiSource/Applications/JM/lencod/lencod: 3.01% (22.6287 => 23.3088, std.dev.: 0.0772) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.92% (51.1089 => 52.6009, std.dev.: 0.1163) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (10.3203 => 10.6083, std.dev.: 0.0572) MultiSource/Applications/kimwitu++/kc: 2.47% (19.7371 => 20.2251, std.dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 2.00% (20.2445 => 20.6485, std.dev.: 0.0569) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (16.5963 => 16.9043, std.dev.: 0.0514) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.79% (6.0244 => 6.1324, std.dev.: 0.0231) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 1.48% (25.1895 => 25.5616, std.dev.: 0.0407) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.9281 => 1.1601, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0531) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 8.25% (1.2121 => 1.3121, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.11% (5.5363 => 5.7084, std.dev.: 0.0418) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 2.11% (21.6534 => 22.1094, std.dev.: 0.0925) SingleSource/Benchmarks/Misc/whetstone: 1.95% (1.4361 => 1.4641, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (4.0203 => 4.0683, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.07% (4.4883 => 4.5363, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0144) SingleSource/UnitTests/Vector/constpool: -81.45% (10.9087 => 2.0241, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: -20.85% (2.6481 => 2.0960, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.20% (7.4801 => 6.2680, std.dev.: 0.0289) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.99% (7.5041 => 6.3040, std.dev.: 0.0429) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0070) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: -2.69% (13.5243 => 13.1603, std.dev.: 0.0358) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0058) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -14.87% (7.8005 => 6.6404, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0049) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (5.1603 => 5.0043, std.dev.: 0.0197) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -1.13% (2.8282 => 2.7962, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 06:20:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 08:20:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413132021.DA2192A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24630?compare_to=24626&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24630, Order: 206132, Start Time: 2014-04-13 08:41:18, End Time: 2014-04-13 13:26:49 To: 24626, Order: 206130, Start Time: 2014-04-13 07:35:49, End Time: 2014-04-13 12:17:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (96 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/Large/cast: 36.36% (0.0440 => 0.0600, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.25% (0.0640 => 0.0840, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.67% (0.2160 => 0.2520, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.26% (0.2160 => 0.2360, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.33% (0.3600 => 0.3720, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 2.78% (0.4320 => 0.4440, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 2.09% (0.9560 => 0.9760, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.80% (1.3321 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.60% (1.2481 => 1.2681, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 8.04% (1.2441 => 1.3441, std.dev.: 0.0237) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0066) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0086) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0122) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.90% (0.3480 => 0.3720, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (10.6960 => 11.3360, std.dev.: 0.0835) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0147) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0257) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0305) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (8.1441 => 8.4521, std.dev.: 0.0415) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0378) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0239) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.03% (1.1880 => 1.2240, std.dev.: 0.0135) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0503) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0337) MultiSource/Applications/sqlite3/sqlite3: 2.48% (23.7574 => 24.3455, std.dev.: 0.0212) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9085, std.dev.: 0.0939) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0313) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.18% (48.1088 => 49.1569, std.dev.: 0.0764) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0087) MultiSource/Applications/kimwitu++/kc: 1.59% (18.8170 => 19.1170, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0177) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 1.19% (17.5484 => 17.7564, std.dev.: 0.0590) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 24.89% (0.9321 => 1.1641, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.01% (1.2561 => 1.3441, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0122) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.98% (3.2242 => 3.2882, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.04% (21.1533 => 21.3733, std.dev.: 0.0795) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0176) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 06:27:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 08:27:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140413132737.424F82A6C042@llvm.org> http://llvm.org/perf/db_default/v4/nts/24631?compare_to=24622&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24631, Order: 206132, Start Time: 2014-04-13 08:44:19, End Time: 2014-04-13 13:34:08 To: 24622, Order: 206126, Start Time: 2014-04-13 03:41:27, End Time: 2014-04-13 08:31:35 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 8 (158 on baseline) Performance Improvements: 3 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (930 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: 12.00% (0.1000 => 0.1120, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.23% (0.5680 => 0.5920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 3.53% (0.3400 => 0.3520, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.59% (0.4640 => 0.4760, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 1.12% (9.6766 => 9.7846, std.dev.: 0.0262) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) SingleSource/UnitTests/2002-12-13-MishaTest: -42.86% (0.0280 => 0.0160, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops: -18.87% (8.9446 => 7.2565, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 994.87% (0.0760 => 0.8321, std.dev.: 0.0070) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 327.63% (0.2320 => 0.9921, std.dev.: 0.0098) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: 300.00% (0.0280 => 0.1120, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0134) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0027) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0082) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0054) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0053) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.31% (1.2160 => 1.5481, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.30% (1.1841 => 1.4481, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.42% (1.1361 => 1.3681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.79% (1.1321 => 1.3561, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 19.07% (8.5802 => 10.2163, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 17.21% (1.2321 => 1.4441, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 15.37% (19.5406 => 22.5447, std.dev.: 0.0728) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.81% (0.1080 => 0.1240, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 14.79% (1.3521 => 1.5521, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.72% (5.3360 => 6.0681, std.dev.: 0.0415) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0115) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.84% (0.2440 => 0.2680, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 9.82% (0.4480 => 0.4920, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (11.3843 => 12.4363, std.dev.: 0.0385) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.97% (1.7400 => 1.8960, std.dev.: 0.0315) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.11% (0.1480 => 0.1600, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.10% (5.7280 => 6.1920, std.dev.: 0.0487) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.34% (5.6680 => 6.0840, std.dev.: 0.0528) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.31% (11.4440 => 12.2800, std.dev.: 0.0778) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.47% (9.5802 => 10.2002, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.54% (1.7320 => 1.8280, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 4.69% (4.7720 => 4.9960, std.dev.: 0.0254) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.4120 => 0.4280, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (6.8280 => 7.0760, std.dev.: 0.0458) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0108) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.29% (49.1529 => 50.7689, std.dev.: 0.0921) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (5.3840 => 5.5520, std.dev.: 0.0516) MultiSource/Applications/ClamAV/clamscan: 2.83% (19.2243 => 19.7684, std.dev.: 0.0436) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 2.47% (24.7575 => 25.3695, std.dev.: 0.0547) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: 1.79% (39.0726 => 39.7726, std.dev.: 0.0568) MultiSource/Applications/kimwitu++/kc: 1.52% (19.7491 => 20.0491, std.dev.: 0.0534) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0124 => 6.0844, std.dev.: 0.0250) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.44% (3.9842 => 4.3203, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0456) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.97% (3.2362 => 3.3322, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (25.4536 => 25.7896, std.dev.: 0.0383) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.14% (4.5563 => 4.6083, std.dev.: 0.0063) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.07% (9.6806 => 9.7846, std.dev.: 0.0262) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.78% (11.0207 => 2.0081, std.dev.: 0.0114) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -60.00% (0.0200 => 0.0080, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.29% (3.4722 => 3.1842, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0813) MultiSource/Applications/siod/siod: -6.43% (2.9842 => 2.7922, std.dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0027) MultiSource/Applications/obsequi/Obsequi: -3.95% (2.1241 => 2.0401, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0118) MultiSource/Benchmarks/sim/sim: -2.08% (4.9963 => 4.8923, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.85% (4.7643 => 4.6763, std.dev.: 0.0123) MultiSource/Applications/lambda-0_1_3/lambda: -1.81% (5.0963 => 5.0043, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 09:32:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 11:32:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413163209.9B2492A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24632?compare_to=24625&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24632, Order: 206132, Start Time: 2014-04-13 11:58:32, End Time: 2014-04-13 16:38:38 To: 24625, Order: 206130, Start Time: 2014-04-13 07:15:01, End Time: 2014-04-13 11:55:19 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (150 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (2 on baseline) Unchanged Tests: 1102 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/div: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 2.49% (1.7640 => 1.8080, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops: 2.44% (0.4920 => 0.5040, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.65% (1.2041 => 1.2481, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 0.30% (51.5250 => 51.6770, std.dev.: 0.1113) SingleSource/Benchmarks/Misc/oourafft: -1.23% (0.6480 => 0.6400, std.dev.: 0.0101) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/7zip/7zip-benchmark: 3.29% (50.0290 => 51.6770, std.dev.: 0.1113) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0093) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0061) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 133.33% (0.0120 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0054) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0047) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0018) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.80% (1.4241 => 1.5921, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.71% (0.1120 => 0.1240, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wc: 9.52% (0.2520 => 0.2760, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0157) MultiSource/Applications/obsequi/Obsequi: 8.99% (1.8680 => 2.0360, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0111) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.49% (0.4240 => 0.4600, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/05-eks/eks: 8.48% (0.6600 => 0.7160, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.05% (1.5401 => 1.6641, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (1.1640 => 1.2520, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.43% (0.7000 => 0.7520, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.4680 => 6.8720, std.dev.: 0.0477) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.2600 => 0.2760, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.15% (11.6440 => 12.3600, std.dev.: 0.0509) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0226) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.4640 => 1.5520, std.dev.: 0.0131) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.95% (9.4842 => 10.0482, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.85% (5.8121 => 6.1521, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (2.0440 => 2.1560, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0239) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 4.52% (21.9606 => 22.9528, std.dev.: 0.0615) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.0443 => 10.4763, std.dev.: 0.0348) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0100) MultiSource/Applications/hbd/hbd: 4.15% (1.7360 => 1.8080, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.05% (0.2960 => 0.3080, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (6.5080 => 6.7680, std.dev.: 0.0373) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (1.7400 => 1.8080, std.dev.: 0.0262) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (6.5440 => 6.7920, std.dev.: 0.0474) MultiSource/Benchmarks/Bullet/bullet: 3.57% (38.4046 => 39.7766, std.dev.: 0.0841) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (5.3600 => 5.5360, std.dev.: 0.0460) MultiSource/Applications/oggenc/oggenc: 3.26% (6.9844 => 7.2124, std.dev.: 0.0155) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0188) MultiSource/Applications/SPASS/SPASS: 2.99% (18.4404 => 18.9925, std.dev.: 0.0497) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0132) MultiSource/Applications/siod/siod: 2.50% (2.7162 => 2.7842, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (16.3483 => 16.7523, std.dev.: 0.0469) MultiSource/Applications/ClamAV/clamscan: 2.46% (19.0444 => 19.5124, std.dev.: 0.0483) MultiSource/Applications/kimwitu++/kc: 2.28% (19.6891 => 20.1371, std.dev.: 0.0548) MultiSource/Applications/d/make_dparser: 1.71% (3.9681 => 4.0361, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (13.0563 => 13.2363, std.dev.: 0.0350) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7922 => 2.8242, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0200) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.21% (2.1401 => 2.4442, std.dev.: 0.0486) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 4.06% (2.8602 => 2.9762, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0306) MultiSource/Applications/sqlite3/sqlite3: 3.22% (3.9842 => 4.1123, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.94% (5.5723 => 5.6804, std.dev.: 0.0336) MultiSource/Applications/minisat/minisat: 1.92% (6.6684 => 6.7964, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9562 => 4.0122, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.31% (3.9922 => 4.0443, std.dev.: 0.0175) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.99% (10.6247 => 2.0201, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4566 => 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.27% (91.8497 => 49.3471, std.dev.: 10.1168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.63% (26.0616 => 17.0371, std.dev.: 0.1015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.24% (50.3031 => 33.0781, std.dev.: 0.1714) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.85% (42.1466 => 28.7218, std.dev.: 0.3288) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1089) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.31% (7.7845 => 6.7484, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.58% (4.8083 => 4.6363, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.33% (4.1243 => 4.0283, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.99% (1.4041 => 1.3761, std.dev.: 0.0095) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.70% (2.8202 => 2.7722, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -94.37% (11.3687 => 0.6400, std.dev.: 0.0101) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 10:16:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 12:16:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413171602.B8C412A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24633?compare_to=24627&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24633, Order: 206132, Start Time: 2014-04-13 12:34:57, End Time: 2014-04-13 17:22:31 To: 24627, Order: 206130, Start Time: 2014-04-13 07:44:29, End Time: 2014-04-13 12:31:48 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 33.33% (0.0480 => 0.0640, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.00% (0.0800 => 0.0920, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.93% (0.2240 => 0.2440, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (1.8721 => 1.8921, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.88% (0.3280 => 0.3440, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0109) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 10:46:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 12:46:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140413174636.2ED412A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24634?compare_to=24628&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24634, Order: 206132, Start Time: 2014-04-13 13:09:56, End Time: 2014-04-13 17:53:04 To: 24628, Order: 206130, Start Time: 2014-04-13 08:23:36, End Time: 2014-04-13 13:06:49 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (8 on baseline) Performance Regressions: 7 (124 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (3 on baseline) Unchanged Tests: 1102 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/methcall: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.00% (0.0800 => 0.0960, std.dev.: 0.0053) MultiSource/Applications/aha/aha: 9.38% (0.1280 => 0.1400, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3480 => 0.3640, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 2.17% (0.7360 => 0.7520, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: -0.39% (51.6570 => 51.4530, std.dev.: 0.1097) SingleSource/Benchmarks/Misc/oourafft: 1.90% (0.6320 => 0.6440, std.dev.: 0.0098) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: 11.00% (17.6723 => 19.6163, std.dev.: 0.0289) MultiSource/Applications/sqlite3/sqlite3: 1420.95% (1.7001 => 25.8576, std.dev.: 0.0267) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (1.0520 => 1.0840, std.dev.: 0.0286) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (11.3920 => 12.3600, std.dev.: 0.0473) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0643, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0059) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/methcall: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0072) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.74% (1.8921 => 2.1521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0045) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4121, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/strcat: 12.28% (0.2280 => 0.2560, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.93% (2.1121 => 2.3641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.84% (1.8081 => 2.0041, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.14% (2.0521 => 2.2601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.08% (2.1041 => 2.3161, std.dev.: 0.0162) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.37% (1.8361 => 2.0081, std.dev.: 0.0203) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0066) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0042) MultiSource/Applications/obsequi/Obsequi: 7.68% (1.8760 => 2.0200, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.57% (0.7400 => 0.7960, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0263) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.78% (0.7080 => 0.7560, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.68% (6.4800 => 6.8480, std.dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.8881 => 0.9361, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0257) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.59% (6.5320 => 6.8320, std.dev.: 0.0261) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (9.6042 => 10.0242, std.dev.: 0.0397) MultiSource/Applications/JM/ldecod/ldecod: 4.15% (10.2283 => 10.6524, std.dev.: 0.0268) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (5.8281 => 6.0601, std.dev.: 0.0458) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (1.2120 => 1.2600, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0197) MultiSource/Applications/lua/lua: 3.26% (4.7920 => 4.9480, std.dev.: 0.0316) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.7480 => 1.8040, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (2.1600 => 2.2280, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.06% (6.5360 => 6.7360, std.dev.: 0.0598) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 2.85% (38.6366 => 39.7366, std.dev.: 0.0509) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (16.3003 => 16.7243, std.dev.: 0.0417) MultiSource/Applications/oggenc/oggenc: 2.55% (7.0524 => 7.2325, std.dev.: 0.0227) MultiSource/Applications/JM/lencod/lencod: 2.48% (22.2206 => 22.7727, std.dev.: 0.0850) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (5.3960 => 5.5240, std.dev.: 0.0495) MultiSource/Applications/SPASS/SPASS: 2.18% (18.5284 => 18.9325, std.dev.: 0.0570) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0170) MultiSource/Applications/d/make_dparser: 1.71% (3.9761 => 4.0441, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 1.43% (19.8291 => 20.1131, std.dev.: 0.0575) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0363 => 13.1683, std.dev.: 0.0385) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.23% (2.1201 => 2.4642, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0112) MultiSource/Applications/siod/siod: 3.77% (2.8642 => 2.9722, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.63% (3.7442 => 3.8802, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.82% (6.5964 => 6.7164, std.dev.: 0.0326) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.63% (3.9442 => 4.0083, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.54% (10.4007 => 2.0241, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.75% (1.5881 => 1.0521, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.20% (94.8339 => 49.1231, std.dev.: 10.4098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.75% (49.9431 => 33.0861, std.dev.: 0.1673) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.46% (25.7136 => 17.1091, std.dev.: 0.1689) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.51% (37.0863 => 29.1098, std.dev.: 0.5513) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -6.77% (1.3001 => 1.2121, std.dev.: 0.0328) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3521 => 2.3081, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: -1.50% (4.7883 => 4.7163, std.dev.: 0.0194) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 2.70% (50.1010 => 51.4530, std.dev.: 0.1097) SingleSource/Benchmarks/Misc/oourafft: -94.32% (11.3407 => 0.6440, std.dev.: 0.0098) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 10:57:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 12:57:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140413175751.090DF2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24635?compare_to=24629&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24635, Order: 206132, Start Time: 2014-04-13 13:14:21, End Time: 2014-04-13 18:04:18 To: 24629, Order: 206130, Start Time: 2014-04-13 08:20:58, End Time: 2014-04-13 13:11:11 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (133 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (950 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Perm: 100.00% (0.0200 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 66.67% (0.0240 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.00% (0.3000 => 0.3240, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (1.2720 => 1.3200, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/hash: 1.04% (4.2483 => 4.2923, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.37% (1.4641 => 1.4441, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0060) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/heapsort: 50.00% (0.0400 => 0.0600, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.36% (1.7481 => 2.1041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.00% (1.7401 => 2.0881, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.91% (1.7681 => 2.1201, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.86% (1.6721 => 2.0041, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.57% (1.6961 => 2.0281, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.56% (1.7241 => 2.0441, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0067) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.67% (0.7200 => 0.7680, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.51% (3.5002 => 3.7282, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.45% (1.2400 => 1.3200, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.41% (11.7880 => 12.5440, std.dev.: 0.0489) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.38% (0.3760 => 0.4000, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.95% (6.7200 => 7.1200, std.dev.: 0.0449) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3600 => 0.3800, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.5240 => 1.6080, std.dev.: 0.0265) MultiSource/Applications/hexxagon/hexxagon: 5.24% (1.1440 => 1.2040, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0165) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (2.0680 => 2.1640, std.dev.: 0.0209) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (9.9842 => 10.4322, std.dev.: 0.0395) MultiSource/Benchmarks/McCat/18-imp/imp: 4.39% (0.4560 => 0.4760, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0144) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0254) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 3.92% (4.7920 => 4.9800, std.dev.: 0.0346) MultiSource/Applications/oggenc/oggenc: 3.82% (6.9124 => 7.1764, std.dev.: 0.0105) MultiSource/Applications/treecc/treecc: 3.82% (2.6200 => 2.7200, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (6.8321 => 7.0881, std.dev.: 0.0318) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (0.4640 => 0.4800, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (10.3203 => 10.6524, std.dev.: 0.0394) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.5000 => 0.5160, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 3.18% (22.6287 => 23.3488, std.dev.: 0.0522) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0229) MultiSource/Applications/SPASS/SPASS: 3.01% (18.4924 => 19.0486, std.dev.: 0.0557) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.72% (51.1089 => 52.4969, std.dev.: 0.0761) MultiSource/Benchmarks/Bullet/bullet: 2.50% (38.9366 => 39.9086, std.dev.: 0.0941) MultiSource/Applications/ClamAV/clamscan: 2.35% (20.2445 => 20.7205, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 2.21% (19.7371 => 20.1731, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (4.2203 => 4.3083, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (16.5963 => 16.9363, std.dev.: 0.0358) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.59% (3.0122 => 3.0602, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 1.40% (25.1895 => 25.5416, std.dev.: 0.0522) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 23.70% (0.9281 => 1.1481, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 5.28% (1.2121 => 1.2761, std.dev.: 0.0228) MultiSource/Applications/spiff/spiff: 4.58% (2.1841 => 2.2841, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0237) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0201) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 2.00% (21.6534 => 22.0854, std.dev.: 0.0573) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.66% (4.0923 => 4.1603, std.dev.: 0.0159) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0200) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.24% (9.6646 => 9.7846, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 1.06% (7.5485 => 7.6285, std.dev.: 0.0182) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.67% (3.1762 => 1.3761, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.19% (1.5881 => 1.1721, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0075) MultiSource/Applications/obsequi/Obsequi: -21.60% (2.6481 => 2.0760, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (7.4801 => 6.2520, std.dev.: 0.0380) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.73% (7.5041 => 6.3240, std.dev.: 0.0381) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -2.69% (13.5243 => 13.1603, std.dev.: 0.0294) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0090) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.39% (5.8884 => 5.5123, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -3.18% (5.1603 => 4.9963, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.04% (8.8486 => 8.7565, std.dev.: 0.0118) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 14:08:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 16:08:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140413210848.20EAF2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24636?compare_to=24631&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24636, Order: 206133, Start Time: 2014-04-13 16:25:52, End Time: 2014-04-13 21:15:16 To: 24631, Order: 206132, Start Time: 2014-04-13 08:44:19, End Time: 2014-04-13 13:34:08 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (153 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 55.56% (0.0360 => 0.0560, std.dev.: 0.0048) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: 5.66% (0.2120 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.42% (0.4960 => 0.5080, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.28% (1.5601 => 1.5801, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 23.81% (0.0840 => 0.1040, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.87% (0.3560 => 0.3840, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.87% (0.7240 => 0.7520, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4721 => 1.4881, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -27.27% (0.0440 => 0.0320, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0094) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0129) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/nestedloop: 329.35% (0.2320 => 0.9961, std.dev.: 0.0090) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 203.17% (0.2520 => 0.7640, std.dev.: 0.0087) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0056) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0075) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0067) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Regression/C/test_indvars: 50.00% (0.0320 => 0.0480, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 26.32% (0.0760 => 0.0960, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.13% (1.2401 => 1.5641, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.67% (1.2321 => 1.5361, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0117) MultiSource/Benchmarks/NPB-serial/is/is: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.54% (1.3001 => 1.5801, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.65% (1.1401 => 1.3641, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.39% (1.1761 => 1.4041, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 18.42% (8.5802 => 10.1603, std.dev.: 0.0366) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.89% (1.2521 => 1.4761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.77% (1.2881 => 1.5041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 15.52% (19.5406 => 22.5727, std.dev.: 0.0532) MultiSource/Benchmarks/nbench/nbench: 14.79% (1.3521 => 1.5521, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.77% (5.3360 => 6.1241, std.dev.: 0.0409) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1760 => 0.2000, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: 12.00% (0.2000 => 0.2240, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.80% (1.7400 => 1.9280, std.dev.: 0.0239) MultiSource/Applications/sgefa/sgefa: 10.71% (0.4480 => 0.4960, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 9.17% (11.3843 => 12.4283, std.dev.: 0.0425) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0059) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.35% (11.4440 => 12.4000, std.dev.: 0.0767) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.31% (5.7280 => 6.2040, std.dev.: 0.0446) MultiSource/Applications/oggenc/oggenc: 8.27% (6.2844 => 6.8044, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.7640 => 0.8200, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.92% (5.6680 => 6.0600, std.dev.: 0.0654) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.85% (9.5802 => 10.2362, std.dev.: 0.0307) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.76% (1.1240 => 1.2000, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0214) MultiSource/Applications/minisat/minisat: 5.26% (0.8360 => 0.8800, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.92% (0.2440 => 0.2560, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (0.4960 => 0.5200, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 4.53% (4.7720 => 4.9880, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.42% (0.4520 => 0.4720, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0222) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.80% (0.3160 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (6.8280 => 7.0640, std.dev.: 0.0437) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0189) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.06% (49.1529 => 50.6569, std.dev.: 0.1225) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (5.3840 => 5.5440, std.dev.: 0.0588) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.2243 => 19.7124, std.dev.: 0.0562) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 2.33% (24.7575 => 25.3335, std.dev.: 0.0476) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 1.88% (39.0726 => 39.8086, std.dev.: 0.0473) MultiSource/Applications/kimwitu++/kc: 1.26% (19.7491 => 19.9971, std.dev.: 0.0511) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0026) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0240) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0250) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.44% (0.7200 => 0.7520, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 2.37% (4.0563 => 4.1523, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (25.4536 => 25.7856, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.23% (4.5563 => 4.6123, std.dev.: 0.0047) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.16% (9.6806 => 9.7926, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0070) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0059) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -60.00% (0.0200 => 0.0080, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -19.16% (8.9566 => 7.2405, std.dev.: 0.0124) SingleSource/Benchmarks/Linpack/linpack-pc: -15.62% (7.8605 => 6.6324, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0808) MultiSource/Applications/siod/siod: -6.30% (2.9842 => 2.7962, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0170) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.0963 => 5.0123, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.35% (3.8562 => 3.8042, std.dev.: 0.0176) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 14:10:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 16:10:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413211035.B6AA02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24637?compare_to=24630&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24637, Order: 206133, Start Time: 2014-04-13 16:35:35, End Time: 2014-04-13 21:17:05 To: 24630, Order: 206132, Start Time: 2014-04-13 08:41:18, End Time: 2014-04-13 13:26:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (106 on baseline) Performance Improvements: 3 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 60.00% (0.0600 => 0.0960, std.dev.: 0.0067) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.73% (0.2200 => 0.2480, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.76% (0.1640 => 0.1800, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.09% (0.1760 => 0.1920, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 7.41% (0.3240 => 0.3480, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 2.10% (1.1440 => 1.1680, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.89% (5.9320 => 6.0440, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.85% (1.2961 => 1.3201, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.61% (1.2401 => 1.2601, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 100.00% (0.0160 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0043) MultiSource/Benchmarks/llubenchmark/llu: 4.11% (5.2563 => 5.4723, std.dev.: 0.0528) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.99% (5.4283 => 5.5363, std.dev.: 0.0320) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.44% (0.0360 => 0.0200, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.45% (0.3720 => 0.3480, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.78% (1.7281 => 1.6801, std.dev.: 0.0164) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0375) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0582) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0206) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0415) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0362) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0317) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0251) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (5.8400 => 6.0440, std.dev.: 0.0246) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0580) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0626) MultiSource/Applications/sqlite3/sqlite3: 2.36% (23.7574 => 24.3175, std.dev.: 0.0380) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9085, std.dev.: 0.0877) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.15% (48.1088 => 49.1449, std.dev.: 0.0677) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0480) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1451, std.dev.: 0.0385) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0117) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0528) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0188) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0094) MultiSource/Benchmarks/llubenchmark/llu: 5.31% (5.1963 => 5.4723, std.dev.: 0.0528) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.30% (4.5203 => 4.6243, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.98% (3.2242 => 3.2882, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 1.42% (21.1533 => 21.4533, std.dev.: 0.0466) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.44% (0.0360 => 0.0200, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/bmm/bmm: -14.29% (0.0840 => 0.0720, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.68% (7.7485 => 6.6884, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 14:15:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 16:15:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413211530.22A7F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24638?compare_to=24632&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24638, Order: 206133, Start Time: 2014-04-13 16:41:54, End Time: 2014-04-13 21:21:59 To: 24632, Order: 206132, Start Time: 2014-04-13 11:58:32, End Time: 2014-04-13 16:38:38 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 13 (146 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 3 (2 on baseline) Unchanged Tests: 1096 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 28.57% (0.0560 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.04% (0.0920 => 0.1040, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3560 => 0.3760, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.75% (1.6041 => 1.6321, std.dev.: 0.0100) MultiSource/Applications/treecc/treecc: 1.51% (2.6480 => 2.6880, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 8.18% (0.4400 => 0.4760, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.25% (0.9841 => 1.0161, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: 3.13% (2.0441 => 2.1081, std.dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: -0.05% (51.6770 => 51.6490, std.dev.: 0.0476) SingleSource/Benchmarks/Misc/oourafft: 0.63% (0.6400 => 0.6440, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/7zip/7zip-benchmark: 3.24% (50.0290 => 51.6490, std.dev.: 0.0476) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0076) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0068) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/random: 12.50% (0.2240 => 0.2520, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.35% (0.3240 => 0.3640, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/em3d/em3d: 11.54% (0.2080 => 0.2320, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.79% (1.8161 => 2.0121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.05% (1.5521 => 1.7081, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.95% (1.6081 => 1.7681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.45% (1.7361 => 1.9001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/05-eks/eks: 9.09% (0.6600 => 0.7200, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0142) MultiSource/Applications/obsequi/Obsequi: 8.99% (1.8680 => 2.0360, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.93% (1.6121 => 1.7561, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0123) MultiSource/Applications/spiff/spiff: 8.33% (1.0080 => 1.0920, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.9800 => 1.0600, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.11% (1.4801 => 1.6001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.95% (0.7040 => 0.7600, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (1.1640 => 1.2560, std.dev.: 0.0219) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.89% (1.1160 => 1.2040, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.88% (1.7761 => 1.9161, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.80% (1.4361 => 1.5481, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.56% (1.6921 => 1.8201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.55% (1.4841 => 1.5961, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.34% (1.5801 => 1.6961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.76% (0.2960 => 0.3160, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (11.6440 => 12.3840, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.20% (1.4841 => 1.5761, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.69% (6.4680 => 6.8360, std.dev.: 0.0708) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0210) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0289) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (9.4842 => 10.0082, std.dev.: 0.0448) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (5.8121 => 6.1121, std.dev.: 0.0361) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.77% (6.5440 => 6.8560, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.0443 => 10.5043, std.dev.: 0.0334) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.42% (0.7240 => 0.7560, std.dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 4.39% (21.9606 => 22.9248, std.dev.: 0.0336) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0135) MultiSource/Applications/treecc/treecc: 4.02% (2.5840 => 2.6880, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.02% (0.7960 => 0.8280, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0245) MultiSource/Benchmarks/MallocBench/gs/gs: 3.88% (5.3600 => 5.5680, std.dev.: 0.0375) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.68% (1.7400 => 1.8040, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (6.5080 => 6.7400, std.dev.: 0.0487) MultiSource/Applications/lua/lua: 3.43% (4.7880 => 4.9520, std.dev.: 0.0369) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4720 => 0.4880, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 3.34% (38.4046 => 39.6886, std.dev.: 0.0620) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0103) MultiSource/Applications/siod/siod: 3.24% (2.7162 => 2.8042, std.dev.: 0.0129) MultiSource/Applications/oggenc/oggenc: 3.09% (6.9844 => 7.2005, std.dev.: 0.0227) MultiSource/Applications/SPASS/SPASS: 3.02% (18.4404 => 18.9966, std.dev.: 0.0602) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 2.79% (19.0444 => 19.5764, std.dev.: 0.0375) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (16.3483 => 16.7603, std.dev.: 0.0392) MultiSource/Applications/kimwitu++/kc: 2.30% (19.6891 => 20.1411, std.dev.: 0.0391) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (1.1000 => 1.1240, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.7480 => 0.7640, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0321) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.14% (2.1401 => 2.4642, std.dev.: 0.0382) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 3.92% (2.8602 => 2.9722, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.89% (0.7200 => 0.7480, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 3.11% (3.9842 => 4.1083, std.dev.: 0.0202) MultiSource/Applications/obsequi/Obsequi: 2.73% (2.0521 => 2.1081, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (3.9922 => 4.0763, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9724 => 6.0764, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.56% (6.6684 => 6.7724, std.dev.: 0.0219) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.21% (10.6247 => 1.9961, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.16% (2.9442 => 0.9080, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4566 => 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.12% (91.8497 => 49.4871, std.dev.: 10.3001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.61% (26.0616 => 17.0411, std.dev.: 0.1801) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.41% (50.3031 => 32.9941, std.dev.: 0.1905) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.19% (42.1466 => 28.5778, std.dev.: 0.5164) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1045) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.21% (7.7845 => 6.7564, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: -2.55% (2.3561 => 2.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.23% (4.1243 => 4.0323, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -1.59% (4.7883 => 4.7123, std.dev.: 0.0093) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.42% (2.8202 => 2.7802, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Existing Failures - Compile Time -------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -94.34% (11.3687 => 0.6440, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000) Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 14:31:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 16:31:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413213122.C7FD82A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24639?compare_to=24637&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24639, Order: 206134, Start Time: 2014-04-13 16:51:54, End Time: 2014-04-13 21:37:50 To: 24637, Order: 206133, Start Time: 2014-04-13 16:35:35, End Time: 2014-04-13 21:17:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (91 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (1004 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 8.93% (0.2240 => 0.2440, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 5.41% (0.4440 => 0.4680, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (1.3281 => 1.3481, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.09% (0.2640 => 0.2880, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/tsp/tsp: 1.54% (1.3001 => 1.3201, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: 1.21% (1.3201 => 1.3361, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: -7.32% (0.1640 => 0.1520, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: -1.03% (8.1605 => 8.0765, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0554) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.05% (1.1921 => 1.2761, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0594) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0407) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0176) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0277) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0370) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0202) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0241) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0246) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0422) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.37% (37.0925 => 37.9726, std.dev.: 0.0691) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0406) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0501) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1169, std.dev.: 0.1096) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 1.06% (18.8170 => 19.0170, std.dev.: 0.0726) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0182) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.13% (0.2480 => 0.2880, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0103) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.86% (3.2242 => 3.2842, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0201) MultiSource/Applications/lua/lua: 1.34% (21.1533 => 21.4373, std.dev.: 0.0777) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0016) SingleSource/Benchmarks/SmallPT/smallpt: 1.23% (14.0009 => 14.1729, std.dev.: 0.0531) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 14:44:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 16:44:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413214405.14F042A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24640?compare_to=24639&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24640, Order: 206135, Start Time: 2014-04-13 17:08:29, End Time: 2014-04-13 21:50:32 To: 24639, Order: 206134, Start Time: 2014-04-13 16:51:54, End Time: 2014-04-13 21:37:50 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (100 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.84% (0.4080 => 0.4400, std.dev.: 0.0095) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.03% (0.3960 => 0.4080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.24% (1.2481 => 1.2761, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.28% (1.2481 => 1.2641, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.19% (1.3481 => 1.3641, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.57% (0.3680 => 0.4400, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/em3d/em3d: 8.00% (0.2000 => 0.2160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (6.0160 => 6.3520, std.dev.: 0.0387) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0248) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0262) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0198) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0474) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0148) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0361) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0302) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.90% (5.8000 => 5.9680, std.dev.: 0.0458) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0569) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0361) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9246, std.dev.: 0.0818) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0347) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.9480 => 0.9680, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0122) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.64% (48.1088 => 48.8969, std.dev.: 0.1154) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (7.8562 => 7.9842, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0176) MultiSource/Applications/kimwitu++/kc: 1.28% (18.8170 => 19.0570, std.dev.: 0.0419) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0111) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (0.9601 => 0.9841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (4.5203 => 4.6283, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.98% (3.2242 => 3.2882, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 1.36% (21.1533 => 21.4413, std.dev.: 0.0425) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0158) MultiSource/Benchmarks/Fhourstones/fhourstones: -20.45% (0.1760 => 0.1400, std.dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 15:03:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 17:03:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413220331.1E55C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24641?compare_to=24640&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24641, Order: 206136, Start Time: 2014-04-13 17:28:25, End Time: 2014-04-13 22:09:58 To: 24640, Order: 206135, Start Time: 2014-04-13 17:08:29, End Time: 2014-04-13 21:50:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (100 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) MultiSource/Applications/aha/aha: 14.29% (0.1120 => 0.1280, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 13.64% (0.0880 => 0.1000, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.11% (0.1080 => 0.1200, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0053) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.09% (0.1320 => 0.1440, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.14% (0.4480 => 0.4800, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.14% (0.2240 => 0.2400, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: 6.25% (0.1920 => 0.2040, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.28% (1.2281 => 1.2561, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (0.9001 => 0.9201, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.20% (1.3321 => 1.3481, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (2.1721 => 2.1961, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.2161 => 1.3481, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.84% (0.6640 => 0.7360, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.14% (0.2240 => 0.2400, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0516) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0415) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0185) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0430) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0286) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0435) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0609) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0383) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: 2.62% (37.0925 => 38.0646, std.dev.: 0.0621) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0103) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.96% (48.1088 => 49.0528, std.dev.: 0.0656) MultiSource/Applications/sqlite3/sqlite3: 1.95% (23.7574 => 24.2215, std.dev.: 0.0538) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0185) MultiSource/Applications/kimwitu++/kc: 1.72% (18.8170 => 19.1410, std.dev.: 0.0362) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0117) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (1.6321 => 1.6521, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0093) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (4.5203 => 4.6283, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.86% (3.2242 => 3.2842, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0224) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.35% (2.0681 => 2.0401, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 15:09:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 17:09:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140413220912.69C632A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24642?compare_to=24633&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24642, Order: 206136, Start Time: 2014-04-13 17:28:22, End Time: 2014-04-13 22:15:42 To: 24633, Order: 206132, Start Time: 2014-04-13 12:34:57, End Time: 2014-04-13 17:22:31 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1102 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 66.67% (0.0240 => 0.0400, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 38.46% (0.0520 => 0.0720, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 41.67% (0.0480 => 0.0680, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0119) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 15:38:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 17:38:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140413223843.ED1AD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24643?compare_to=24634&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24643, Order: 206136, Start Time: 2014-04-13 17:58:47, End Time: 2014-04-13 22:45:14 To: 24634, Order: 206132, Start Time: 2014-04-13 13:09:56, End Time: 2014-04-13 17:53:04 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 3 (11 on baseline) Performance Regressions: 11 (137 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: 0.61% (51.4530 => 51.7650, std.dev.: 0.0850) SingleSource/Benchmarks/Misc/oourafft: 371.46% (0.6440 => 3.0362, std.dev.: 0.0084) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0118) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 40.00% (0.0400 => 0.0560, std.dev.: 0.0059) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.4320 => 0.4640, std.dev.: 0.0104) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 6.98% (0.3440 => 0.3680, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.86% (0.4200 => 0.4320, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (1.1040 => 1.1280, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.93% (17.6723 => 19.6043, std.dev.: 0.0539) MultiSource/Applications/sqlite3/sqlite3: 1416.71% (1.7001 => 25.7856, std.dev.: 0.0336) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.32% (50.1010 => 51.7650, std.dev.: 0.0850) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (1.0520 => 1.1240, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.11% (11.3920 => 12.3160, std.dev.: 0.0649) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0084) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0563, std.dev.: 0.0217) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0118) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0274) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0028) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0028) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 45.45% (0.0440 => 0.0640, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.22% (0.1840 => 0.2120, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.05% (1.8601 => 2.1401, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.59% (2.0281 => 2.3241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.82% (0.1560 => 0.1760, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.60% (2.0681 => 2.3081, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (1.9761 => 2.2041, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/health/health: 10.87% (0.1840 => 0.2040, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.55% (1.8201 => 2.0121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.47% (1.9481 => 2.1521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.16% (2.0521 => 2.2401, std.dev.: 0.0191) MultiSource/Applications/obsequi/Obsequi: 8.96% (1.8760 => 2.0440, std.dev.: 0.0160) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.18% (0.6360 => 0.6880, std.dev.: 0.0184) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0100) MultiSource/Applications/spiff/spiff: 6.30% (1.0160 => 1.0800, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.21% (0.7080 => 0.7520, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (6.4800 => 6.8640, std.dev.: 0.0496) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0113) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.84% (0.6160 => 0.6520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0185) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.49% (0.9801 => 1.0241, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (5.8281 => 6.0881, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.5640 => 1.6320, std.dev.: 0.0247) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0371) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (6.5320 => 6.7960, std.dev.: 0.0415) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.2283 => 10.6324, std.dev.: 0.0377) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.85% (0.4160 => 0.4320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0106) MultiSource/Applications/hbd/hbd: 3.47% (1.7280 => 1.7880, std.dev.: 0.0226) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (2.1600 => 2.2280, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 3.05% (38.6366 => 39.8166, std.dev.: 0.0967) MultiSource/Applications/treecc/treecc: 2.78% (2.5880 => 2.6600, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (16.3003 => 16.7523, std.dev.: 0.0311) MultiSource/Applications/SPASS/SPASS: 2.76% (18.5284 => 19.0406, std.dev.: 0.0366) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0211) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.2206 => 22.8087, std.dev.: 0.0536) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.63% (6.5360 => 6.7080, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (5.3960 => 5.5280, std.dev.: 0.0424) MultiSource/Applications/d/make_dparser: 2.41% (3.9761 => 4.0721, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2243 => 4.3203, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 2.25% (4.7920 => 4.9000, std.dev.: 0.0409) MultiSource/Applications/kimwitu++/kc: 1.94% (19.8291 => 20.2131, std.dev.: 0.0408) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.72% (2.1201 => 2.4322, std.dev.: 0.0462) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 3.91% (2.8642 => 2.9762, std.dev.: 0.0292) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.53% (3.7442 => 3.8762, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 2.12% (6.5964 => 6.7364, std.dev.: 0.0396) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9684 => 6.0724, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.81% (94.8339 => 49.4911, std.dev.: 10.3129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.98% (49.9431 => 32.9741, std.dev.: 0.2432) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.76% (25.7136 => 17.0331, std.dev.: 0.1556) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.47% (37.0863 => 28.3818, std.dev.: 0.5490) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1124) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.84% (1.2681 => 1.2321, std.dev.: 0.0107) MultiSource/Benchmarks/BitBench/five11/five11: -2.72% (2.3521 => 2.2881, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.33% (4.8043 => 4.6923, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -1.59% (4.7883 => 4.7123, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.46% (4.1123 => 4.0523, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 15:53:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 17:53:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140413225341.7FE1D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24644?compare_to=24635&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24644, Order: 206136, Start Time: 2014-04-13 18:10:02, End Time: 2014-04-13 23:00:10 To: 24635, Order: 206132, Start Time: 2014-04-13 13:14:21, End Time: 2014-04-13 18:04:18 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (130 on baseline) Performance Improvements: 2 (29 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (950 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2002-08-19-CodegenBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C/casts: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.89% (0.1440 => 0.1640, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.71% (0.1120 => 0.1240, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.4520 => 0.4680, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.57% (2.0441 => 2.0761, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 40.00% (0.0400 => 0.0560, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 7.06% (1.0761 => 1.1521, std.dev.: 0.0253) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray: -4.00% (0.4000 => 0.3840, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.00% (0.1200 => 0.1080, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.77% (1.7641 => 2.1481, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.54% (1.7081 => 2.0761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.70% (1.7201 => 2.0761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.59% (1.7681 => 2.1321, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.42% (1.7241 => 2.0761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.40% (1.9801 => 2.3841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.81% (0.1080 => 0.1240, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.11% (0.6120 => 0.6800, std.dev.: 0.0147) SingleSource/Benchmarks/SmallPT/smallpt: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.81% (0.1480 => 0.1640, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4360 => 0.4680, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (3.5002 => 3.7562, std.dev.: 0.0132) MultiSource/Applications/spiff/spiff: 6.27% (1.0200 => 1.0840, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.14% (11.7880 => 12.5120, std.dev.: 0.0708) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.12% (0.7840 => 0.8320, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 5.93% (1.8201 => 1.9281, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (6.7200 => 7.1160, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.42% (2.0680 => 2.1800, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0102) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 4.34% (4.7920 => 5.0000, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (6.8321 => 7.0921, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.77% (9.9842 => 10.3602, std.dev.: 0.0581) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0242) MultiSource/Applications/oggenc/oggenc: 3.70% (6.9124 => 7.1684, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.6801 => 1.7401, std.dev.: 0.0134) MultiSource/Applications/JM/ldecod/ldecod: 3.37% (10.3203 => 10.6684, std.dev.: 0.0297) MultiSource/Applications/d/make_dparser: 3.23% (3.9641 => 4.0921, std.dev.: 0.0253) MultiSource/Applications/JM/lencod/lencod: 3.22% (22.6287 => 23.3567, std.dev.: 0.0428) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0200) MultiSource/Applications/SPASS/SPASS: 3.09% (18.4924 => 19.0644, std.dev.: 0.0508) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0075) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.65% (51.1089 => 52.4649, std.dev.: 0.1025) MultiSource/Benchmarks/Bullet/bullet: 2.51% (38.9366 => 39.9126, std.dev.: 0.1012) MultiSource/Applications/minisat/minisat: 2.34% (0.8560 => 0.8760, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 2.21% (19.7371 => 20.1731, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (4.2203 => 4.3083, std.dev.: 0.0134) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: 1.88% (20.2445 => 20.6245, std.dev.: 0.0613) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (16.5963 => 16.9003, std.dev.: 0.0525) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 1.37% (25.1895 => 25.5335, std.dev.: 0.0460) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0244 => 6.1004, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 40.00% (0.0400 => 0.0560, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.43% (0.9281 => 1.1641, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0447) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 3.05% (6.8204 => 7.0284, std.dev.: 0.0298) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.12% (5.0963 => 5.2043, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 2.11% (21.6534 => 22.1094, std.dev.: 0.0946) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.88% (5.9604 => 6.0724, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0304) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.0923 => 4.1563, std.dev.: 0.0216) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0069) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.28% (9.6646 => 9.7886, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.07% (4.4883 => 4.5363, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.32% (6.2884 => 0.8600, std.dev.: 0.0121) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout/nestedloop: -60.32% (2.9642 => 1.1761, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: -21.91% (2.6481 => 2.0680, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.74% (7.4801 => 6.2280, std.dev.: 0.0541) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.94% (7.5041 => 6.3080, std.dev.: 0.0323) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0053) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: -2.75% (13.5243 => 13.1523, std.dev.: 0.0396) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (5.1603 => 5.0043, std.dev.: 0.0218) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7603 => 4.6763, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -1.06% (11.6527 => 11.5287, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.04% (8.8486 => 8.7565, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 16:26:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 18:26:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140413232614.0B6AA2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24645?compare_to=24641&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24645, Order: 206137, Start Time: 2014-04-13 18:53:41, End Time: 2014-04-13 23:32:41 To: 24641, Order: 206136, Start Time: 2014-04-13 17:28:25, End Time: 2014-04-13 22:09:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (106 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/2010-12-08-tls: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.43% (0.7360 => 0.7760, std.dev.: 0.0125) MultiSource/Applications/Burg/burg: 3.57% (1.4560 => 1.5080, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.25% (0.9601 => 0.9721, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.27% (2.1961 => 2.1681, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.55% (1.7241 => 1.6801, std.dev.: 0.0157) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0065) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0650) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.19% (0.7640 => 0.7960, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0494) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0251) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0119) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0275) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0405) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.8000 => 5.9560, std.dev.: 0.0510) MultiSource/Benchmarks/Bullet/bullet: 2.52% (37.0925 => 38.0286, std.dev.: 0.0490) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0393) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.76% (48.1088 => 48.9569, std.dev.: 0.0902) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.9561 => 0.9721, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: 1.23% (18.8170 => 19.0490, std.dev.: 0.0519) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0243) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.33% (0.1800 => 0.2040, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0177) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0316) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 1.94% (2.8802 => 2.9362, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0307) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.35% (2.0681 => 2.0401, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 18:58:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 20:58:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140414015843.862F52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24646?compare_to=24645&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24646, Order: 206138, Start Time: 2014-04-13 21:22:48, End Time: 2014-04-14 02:04:36 To: 24645, Order: 206137, Start Time: 2014-04-13 18:53:41, End Time: 2014-04-13 23:32:41 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (96 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/pi: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0560 => 0.0680, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.11% (0.1480 => 0.1600, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.32% (0.1640 => 0.1760, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.81% (0.9640 => 1.0200, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.9040 => 0.9560, std.dev.: 0.0164) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.45% (0.6600 => 0.6960, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.06% (1.3800 => 1.4360, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.65% (1.4561 => 1.4801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.55% (1.2921 => 1.3121, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.68% (0.2480 => 0.2720, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.78% (0.9521 => 0.9881, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.04% (4.7083 => 4.8043, std.dev.: 0.0206) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.05% (0.6240 => 0.6680, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.47% (10.6960 => 11.3880, std.dev.: 0.0577) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0053) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0167) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0157) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0192) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0525) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0433) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0463) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0169) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.33% (37.0925 => 37.9566, std.dev.: 0.0889) MultiSource/Applications/sqlite3/sqlite3: 2.24% (23.7574 => 24.2895, std.dev.: 0.0495) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0422) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.80% (48.1088 => 48.9728, std.dev.: 0.0848) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 1.49% (18.8170 => 19.0970, std.dev.: 0.0291) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0217) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.68% (0.2480 => 0.2720, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 1.94% (2.8802 => 2.9362, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (3.2242 => 3.2802, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 1.61% (21.1533 => 21.4933, std.dev.: 0.0549) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.26% (4.7443 => 4.8043, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.21% (1.2601 => 1.1441, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 19:04:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 21:04:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140414020444.45C5F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24647?compare_to=24638&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24647, Order: 206138, Start Time: 2014-04-13 21:27:46, End Time: 2014-04-14 02:10:44 To: 24638, Order: 206133, Start Time: 2014-04-13 16:41:54, End Time: 2014-04-13 21:21:59 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 3 (2 on baseline) Performance Regressions: 12 (145 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Misc/oourafft MultiSource/Benchmarks/7zip/7zip-benchmark: -0.06% (51.6490 => 51.6170, std.dev.: 0.0996) SingleSource/Benchmarks/Misc/oourafft: 372.08% (0.6440 => 3.0402, std.dev.: 0.0105) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 12.00% (0.2000 => 0.2240, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.62% (0.3560 => 0.3760, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.26% (0.3040 => 0.3200, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3480 => 0.3640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 3.28% (0.4880 => 0.5040, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.76% (1.5961 => 1.6401, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.47% (2.1080 => 2.1600, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.25% (1.9161 => 1.9401, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0105) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/UnitTests/AtomicOps: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0111) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.62% (1.0240 => 1.1840, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.26% (1.4561 => 1.6201, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0133) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.43% (1.4961 => 1.6521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.42% (1.6121 => 1.7801, std.dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.69% (1.5281 => 1.6761, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: 9.64% (1.8680 => 2.0480, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.01% (1.4201 => 1.5481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.68% (1.6121 => 1.7521, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.39% (0.6200 => 0.6720, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.45% (0.3720 => 0.3960, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 6.37% (1.5080 => 1.6040, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.19% (1.1640 => 1.2360, std.dev.: 0.0216) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (6.4680 => 6.8600, std.dev.: 0.0528) MultiSource/Applications/spiff/spiff: 5.95% (1.0080 => 1.0680, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.68% (2.0440 => 2.1600, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.67% (11.6440 => 12.3040, std.dev.: 0.0678) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (9.4842 => 9.9922, std.dev.: 0.0500) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0251) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.5480 => 1.6160, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.7400 => 1.8160, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.5600 => 1.6280, std.dev.: 0.0219) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.20% (5.8121 => 6.0561, std.dev.: 0.0597) MultiSource/Applications/JM/ldecod/ldecod: 4.10% (10.0443 => 10.4563, std.dev.: 0.0386) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 3.84% (21.9606 => 22.8048, std.dev.: 0.0595) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.83% (1.4640 => 1.5200, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.9681 => 1.0041, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (6.5080 => 6.7480, std.dev.: 0.0454) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (6.5440 => 6.7840, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: 3.44% (38.4046 => 39.7246, std.dev.: 0.0675) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0045) MultiSource/Applications/hbd/hbd: 3.23% (1.7360 => 1.7920, std.dev.: 0.0193) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0334) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.17% (50.0290 => 51.6170, std.dev.: 0.0996) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (5.3600 => 5.5200, std.dev.: 0.0441) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0096) MultiSource/Applications/SPASS/SPASS: 2.82% (18.4404 => 18.9605, std.dev.: 0.0468) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0075) MultiSource/Applications/treecc/treecc: 2.79% (2.5840 => 2.6560, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (4.1843 => 4.3003, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (16.3483 => 16.7843, std.dev.: 0.0434) MultiSource/Applications/ClamAV/clamscan: 2.52% (19.0444 => 19.5244, std.dev.: 0.0620) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0201) MultiSource/Applications/siod/siod: 2.36% (2.7162 => 2.7802, std.dev.: 0.0170) MultiSource/Applications/kimwitu++/kc: 1.93% (19.6891 => 20.0691, std.dev.: 0.0495) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (13.0563 => 13.2083, std.dev.: 0.0220) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.96% (2.1401 => 2.4602, std.dev.: 0.0598) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (3.3002 => 3.4482, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 3.78% (2.8602 => 2.9682, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.16% (4.5603 => 4.7043, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.61% (3.9842 => 4.0883, std.dev.: 0.0152) MultiSource/Applications/minisat/minisat: 1.74% (6.6684 => 6.7844, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.07% (4.1003 => 4.1443, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.14% (10.6247 => 2.0041, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -70.11% (2.9442 => 0.8800, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.03% (91.8497 => 49.5671, std.dev.: 10.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.40% (26.0616 => 17.0971, std.dev.: 0.1188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.10% (50.3031 => 33.1501, std.dev.: 0.2005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.13% (42.1466 => 28.6058, std.dev.: 0.5500) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1114) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.58% (4.8083 => 4.6363, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.33% (4.1243 => 4.0283, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1563 => 5.0643, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0225) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.42% (2.8202 => 2.7802, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 19:04:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 21:04:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140414020455.05B612A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24648?compare_to=24636&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24648, Order: 206138, Start Time: 2014-04-13 21:20:58, End Time: 2014-04-14 02:10:52 To: 24636, Order: 206133, Start Time: 2014-04-13 16:25:52, End Time: 2014-04-13 21:15:16 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (164 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (927 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.57% (0.0560 => 0.0720, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/almabench: 27.78% (0.0720 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.27% (0.0880 => 0.1120, std.dev.: 0.0070) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.28% (1.4041 => 1.4361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.76% (1.3641 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.64% (1.4641 => 1.4881, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7842 => 2.8122, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.33% (0.0360 => 0.0480, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.20% (2.3241 => 2.3521, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0088) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0067) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0060) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 327.63% (0.2320 => 0.9921, std.dev.: 0.0099) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 193.65% (0.2520 => 0.7400, std.dev.: 0.0124) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0090) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0073) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0060) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.57% (0.7040 => 1.0600, std.dev.: 0.0206) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 31.58% (0.0760 => 0.1000, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0115) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.55% (1.1321 => 1.3761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0128) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (1.1441 => 1.3841, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.78% (1.2321 => 1.4881, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 19.50% (1.2921 => 1.5441, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 18.46% (8.5802 => 10.1643, std.dev.: 0.0384) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.18% (0.0880 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 15.74% (19.5406 => 22.6167, std.dev.: 0.0418) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.84% (5.3360 => 6.1281, std.dev.: 0.0245) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.49% (1.7400 => 1.9400, std.dev.: 0.0285) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 9.52% (11.3843 => 12.4683, std.dev.: 0.0237) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0172) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.52% (5.7280 => 6.2160, std.dev.: 0.0323) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (11.4440 => 12.3120, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0074) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.85% (5.6680 => 6.0560, std.dev.: 0.0623) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.56% (9.5802 => 10.2082, std.dev.: 0.0537) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (1.4760 => 1.5600, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.6240 => 1.7080, std.dev.: 0.0213) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.14% (1.3240 => 1.3920, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (0.4960 => 0.5200, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0166) MultiSource/Applications/lua/lua: 4.02% (4.7720 => 4.9640, std.dev.: 0.0263) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (6.8280 => 7.0760, std.dev.: 0.0425) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0155) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0047) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.25% (49.1529 => 50.7489, std.dev.: 0.1283) MultiSource/Applications/hbd/hbd: 3.14% (1.7840 => 1.8400, std.dev.: 0.0189) MultiSource/Benchmarks/PAQ8p/paq8p: 3.08% (2.7282 => 2.8122, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0076) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.99% (1.3400 => 1.3800, std.dev.: 0.0125) MultiSource/Applications/ClamAV/clamscan: 2.87% (19.2243 => 19.7764, std.dev.: 0.0492) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 2.63% (24.7575 => 25.4095, std.dev.: 0.0391) MultiSource/Benchmarks/MallocBench/gs/gs: 2.53% (5.3840 => 5.5200, std.dev.: 0.0526) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: 2.17% (39.0726 => 39.9206, std.dev.: 0.0514) MultiSource/Applications/kimwitu++/kc: 1.66% (19.7491 => 20.0771, std.dev.: 0.0536) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0124 => 6.0884, std.dev.: 0.0186) MultiSource/Applications/SPASS/SPASS: 1.15% (18.7966 => 19.0127, std.dev.: 0.0348) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.33% (0.0360 => 0.0480, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0154) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0274) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.97% (3.2362 => 3.3322, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0272) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.87% (4.0563 => 4.1323, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9724 => 6.0684, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (25.4536 => 25.8096, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0073) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.24% (9.6806 => 9.8006, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0288) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0053) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -8.52% (3.4722 => 3.1762, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0962) MultiSource/Applications/siod/siod: -6.30% (2.9842 => 2.7962, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.88% (5.0963 => 5.0003, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 19:59:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 21:59:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140414025952.44C492A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24649?compare_to=24642&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24649, Order: 206138, Start Time: 2014-04-13 22:18:53, End Time: 2014-04-14 03:06:20 To: 24642, Order: 206136, Start Time: 2014-04-13 17:28:22, End Time: 2014-04-13 22:15:42 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1098 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 200.00% (0.0080 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.33% (0.2400 => 0.2600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 7.69% (0.1560 => 0.1680, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.90% (0.3480 => 0.3720, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2360 => 0.2520, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2400 => 0.2520, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.26% (0.8600 => 0.8880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.06% (0.3920 => 0.4040, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.60% (1.7521 => 1.7801, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.51% (1.0601 => 1.0761, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.28% (4.0761 => 4.1281, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0136) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 20:28:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 22:28:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140414032821.6E74A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24650?compare_to=24643&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24650, Order: 206138, Start Time: 2014-04-13 22:48:23, End Time: 2014-04-14 03:34:49 To: 24643, Order: 206136, Start Time: 2014-04-13 17:58:47, End Time: 2014-04-13 22:45:14 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (131 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 400.00% (0.0040 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) MultiSource/Benchmarks/llubenchmark/llu: 36.36% (0.0440 => 0.0600, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bisort/bisort: 25.00% (0.0640 => 0.0800, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 10.64% (0.1880 => 0.2080, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: 6.94% (0.2880 => 0.3080, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2360 => 0.2520, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.40% (1.1680 => 1.1960, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.70% (0.9401 => 0.9561, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.09% (2.2041 => 2.2281, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.14% (17.6723 => 19.6404, std.dev.: 0.0524) MultiSource/Applications/sqlite3/sqlite3: 1419.30% (1.7001 => 25.8296, std.dev.: 0.0392) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.11% (50.1010 => 51.6610, std.dev.: 0.0919) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0345) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.01% (11.3920 => 12.3040, std.dev.: 0.0590) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0098) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0643, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0113) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0083) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0052) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0031) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 33.33% (0.0480 => 0.0640, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.24% (0.1160 => 0.1360, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.99% (2.0281 => 2.3321, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.02% (1.9121 => 2.1801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.75% (1.9761 => 2.2281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.00% (1.9001 => 2.1281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.60% (2.0681 => 2.3081, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0114) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.84% (1.8081 => 2.0041, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/EH/except: 10.34% (0.2320 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.93% (1.0880 => 1.1960, std.dev.: 0.0347) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.45% (1.9481 => 2.1321, std.dev.: 0.0178) MultiSource/Applications/obsequi/Obsequi: 8.53% (1.8760 => 2.0360, std.dev.: 0.0239) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.55% (0.6360 => 0.6840, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2360 => 0.2520, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.4800 => 6.8720, std.dev.: 0.0403) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: 5.65% (1.1320 => 1.1960, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (5.8281 => 6.1241, std.dev.: 0.0320) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.57% (0.7880 => 0.8240, std.dev.: 0.0140) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (9.6042 => 10.0002, std.dev.: 0.0426) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 3.94% (1.7280 => 1.7960, std.dev.: 0.0244) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (6.5320 => 6.7720, std.dev.: 0.0440) MultiSource/Applications/JM/ldecod/ldecod: 3.44% (10.2283 => 10.5804, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.32% (1.5640 => 1.6160, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (2.1600 => 2.2280, std.dev.: 0.0198) MultiSource/Applications/treecc/treecc: 3.09% (2.5880 => 2.6680, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (16.3003 => 16.7723, std.dev.: 0.0558) MultiSource/Benchmarks/Bullet/bullet: 2.86% (38.6366 => 39.7406, std.dev.: 0.0842) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 2.72% (22.2206 => 22.8248, std.dev.: 0.0517) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (6.5360 => 6.7120, std.dev.: 0.0327) MultiSource/Applications/oggenc/oggenc: 2.61% (7.0524 => 7.2365, std.dev.: 0.0214) MultiSource/Applications/lua/lua: 2.50% (4.7920 => 4.9120, std.dev.: 0.0282) MultiSource/Applications/SPASS/SPASS: 2.42% (18.5284 => 18.9766, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2243 => 4.2883, std.dev.: 0.0183) MultiSource/Applications/kimwitu++/kc: 1.07% (19.8291 => 20.0411, std.dev.: 0.0615) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.66% (2.1201 => 2.4522, std.dev.: 0.0426) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.53% (3.7442 => 3.8762, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0030) MultiSource/Applications/obsequi/Obsequi: 2.35% (2.0441 => 2.0921, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.99% (3.2082 => 3.2722, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.82% (6.5964 => 6.7164, std.dev.: 0.0341) SingleSource/Benchmarks/Misc/perlin: 1.81% (5.9684 => 6.0764, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.28% (2.9562 => 0.9080, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.10% (94.8339 => 49.2231, std.dev.: 10.1301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.14% (49.9431 => 32.8941, std.dev.: 0.2737) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.71% (25.7136 => 17.0451, std.dev.: 0.1680) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.56% (37.0863 => 28.7178, std.dev.: 0.7955) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (4.1123 => 4.0483, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0194) MultiSource/Applications/lua/lua: -1.21% (21.8014 => 21.5373, std.dev.: 0.0847) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: -1.02% (3.5442 => 3.5082, std.dev.: 0.0117) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 20:47:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 22:47:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140414034707.01F9D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24651?compare_to=24644&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24651, Order: 206138, Start Time: 2014-04-13 23:03:24, End Time: 2014-04-14 03:53:31 To: 24644, Order: 206136, Start Time: 2014-04-13 18:10:02, End Time: 2014-04-13 23:00:10 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (130 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (951 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2002-05-02-ManyArguments: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 13.64% (0.0880 => 0.1000, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/mst/mst: 11.43% (0.1400 => 0.1560, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.36% (0.1760 => 0.1960, std.dev.: 0.0069) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 3.66% (0.3280 => 0.3400, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (1.0360 => 1.0680, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.7401 => 1.7681, std.dev.: 0.0101) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0074) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.29% (1.6721 => 2.0281, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.28% (1.6921 => 2.0521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.80% (1.8081 => 2.1841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.71% (1.6801 => 2.0281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.07% (1.7201 => 2.0481, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.02% (1.7241 => 2.0521, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.64% (1.8881 => 2.2401, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.21% (1.9761 => 2.3161, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.46% (0.2080 => 0.2360, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.11% (0.6120 => 0.6800, std.dev.: 0.0243) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 8.24% (1.0200 => 1.1040, std.dev.: 0.0240) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.66% (0.9920 => 1.0680, std.dev.: 0.0078) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.7800 => 0.8320, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 6.25% (0.3200 => 0.3400, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.7200 => 0.7640, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.95% (6.7200 => 7.1200, std.dev.: 0.0278) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.93% (1.3480 => 1.4280, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.56% (11.7880 => 12.4440, std.dev.: 0.1034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (1.7280 => 1.8240, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/18-imp/imp: 5.26% (0.4560 => 0.4800, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0140) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 4.42% (4.7920 => 5.0040, std.dev.: 0.0366) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (9.9842 => 10.4202, std.dev.: 0.0418) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.32% (0.5560 => 0.5800, std.dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 4.28% (6.9124 => 7.2085, std.dev.: 0.0222) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.86% (6.8321 => 7.0961, std.dev.: 0.0258) MultiSource/Applications/JM/ldecod/ldecod: 3.49% (10.3203 => 10.6804, std.dev.: 0.0434) MultiSource/Applications/SPASS/SPASS: 3.35% (18.4924 => 19.1125, std.dev.: 0.0586) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 3.02% (22.6287 => 23.3128, std.dev.: 0.0494) MultiSource/Benchmarks/Bullet/bullet: 2.79% (38.9366 => 40.0246, std.dev.: 0.0751) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2203 => 4.3203, std.dev.: 0.0067) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.30% (51.1089 => 52.2849, std.dev.: 0.1819) MultiSource/Applications/ClamAV/clamscan: 2.27% (20.2445 => 20.7045, std.dev.: 0.0429) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 2.25% (19.7371 => 20.1811, std.dev.: 0.0407) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0106) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (2.7722 => 2.8282, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (16.5963 => 16.9083, std.dev.: 0.0746) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 1.38% (25.1895 => 25.5375, std.dev.: 0.0441) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.15% (0.9281 => 1.1801, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: 24.52% (7.3405 => 9.1406, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 15.38% (0.2600 => 0.3000, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0234) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0405) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 2.25% (21.6534 => 22.1414, std.dev.: 0.0761) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.20% (5.0963 => 5.2083, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.76% (4.0923 => 4.1643, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0054) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.08% (9.6646 => 9.7686, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/lists: 1.06% (4.9003 => 4.9523, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.58% (6.2884 => 0.8440, std.dev.: 0.0149) SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0100) MultiSource/Applications/obsequi/Obsequi: -21.45% (2.6481 => 2.0800, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.36% (7.4801 => 6.2560, std.dev.: 0.0300) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.99% (7.5041 => 6.3040, std.dev.: 0.0379) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0039) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -2.34% (13.5243 => 13.2083, std.dev.: 0.0235) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -14.92% (7.8005 => 6.6364, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0049) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (5.1603 => 5.0003, std.dev.: 0.0324) MultiSource/Benchmarks/sim/sim: -2.00% (4.9883 => 4.8883, std.dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 20:52:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 22:52:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140414035226.AFB6F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24652?compare_to=24646&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24652, Order: 206141, Start Time: 2014-04-13 23:15:53, End Time: 2014-04-14 03:58:54 To: 24646, Order: 206138, Start Time: 2014-04-13 21:22:48, End Time: 2014-04-14 02:04:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (89 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (1005 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2007-03-02-VaCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/Vector/divides: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.00% (0.2000 => 0.2440, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.05% (0.0760 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.09% (0.1320 => 0.1440, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.45% (1.4720 => 1.5080, std.dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0062) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0410) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.7080 => 1.7840, std.dev.: 0.0189) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0334) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0420) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0604) MultiSource/Applications/JM/lencod/lencod: 2.88% (17.6165 => 18.1245, std.dev.: 0.0434) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0469) SingleSource/Benchmarks/Shootout-C++/hash2: 2.44% (0.4920 => 0.5040, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 2.36% (23.7574 => 24.3175, std.dev.: 0.0455) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0232) MultiSource/Benchmarks/Bullet/bullet: 2.28% (37.0925 => 37.9366, std.dev.: 0.0981) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0362) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.75% (48.1088 => 48.9489, std.dev.: 0.0807) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0376) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0168) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0533) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0164) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.68% (7.7485 => 6.6884, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.05% (3.3482 => 3.1122, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 20:53:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Apr 2014 22:53:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140414035312.426F92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24653?compare_to=24646&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24653, Order: 206140, Start Time: 2014-04-13 23:13:59, End Time: 2014-04-14 03:59:39 To: 24646, Order: 206138, Start Time: 2014-04-13 21:22:48, End Time: 2014-04-14 02:04:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (100 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 400.00% (0.0040 => 0.0200, std.dev.: 0.0022) SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.00% (0.2000 => 0.2480, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: 23.33% (0.1200 => 0.1480, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/mst/mst: 15.15% (0.1320 => 0.1520, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 4.76% (0.4200 => 0.4400, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists1: 4.60% (0.3480 => 0.3640, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3280 => 0.3400, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (0.3560 => 0.3680, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.73% (0.4400 => 0.4520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.25% (1.2441 => 1.2721, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.20% (0.3280 => 0.3680, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (10.6960 => 11.3680, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0384) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0210) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0404) MultiSource/Applications/JM/lencod/lencod: 2.97% (17.6165 => 18.1405, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0174) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0317) MultiSource/Benchmarks/Bullet/bullet: 2.32% (37.0925 => 37.9526, std.dev.: 0.1164) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.30% (1.2200 => 1.2480, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.05% (23.7574 => 24.2455, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (5.8400 => 5.9560, std.dev.: 0.0439) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0095) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0100) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.64% (48.1088 => 48.8968, std.dev.: 0.1017) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 1.34% (18.8170 => 19.0690, std.dev.: 0.0387) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.75% (0.9321 => 1.1721, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.61% (1.6601 => 1.7201, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0111) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (4.5203 => 4.6283, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.86% (3.2242 => 3.2842, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 1.25% (21.1533 => 21.4173, std.dev.: 0.0821) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 13 23:22:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Apr 2014 01:22:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140414062235.16B802A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24654?compare_to=24652&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24654, Order: 206143, Start Time: 2014-04-14 01:47:47, End Time: 2014-04-14 06:28:59 To: 24652, Order: 206141, Start Time: 2014-04-13 23:15:53, End Time: 2014-04-14 03:58:54 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (101 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-19-CodegenBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 36.36% (0.0440 => 0.0600, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.22% (0.0720 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.78% (0.2360 => 0.2520, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 5.71% (0.2800 => 0.2960, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 4.94% (0.3240 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 4.60% (0.6960 => 0.7280, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (5.0000 => 5.0600, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.19% (1.3401 => 1.3561, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.05% (3.3562 => 3.4922, std.dev.: 0.0432) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.25% (1.1241 => 1.2281, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0112) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.06% (0.2480 => 0.2680, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (10.6960 => 11.3960, std.dev.: 0.0773) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0438) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0424) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0220) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0292) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0479) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0387) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0417) MultiSource/Benchmarks/Bullet/bullet: 2.56% (37.0925 => 38.0406, std.dev.: 0.0681) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0420) MultiSource/Applications/sqlite3/sqlite3: 2.31% (23.7574 => 24.3055, std.dev.: 0.0364) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0274) MultiSource/Applications/hbd/hbd: 2.14% (1.6800 => 1.7160, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0082) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0248, std.dev.: 0.0969) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0332) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0107) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0559) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.9321 => 1.1681, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0268) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.31% (3.3802 => 3.4922, std.dev.: 0.0432) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0110) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (4.5203 => 4.6283, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.98% (3.2242 => 3.2882, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0016) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0380) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/life/life: -27.27% (0.0880 => 0.0640, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones/fhourstones: -11.36% (0.1760 => 0.1560, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.78% (7.7485 => 6.6804, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 14 00:20:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Apr 2014 02:20:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140414072001.AE08B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24655?compare_to=24647&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24655, Order: 206144, Start Time: 2014-04-14 02:43:18, End Time: 2014-04-14 07:26:30 To: 24647, Order: 206138, Start Time: 2014-04-13 21:27:46, End Time: 2014-04-14 02:10:44 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 11 (151 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0025) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.76% (0.1360 => 0.1520, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.5200 => 0.5320, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.17% (1.0281 => 1.0401, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 26.32% (0.1520 => 0.1920, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.33% (0.3160 => 0.3360, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0118) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0092) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0072) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/UnitTests/2002-10-12-StructureArgs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0043) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.18% (0.0680 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/15-trie/trie: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0161) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.62% (1.0240 => 1.1840, std.dev.: 0.0206) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.6600 => 0.7480, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/random: 12.50% (0.2240 => 0.2520, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.2360 => 0.2640, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.26% (1.4561 => 1.6201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.1800 => 0.2000, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.08% (1.4361 => 1.5521, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.63% (1.5201 => 1.6361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.34% (1.5801 => 1.6961, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: 7.28% (1.8680 => 2.0040, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.87% (1.1640 => 1.2440, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.49% (11.6440 => 12.4000, std.dev.: 0.0738) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 6.35% (1.0080 => 1.0720, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.4680 => 6.8760, std.dev.: 0.0352) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.09% (1.1160 => 1.1840, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0096) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0216) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash2: 5.56% (0.5040 => 0.5320, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (9.4842 => 10.0082, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0346) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.5480 => 1.6240, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.4640 => 1.5280, std.dev.: 0.0169) MultiSource/Applications/JM/lencod/lencod: 4.32% (21.9606 => 22.9088, std.dev.: 0.0381) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.0443 => 10.4523, std.dev.: 0.0298) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0096) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.96% (1.3120 => 1.3640, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (2.0440 => 2.1240, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (6.5440 => 6.8000, std.dev.: 0.0387) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (6.5080 => 6.7560, std.dev.: 0.0321) MultiSource/Applications/hbd/hbd: 3.69% (1.7360 => 1.8000, std.dev.: 0.0164) MultiSource/Applications/oggenc/oggenc: 3.61% (6.9844 => 7.2365, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.59% (4.7880 => 4.9600, std.dev.: 0.0255) MultiSource/Benchmarks/Bullet/bullet: 3.48% (38.4046 => 39.7406, std.dev.: 0.0627) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (5.3600 => 5.5440, std.dev.: 0.0329) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0100) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.35% (50.0290 => 51.7050, std.dev.: 0.0625) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 2.97% (18.4404 => 18.9886, std.dev.: 0.0428) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (4.1843 => 4.3003, std.dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 2.65% (19.0444 => 19.5484, std.dev.: 0.0358) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (16.3483 => 16.6883, std.dev.: 0.0567) MultiSource/Applications/kimwitu++/kc: 1.99% (19.6891 => 20.0811, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (13.0563 => 13.2163, std.dev.: 0.0262) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.08% (2.1401 => 2.4842, std.dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.36% (3.3002 => 3.4442, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 4.06% (2.8602 => 2.9762, std.dev.: 0.0428) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.87% (3.4122 => 3.5442, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.25% (4.5603 => 4.7083, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 2.91% (3.9842 => 4.1003, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (3.9922 => 4.0603, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 1.50% (6.6684 => 6.7684, std.dev.: 0.0325) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.43% (2.9442 => 0.9000, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5641 => 1.0401, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.13% (91.8497 => 49.4831, std.dev.: 9.8344) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.63% (26.0616 => 17.0371, std.dev.: 0.1405) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.12% (50.3031 => 33.1421, std.dev.: 0.1140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.93% (42.1466 => 28.6898, std.dev.: 0.4486) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.68% (3.1122 => 2.3441, std.dev.: 0.1134) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.26% (7.7845 => 6.7524, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.34% (0.1160 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.06% (0.3400 => 0.3160, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.41% (4.8083 => 4.6443, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.23% (4.1243 => 4.0323, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.86% (5.1563 => 5.0603, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0112) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0166) MultiSource/Benchmarks/sim/sim: -1.34% (4.7883 => 4.7243, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 14 00:20:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Apr 2014 02:20:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140414072032.917DD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24656?compare_to=24648&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24656, Order: 206143, Start Time: 2014-04-14 02:37:30, End Time: 2014-04-14 07:27:02 To: 24648, Order: 206138, Start Time: 2014-04-13 21:20:58, End Time: 2014-04-14 02:10:52 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 12 (161 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 19.05% (0.0840 => 0.1000, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.67% (0.1200 => 0.1400, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: 14.29% (0.0840 => 0.0960, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.11% (0.1480 => 0.1600, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 3.35% (1.5520 => 1.6040, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.19% (0.3760 => 0.3880, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.07% (1.5441 => 1.5761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.69% (1.4201 => 1.4441, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.04% (2.3681 => 2.4402, std.dev.: 0.0269) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0049) SingleSource/Regression/C/sumarray2d: 966.67% (0.0360 => 0.3840, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: 329.35% (0.2320 => 0.9961, std.dev.: 0.0060) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 195.24% (0.2520 => 0.7440, std.dev.: 0.0130) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0043) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0103) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0044) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0049) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0057) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0172) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0256) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 34.62% (0.1040 => 0.1400, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.49% (1.1561 => 1.4161, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.55% (1.1321 => 1.3761, std.dev.: 0.0076) MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 18.14% (8.5802 => 10.1363, std.dev.: 0.0487) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.89% (1.2521 => 1.4761, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.57% (1.1841 => 1.3921, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.46% (1.2881 => 1.5001, std.dev.: 0.0173) MultiSource/Applications/JM/lencod/lencod: 15.50% (19.5406 => 22.5687, std.dev.: 0.0406) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.17% (5.3360 => 6.0921, std.dev.: 0.0399) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1760 => 0.2000, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.63% (0.1720 => 0.1920, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.26% (1.7400 => 1.9360, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (11.3843 => 12.4363, std.dev.: 0.0418) MultiSource/Applications/oggenc/oggenc: 8.66% (6.2844 => 6.8284, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.03% (5.7280 => 6.1880, std.dev.: 0.0465) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.76% (5.6680 => 6.1080, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.65% (0.6800 => 0.7320, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (11.4440 => 12.3120, std.dev.: 0.0381) MultiSource/Benchmarks/McCat/08-main/main: 7.14% (0.3360 => 0.3600, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.16% (1.6240 => 1.7240, std.dev.: 0.0168) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.10% (9.5802 => 10.1642, std.dev.: 0.0508) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2000 => 0.2120, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.89% (0.7360 => 0.7720, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.50% (0.8000 => 0.8360, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.13% (0.8721 => 0.9081, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (6.8280 => 7.0920, std.dev.: 0.0447) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/gs/gs: 3.49% (5.3840 => 5.5720, std.dev.: 0.0430) MultiSource/Applications/lua/lua: 3.27% (4.7720 => 4.9280, std.dev.: 0.0425) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.25% (49.1529 => 50.7489, std.dev.: 0.0558) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: 2.68% (19.2243 => 19.7404, std.dev.: 0.0488) MultiSource/Applications/sqlite3/sqlite3: 2.49% (24.7575 => 25.3735, std.dev.: 0.0398) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (2.7282 => 2.7802, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 1.77% (39.0726 => 39.7646, std.dev.: 0.0674) MultiSource/Applications/kimwitu++/kc: 1.34% (19.7491 => 20.0131, std.dev.: 0.0479) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0124 => 6.0844, std.dev.: 0.0161) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (29.3298 => 29.6299, std.dev.: 0.0335) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0020) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0276) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 2.87% (2.2321 => 2.2961, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.84% (3.2362 => 3.3282, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.40% (6.8204 => 6.9844, std.dev.: 0.0379) MultiSource/Applications/sqlite3/sqlite3: 2.07% (4.0563 => 4.1403, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: 1.67% (5.9724 => 6.0724, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (25.4536 => 25.8096, std.dev.: 0.0361) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0152) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.14% (4.5563 => 4.6083, std.dev.: 0.0049) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.12% (9.6806 => 9.7886, std.dev.: 0.0224) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.78% (11.0207 => 2.0081, std.dev.: 0.0097) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -15.67% (7.8605 => 6.6284, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0894) MultiSource/Applications/siod/siod: -6.57% (2.9842 => 2.7882, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -2.00% (4.9963 => 4.8963, std.dev.: 0.0212) MultiSource/Applications/lambda-0_1_3/lambda: -1.88% (5.0963 => 5.0003, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 14 00:33:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Apr 2014 02:33:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140414073331.C71D12A6C03F@llvm.org> http://llvm.org/perf/db_default/v4/nts/24657?compare_to=24654&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24657, Order: 206146, Start Time: 2014-04-14 03:00:29, End Time: 2014-04-14 07:39:55 To: 24654, Order: 206143, Start Time: 2014-04-14 01:47:47, End Time: 2014-04-14 06:28:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (98 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 29.41% (0.0680 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 9.80% (0.2040 => 0.2240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2440 => 0.2640, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.76% (0.7560 => 0.7920, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.70% (0.4320 => 0.4480, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.93% (1.2281 => 1.2641, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: 2.54% (1.2600 => 1.2920, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.47% (1.3561 => 1.3761, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 1.03% (5.0723 => 5.1243, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2006-01-23-UnionInit: -37.50% (0.0320 => 0.0200, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/oggenc/oggenc: -11.11% (0.1440 => 0.1280, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.87% (0.1840 => 0.2040, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0598) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0228) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0240) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0378) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0150) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0187) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0275) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0192) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0262) MultiSource/Benchmarks/Bullet/bullet: 2.49% (37.0925 => 38.0166, std.dev.: 0.0532) MultiSource/Applications/sqlite3/sqlite3: 2.39% (23.7574 => 24.3255, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: 2.22% (1.2640 => 1.2920, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0163) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.82% (48.1088 => 48.9849, std.dev.: 0.0919) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0810, std.dev.: 0.0450) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.18% (0.9321 => 1.1761, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0107) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 2.23% (5.0123 => 5.1243, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (3.4842 => 3.5522, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.86% (3.2242 => 3.2842, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.49% (21.1533 => 21.4693, std.dev.: 0.0840) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0210) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 14 00:36:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Apr 2014 02:36:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140414073601.BA15A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24658?compare_to=24654&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24658, Order: 206144, Start Time: 2014-04-14 03:00:44, End Time: 2014-04-14 07:42:29 To: 24654, Order: 206143, Start Time: 2014-04-14 01:47:47, End Time: 2014-04-14 06:28:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (99 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (999 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.55% (0.2120 => 0.2280, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.61% (1.2281 => 1.2601, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.12% (2.4322 => 2.5082, std.dev.: 0.0255) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0084) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0421) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0521) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0430) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0399) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.9200 => 0.9520, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0511) MultiSource/Applications/JM/lencod/lencod: 2.97% (17.6165 => 18.1405, std.dev.: 0.0299) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.46% (23.7574 => 24.3415, std.dev.: 0.0269) MultiSource/Benchmarks/Bullet/bullet: 2.42% (37.0925 => 37.9885, std.dev.: 0.0772) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0431) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.01% (48.1088 => 49.0769, std.dev.: 0.0596) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 1.59% (18.8170 => 19.1170, std.dev.: 0.0283) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0130) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0124) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0475) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 24.46% (0.9321 => 1.1601, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: 3.09% (2.0681 => 2.1321, std.dev.: 0.0170) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0406) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.98% (3.2242 => 3.2882, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0143) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0196) MultiSource/Applications/lua/lua: 1.36% (21.1533 => 21.4413, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.73% (7.7485 => 6.6844, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 14 01:06:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Apr 2014 03:06:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140414080657.99AA02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24659?compare_to=24649&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24659, Order: 206146, Start Time: 2014-04-14 03:25:52, End Time: 2014-04-14 08:13:23 To: 24649, Order: 206138, Start Time: 2014-04-13 22:18:53, End Time: 2014-04-14 03:06:20 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1097 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/short_circuit_dtor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2006-02-04-DivRem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: 40.00% (0.0400 => 0.0560, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 17.14% (0.1400 => 0.1640, std.dev.: 0.0078) SingleSource/Regression/C/bigstack: 9.30% (0.1720 => 0.1880, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.05% (1.5720 => 1.6200, std.dev.: 0.0166) MultiSource/Applications/treecc/treecc: 2.56% (2.6520 => 2.7200, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (1.0241 => 1.0441, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.20% (2.0081 => 2.0321, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 5.02% (0.9561 => 1.0041, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.11% (1.0841 => 1.0961) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0110) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 16 16:09:21 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 16 Apr 2014 16:09:21 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase2 - living Message-ID: <20140416230932.443084F8CF83@lab.llvm.org> The Buildbot has detected a restored build on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7498 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205681 Blamelist: compnerd,dblaikie Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 01:54:10 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 01:54:10 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140417085411.2FD204F91F68@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14508 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206451 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': make[4]: Nothing to be done for `all'. make[5]: Nothing to be done for `all'. make[5]: Nothing to be done for `all'. /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/lib/Sema/SemaTemplate.cpp:1740:9: error: no matching function for call to object of type '' if (CheckExplicitSpecialization(Range, true)) ^~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/lib/Sema/SemaTemplate.cpp:1725:38: note: candidate function not viable: requires single argument 'Range', but 2 arguments were provided auto CheckExplicitSpecialization = [&](SourceRange Range) { ^ 1 error generated. make[4]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/lib/Sema/Release+Asserts/SemaTemplate.o] Error 1 make[3]: *** [Sema/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 01:54:11 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 01:54:11 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140417085411.311244F91F6A@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18946 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206451 Blamelist: chapuni BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: lib/Sema/SemaTemplate.cpp On: http://10.1.1.2/svn/llvm-project For: cfe At: Thu 17 Apr 2014 01:50:41 Changed By: chapuni Comments: SemaTemplate.cpp: Appease msvc to get rid of default argument in lambda definition. clang\lib\Sema\SemaTemplate.cpp(1826) : error C2064: term does not evaluate to a function taking 1 argumentsProperties: LOGS: From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 01:54:11 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 01:54:11 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140417085411.3264E4F91F6B@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18946 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206451 Blamelist: chapuni BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 01:54:10 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 01:54:10 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140417085411.307984F91F69@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14508 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206451 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': make[4]: Nothing to be done for `all'. make[5]: Nothing to be done for `all'. make[5]: Nothing to be done for `all'. /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/lib/Sema/SemaTemplate.cpp:1740:9: error: no matching function for call to object of type '' if (CheckExplicitSpecialization(Range, true)) ^~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/lib/Sema/SemaTemplate.cpp:1725:38: note: candidate function not viable: requires single argument 'Range', but 2 arguments were provided auto CheckExplicitSpecialization = [&](SourceRange Range) { ^ 1 error generated. make[4]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/lib/Sema/Release+Asserts/SemaTemplate.o] Error 1 make[3]: *** [Sema/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 02:41:34 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 02:41:34 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140417094134.CDF624F9259C@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18947 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206452 Blamelist: chapuni Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 03:40:12 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 03:40:12 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase3 - tree health Message-ID: <20140417104017.F303E4F92E16@lab.llvm.org> The Buildbot has detected a restored build on builder phase3 - tree health while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase3%20-%20tree%20health/builds/2331 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 205672 Blamelist: dblaikie Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 06:01:14 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 06:01:14 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140417130150.C474B4F9416A@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/731 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 205672 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpck_0O5exe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpck_0O5exe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpIRZGE0exe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpIRZGE0exe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Thu Apr 17 09:20:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 11:20:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417162018.6E5652A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24659?compare_to=24657&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24659, Order: 206457, Start Time: 2014-04-17 11:44:44, End Time: 2014-04-17 16:26:31 To: 24657, Order: 206146, Start Time: 2014-04-14 03:00:29, End Time: 2014-04-14 07:39:55 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 19 (105 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/printargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 29.41% (0.0680 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.50% (0.0960 => 0.1080, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.12% (0.1320 => 0.1480, std.dev.: 0.0053) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.76% (0.1360 => 0.1520, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.67% (0.2400 => 0.2680, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists: 8.70% (0.2760 => 0.3000, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.39% (0.4560 => 0.4760, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 3.57% (0.7840 => 0.8120, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.28% (1.2281 => 1.2561, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 1.88% (4.6760 => 4.7640, std.dev.: 0.0206) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 11.17% (2.9362 => 3.2642, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (26.0976 => 26.9497, std.dev.: 0.0294) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0523 => 4.1123, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -5.10% (1.1761 => 1.1161, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -2.09% (2.6842 => 2.6282, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 17.39% (0.0920 => 0.1080, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0616) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0357) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.53% (1.7360 => 1.8320, std.dev.: 0.0229) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.45% (8.1441 => 8.5881, std.dev.: 0.0333) MultiSource/Applications/lua/lua: 5.40% (4.5200 => 4.7640, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0148) MultiSource/Applications/spiff/spiff: 4.05% (0.9880 => 1.0280, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0181) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0624) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0432) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (4.9000 => 5.0680, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0410) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0387) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0200) MultiSource/Applications/sqlite3/sqlite3: 2.31% (23.7574 => 24.3055, std.dev.: 0.0436) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.29% (48.1088 => 49.2128, std.dev.: 0.0670) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: 1.94% (37.0925 => 37.8125, std.dev.: 0.0512) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.85% (18.8170 => 19.1651, std.dev.: 0.0532) MultiSource/Applications/treecc/treecc: 1.80% (2.4480 => 2.4920, std.dev.: 0.0143) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0229) MultiSource/Applications/SPASS/SPASS: 1.46% (17.5484 => 17.8044, std.dev.: 0.0456) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (25.8896 => 26.9497, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0084) MultiSource/Applications/lua/lua: 2.67% (21.1533 => 21.7174, std.dev.: 0.1769) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0417) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.0123 => 5.0803, std.dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 10:11:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 12:11:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417171115.8FA3E2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24660?compare_to=24659&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24660, Order: 206458, Start Time: 2014-04-17 12:33:06, End Time: 2014-04-17 17:17:48 To: 24659, Order: 206457, Start Time: 2014-04-17 11:44:44, End Time: 2014-04-17 16:26:31 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (113 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022) SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.00% (0.0800 => 0.0960, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 5.77% (0.4160 => 0.4400, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.41% (0.7040 => 0.7280, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 9.09% (1.1001 => 1.2001, std.dev.: 0.0366) SingleSource/Benchmarks/Shootout-C++/hash: 3.91% (0.5120 => 0.5320, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 3.28% (0.9761 => 1.0081, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.91% (1.2561 => 1.2801, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 1.35% (0.8921 => 0.9041, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 22.22% (0.0720 => 0.0880, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0080) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.89% (10.6960 => 11.5400, std.dev.: 0.0468) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0498) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0213) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0422) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0349) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0192) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0550) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0259) MultiSource/Applications/lambda-0_1_3/lambda: 3.05% (0.7880 => 0.8120, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0487) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0503) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0360) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0439) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.22% (48.1088 => 49.1770, std.dev.: 0.1068) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0157) MultiSource/Benchmarks/Bullet/bullet: 1.73% (37.0925 => 37.7325, std.dev.: 0.0716) MultiSource/Applications/kimwitu++/kc: 1.72% (18.8170 => 19.1410, std.dev.: 0.0494) MultiSource/Applications/SPASS/SPASS: 1.64% (17.5484 => 17.8364, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0111) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0092) MultiSource/Applications/siod/siod: 12.92% (2.8802 => 3.2522, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.23% (1.0681 => 1.1881, std.dev.: 0.0356) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (25.8896 => 26.9457, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0097) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0361) MultiSource/Applications/lua/lua: 2.53% (21.1533 => 21.6894, std.dev.: 0.1686) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 1.62% (6.6564 => 6.7644, std.dev.: 0.0281) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.2601 => 1.2801, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0180) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0351) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.64% (10.8967 => 2.0001, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (2.3361 => 2.3041, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 11:01:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 13:01:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417180129.B4E382A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24661?compare_to=24660&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24661, Order: 206465, Start Time: 2014-04-17 13:27:51, End Time: 2014-04-17 18:08:02 To: 24660, Order: 206458, Start Time: 2014-04-17 12:33:06, End Time: 2014-04-17 17:17:48 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (111 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/FloatMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 36.36% (0.0440 => 0.0600, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.49% (0.3440 => 0.3560, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.64% (1.4601 => 1.4841, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 2.76% (0.7240 => 0.7440, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9602 => 4.0003, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -11.78% (1.1881 => 1.0481, std.dev.: 0.0516) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.4602 => 2.4322, std.dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: 16.22% (0.1480 => 0.1720, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 13.13% (0.3960 => 0.4480, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0476) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0385) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.30% (1.9640 => 2.0680, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (5.8000 => 6.0960, std.dev.: 0.0393) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (1.7360 => 1.8240, std.dev.: 0.0210) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0424) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.59% (0.4360 => 0.4560, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0235) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0194) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0602) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0321) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 3.09% (17.6165 => 18.1605, std.dev.: 0.0626) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0338) MultiSource/Applications/sqlite3/sqlite3: 2.93% (23.7574 => 24.4535, std.dev.: 0.0389) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0259) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.66% (48.1088 => 49.3889, std.dev.: 0.1168) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0130) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0179) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8886, std.dev.: 0.0836) MultiSource/Applications/oggenc/oggenc: 2.14% (5.7964 => 5.9204, std.dev.: 0.0191) MultiSource/Applications/kimwitu++/kc: 2.04% (18.8170 => 19.2011, std.dev.: 0.0491) MultiSource/Applications/SPASS/SPASS: 1.66% (17.5484 => 17.8404, std.dev.: 0.0444) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.21% (15.2282 => 15.4122, std.dev.: 0.0353) MultiSource/Applications/ClamAV/clamscan: 1.10% (17.4082 => 17.6002, std.dev.: 0.0669) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 9.38% (0.1280 => 0.1400, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (25.8896 => 26.9497, std.dev.: 0.0228) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.00% (0.6000 => 0.6240, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (1.3481 => 1.3921, std.dev.: 0.0109) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0193) MultiSource/Applications/minisat/minisat: 1.68% (6.6564 => 6.7684, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0643 => 4.1123, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 11:26:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 13:26:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140417182601.059842A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24662?compare_to=24655&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24662, Order: 206467, Start Time: 2014-04-17 13:49:17, End Time: 2014-04-17 18:32:32 To: 24655, Order: 206144, Start Time: 2014-04-14 02:43:18, End Time: 2014-04-14 07:26:30 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 32 (161 on baseline) Performance Improvements: 5 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1075 (923 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-12-MinIntProblem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.13% (0.7800 => 0.8200, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.90% (0.3080 => 0.3200, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 3.66% (0.3280 => 0.3400, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 3.03% (2.6360 => 2.7160, std.dev.: 0.0274) MultiSource/Applications/obsequi/Obsequi: 2.79% (2.0040 => 2.0600, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5480 => 0.5600, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 2.02% (5.5440 => 5.6560, std.dev.: 0.0290) MultiSource/Applications/d/make_dparser: 1.99% (4.0241 => 4.1041, std.dev.: 0.0232) MultiSource/Applications/siod/siod: 1.74% (2.7602 => 2.8082, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.62% (1.7321 => 1.7601, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.54% (1.0401 => 1.0561, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 1.34% (1.4961 => 1.5161, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: 1.27% (20.0811 => 20.3371, std.dev.: 0.0465) MultiSource/Applications/SPASS/SPASS: 1.22% (18.9886 => 19.2205, std.dev.: 0.0436) MultiSource/Benchmarks/PAQ8p/paq8p: 1.14% (2.8162 => 2.8482, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (16.6883 => 16.8683, std.dev.: 0.0428) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.1324 => 6.1964, std.dev.: 0.0209) MultiSource/Applications/ClamAV/clamscan: 1.00% (19.5484 => 19.7444, std.dev.: 0.0514) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 12.00% (3.1322 => 3.5082, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 6.85% (2.9762 => 3.1802, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 2.27% (21.6414 => 22.1334, std.dev.: 0.0759) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.21% (5.0603 => 5.1723, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.76% (2.7202 => 2.7682, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.35% (4.1403 => 4.1963, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.88% (3.4442 => 3.2762, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -4.21% (2.7562 => 2.6402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.31% (4.7083 => 4.5523, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.79% (4.0203 => 3.9482, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.36% (26.7097 => 26.3456, std.dev.: 0.0373) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0163) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0156) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0072) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/mandel-text: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 33.33% (0.0960 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: 20.45% (0.1760 => 0.2120, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0178) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 13.46% (0.2080 => 0.2360, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.64% (1.4241 => 1.6041, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.81% (1.4561 => 1.6281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.38% (1.6521 => 1.8401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.53% (0.2280 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.31% (1.1640 => 1.2840, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.31% (1.5521 => 1.7121, std.dev.: 0.0079) MultiSource/Applications/obsequi/Obsequi: 10.28% (1.8680 => 2.0600, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.17% (1.6121 => 1.7761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.08% (1.5481 => 1.7041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.63% (0.7480 => 0.8200, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.46% (1.7761 => 1.9441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.45% (1.7361 => 1.9001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.18% (1.6121 => 1.7601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.01% (1.4201 => 1.5481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.56% (1.4481 => 1.5721, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.30% (1.7841 => 1.9321, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 7.94% (1.0080 => 1.0880, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.91% (1.4161 => 1.5281, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.56% (1.6921 => 1.8201, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (11.6440 => 12.5200, std.dev.: 0.0402) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.4680 => 6.9240, std.dev.: 0.0450) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0065) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.82% (1.5841 => 1.6921, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.78% (0.2360 => 0.2520, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: 6.38% (1.1280 => 1.2000, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0125) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.28% (9.4842 => 10.0802, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.06% (5.8121 => 6.1641, std.dev.: 0.0264) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.4640 => 1.5520, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (1.5480 => 1.6400, std.dev.: 0.0280) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0244) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0280) MultiSource/Benchmarks/MallocBench/gs/gs: 5.52% (5.3600 => 5.6560, std.dev.: 0.0290) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.50% (6.5440 => 6.9040, std.dev.: 0.0523) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.31% (1.7320 => 1.8240, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (1.7921 => 1.8841, std.dev.: 0.0139) MultiSource/Applications/treecc/treecc: 5.11% (2.5840 => 2.7160, std.dev.: 0.0274) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (6.5080 => 6.8400, std.dev.: 0.0355) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.99% (2.3281 => 2.4442, std.dev.: 0.0080) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 4.90% (10.0443 => 10.5363, std.dev.: 0.0286) MultiSource/Applications/JM/lencod/lencod: 4.70% (21.9606 => 22.9928, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 4.59% (4.7880 => 5.0080, std.dev.: 0.0328) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0107) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.34% (50.0290 => 52.2010, std.dev.: 0.0836) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (2.0440 => 2.1320, std.dev.: 0.0238) MultiSource/Applications/oggenc/oggenc: 4.30% (6.9844 => 7.2845, std.dev.: 0.0164) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0118) MultiSource/Applications/SPASS/SPASS: 4.23% (18.4404 => 19.2205, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (3.0282 => 3.1522, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.95% (2.1240 => 2.2080, std.dev.: 0.0232) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0195) MultiSource/Applications/hbd/hbd: 3.92% (1.7360 => 1.8040, std.dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: 3.68% (19.0444 => 19.7444, std.dev.: 0.0514) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.54% (4.1843 => 4.3323, std.dev.: 0.0126) MultiSource/Applications/d/make_dparser: 3.43% (3.9681 => 4.1041, std.dev.: 0.0232) MultiSource/Applications/siod/siod: 3.39% (2.7162 => 2.8082, std.dev.: 0.0154) MultiSource/Benchmarks/Bullet/bullet: 3.36% (38.4046 => 39.6966, std.dev.: 0.0927) MultiSource/Applications/kimwitu++/kc: 3.29% (19.6891 => 20.3371, std.dev.: 0.0465) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (16.3483 => 16.8683, std.dev.: 0.0428) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (2.7922 => 2.8482, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.88% (1.4881 => 1.5161, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (13.0563 => 13.2683, std.dev.: 0.0247) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (6.1044 => 6.1964, std.dev.: 0.0209) MultiSource/Applications/sqlite3/sqlite3: 1.45% (25.6856 => 26.0576, std.dev.: 0.0297) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.13% (29.3338 => 29.6659, std.dev.: 0.0311) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.21% (2.1401 => 2.4442, std.dev.: 0.0307) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 5.48% (5.1123 => 5.3923, std.dev.: 0.0800) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0264) MultiSource/Applications/sqlite3/sqlite3: 3.01% (3.9842 => 4.1043, std.dev.: 0.0089) MultiSource/Applications/minisat/minisat: 2.40% (6.6684 => 6.8284, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.34% (4.1003 => 4.1963, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 1.82% (21.7374 => 22.1334, std.dev.: 0.0759) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1245 => 8.2125, std.dev.: 0.0214) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.14% (10.6247 => 2.0041, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.48% (1.5641 => 1.0561, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.22% (91.8497 => 49.3991, std.dev.: 10.1606) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.20% (26.0616 => 17.1491, std.dev.: 0.0993) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.17% (50.3031 => 33.1141, std.dev.: 0.1921) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.59% (42.1466 => 28.4098, std.dev.: 0.6620) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1095) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.16% (7.7845 => 6.7604, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0037) MultiSource/Applications/aha/aha: -4.07% (2.7522 => 2.6402, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0504) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.28% (1.4041 => 1.3721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0109) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0153) MultiSource/Benchmarks/mafft/pairlocalalign: -1.32% (26.6977 => 26.3456, std.dev.: 0.0373) MultiSource/Benchmarks/sim/sim: -1.09% (4.7883 => 4.7363, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 11:43:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 13:43:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417184320.667B02A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24663?compare_to=24661&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24663, Order: 206467, Start Time: 2014-04-17 14:08:35, End Time: 2014-04-17 18:49:55 To: 24661, Order: 206465, Start Time: 2014-04-17 13:27:51, End Time: 2014-04-17 18:08:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (115 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C/badidx: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-07-VarArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 16.13% (0.1240 => 0.1440, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.09% (0.1760 => 0.1920, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 4.41% (0.2720 => 0.2840, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.70% (0.5400 => 0.5600, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.10% (0.5160 => 0.5320, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.28% (1.2521 => 1.2681, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.28% (0.2280 => 0.2560, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.53% (0.3040 => 0.3360, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.78% (1.0481 => 1.1401, std.dev.: 0.0353) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0053) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0718) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0395) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (8.1441 => 8.5681, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.15% (1.7080 => 1.7960, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0247) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0550) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0312) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (5.8400 => 6.0520, std.dev.: 0.0351) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0389) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0366) MultiSource/Applications/sqlite3/sqlite3: 3.08% (23.7574 => 24.4895, std.dev.: 0.0532) MultiSource/Applications/siod/siod: 2.80% (2.5721 => 2.6441, std.dev.: 0.0093) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.45% (48.1088 => 49.2889, std.dev.: 0.1160) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0358) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.5480 => 1.5840, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 2.32% (18.8170 => 19.2531, std.dev.: 0.0665) MultiSource/Benchmarks/Bullet/bullet: 2.31% (37.0925 => 37.9486, std.dev.: 0.0629) MultiSource/Applications/treecc/treecc: 2.29% (2.4480 => 2.5040, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0111) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0181) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0647) MultiSource/Applications/ClamAV/clamscan: 1.49% (17.4082 => 17.6682, std.dev.: 0.0465) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (25.8896 => 26.9537, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (1.3481 => 1.3921, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (0.6000 => 0.6160, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 2.59% (21.1533 => 21.7014, std.dev.: 0.1707) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0197) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0139) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0549) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -26.32% (0.0760 => 0.0560, std.dev.: 0.0078) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0224) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.88% (0.3400 => 0.3200, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (2.3881 => 2.2521, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 11:46:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 13:46:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140417184621.5F47E2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24664?compare_to=24650&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24664, Order: 206467, Start Time: 2014-04-17 14:07:14, End Time: 2014-04-17 18:52:54 To: 24650, Order: 206138, Start Time: 2014-04-13 22:48:23, End Time: 2014-04-14 03:34:49 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 28 (154 on baseline) Performance Improvements: 2 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1082 (922 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 18.75% (0.0640 => 0.0760, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.86% (0.1120 => 0.1320, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 6.67% (0.2400 => 0.2560, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.08% (0.2360 => 0.2480, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.80% (0.3160 => 0.3280, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 3.59% (1.5600 => 1.6160, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.30% (0.3640 => 0.3760, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 2.28% (4.9120 => 5.0240, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.20% (2.0041 => 2.0481, std.dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 1.96% (1.8401 => 1.8761, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 1.74% (5.5120 => 5.6080, std.dev.: 0.0342) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (10.5804 => 10.7244, std.dev.: 0.0251) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.20% (10.0002 => 10.1202, std.dev.: 0.0330) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.1284 => 6.1924, std.dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: 1.03% (18.9766 => 19.1724, std.dev.: 0.0353) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 15.35% (0.9121 => 1.0521, std.dev.: 0.0454) MultiSource/Applications/siod/siod: 7.13% (2.9722 => 3.1842, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.5080 => 0.5280, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 2.17% (1.1081 => 1.1321, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.56% (21.5373 => 21.8734, std.dev.: 0.1054) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0226) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/aha/aha: -4.06% (2.7562 => 2.6442, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (3.2722 => 3.2162, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 12.22% (17.6723 => 19.8323, std.dev.: 0.0610) MultiSource/Applications/sqlite3/sqlite3: 1428.47% (1.7001 => 25.9856, std.dev.: 0.0405) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.84% (50.1010 => 52.0250, std.dev.: 0.1375) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (1.0520 => 1.0680, std.dev.: 0.0381) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.09% (11.3920 => 12.4280, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0123) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.0960, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1243, std.dev.: 0.0226) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0135) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0074) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0062) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: 25.00% (0.1280 => 0.1600, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 18.75% (0.0640 => 0.0760, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 16.48% (1.8201 => 2.1201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.41% (1.8281 => 2.1281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.37% (1.8081 => 2.1041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 16.28% (1.9161 => 2.2281, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 16.12% (1.8361 => 2.1321, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.62% (1.9721 => 2.2801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.58% (2.0281 => 2.3441, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.51% (1.9601 => 2.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.36% (2.1361 => 2.4642, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.14% (1.8761 => 2.1601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.01% (1.8921 => 2.1761, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.96% (1.9521 => 2.2441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.76% (1.9241 => 2.2081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.62% (1.8601 => 2.1321, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.43% (1.9121 => 2.1881, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.27% (1.8081 => 2.0481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.25% (2.1441 => 2.4282, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.87% (1.7721 => 2.0001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.69% (1.7961 => 2.0241, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.50% (0.0960 => 0.1080, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.21% (1.9001 => 2.1321, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 12.19% (2.0681 => 2.3201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.13% (1.8801 => 2.1081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.61% (1.8601 => 2.0761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.11% (0.3240 => 0.3600, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0189) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.47% (0.2360 => 0.2560, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.91% (0.7080 => 0.7640, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.3760 => 0.4040, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.4760 => 0.5080, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.67% (0.1800 => 0.1920, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (6.4800 => 6.9000, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (2.9721 => 3.1562, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 5.91% (1.0160 => 1.0760, std.dev.: 0.0223) MultiSource/Benchmarks/nbench/nbench: 5.87% (1.7721 => 1.8761, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: 5.76% (1.5280 => 1.6160, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.9960 => 1.0520, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.37% (9.6042 => 10.1202, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.01% (5.8281 => 6.1201, std.dev.: 0.0312) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 4.85% (10.2283 => 10.7244, std.dev.: 0.0251) MultiSource/Applications/lua/lua: 4.84% (4.7920 => 5.0240, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/football/football: 4.80% (1.0840 => 1.1360, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 3.93% (5.3960 => 5.6080, std.dev.: 0.0342) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (6.5360 => 6.7800, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (6.5320 => 6.7720, std.dev.: 0.0672) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.1600 => 2.2360, std.dev.: 0.0219) MultiSource/Applications/SPASS/SPASS: 3.48% (18.5284 => 19.1724, std.dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0094) MultiSource/Applications/oggenc/oggenc: 3.35% (7.0524 => 7.2885, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (16.3003 => 16.8163, std.dev.: 0.0625) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0189) MultiSource/Applications/d/make_dparser: 2.92% (3.9761 => 4.0921, std.dev.: 0.0235) MultiSource/Applications/JM/lencod/lencod: 2.79% (22.2206 => 22.8407, std.dev.: 0.0530) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 2.72% (38.6366 => 39.6886, std.dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 2.02% (19.8291 => 20.2291, std.dev.: 0.0657) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (13.0363 => 13.1883, std.dev.: 0.0339) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.53% (2.1201 => 2.4282, std.dev.: 0.0427) MultiSource/Applications/siod/siod: 11.17% (2.8642 => 3.1842, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.97% (6.5964 => 6.7924, std.dev.: 0.0456) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (4.0003 => 4.0723, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.69% (10.4007 => 2.0081, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.27% (94.8339 => 49.0591, std.dev.: 7.9292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.72% (49.9431 => 33.1021, std.dev.: 0.1356) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.43% (25.7136 => 17.1171, std.dev.: 0.1247) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.57% (3.0722 => 2.3481, std.dev.: 0.1091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.17% (37.0863 => 28.8658, std.dev.: 0.4799) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.61% (7.8165 => 6.7524, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (4.1123 => 4.0483, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0189) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 11:54:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 13:54:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140417185406.D732F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24665?compare_to=24649&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24665, Order: 206467, Start Time: 2014-04-17 14:13:33, End Time: 2014-04-17 19:00:40 To: 24649, Order: 206138, Start Time: 2014-04-13 22:18:53, End Time: 2014-04-14 03:06:20 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 34 (0 on baseline) Performance Improvements: 6 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1072 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/IntMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/almabench: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.63% (0.1640 => 0.1880, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.81% (0.1480 => 0.1640, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.11% (0.1480 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.41% (1.2560 => 1.3240, std.dev.: 0.0171) MultiSource/Applications/sgefa/sgefa: 4.41% (0.5440 => 0.5680, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 2.71% (2.6520 => 2.7240, std.dev.: 0.0275) MultiSource/Applications/obsequi/Obsequi: 2.52% (2.0640 => 2.1160, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 2.15% (2.7922 => 2.8522, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.99% (1.8081 => 1.8441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.96% (1.8401 => 1.8761, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.93% (12.4320 => 12.6720, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.59% (2.0081 => 2.0401, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 1.51% (20.0971 => 20.4011, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.51% (1.8601 => 1.8881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.49% (1.8801 => 1.9081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.44% (1.9441 => 1.9721, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.41% (6.2400 => 6.3280, std.dev.: 0.0247) MultiSource/Applications/SPASS/SPASS: 1.33% (19.0005 => 19.2525, std.dev.: 0.0475) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.30% (1.8481 => 1.8721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.17% (2.0521 => 2.0761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.13% (1.7641 => 1.7841, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (6.0844 => 6.1524, std.dev.: 0.0197) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/siod/siod: 13.90% (2.7922 => 3.1802, std.dev.: 0.0198) MultiSource/Applications/lemon/lemon: 4.60% (0.9561 => 1.0001, std.dev.: 0.0170) MultiSource/Applications/minisat/minisat: 1.86% (7.1124 => 7.2445, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (4.0243 => 4.0923, std.dev.: 0.0172) MultiSource/Benchmarks/sim/sim: 1.63% (4.8963 => 4.9763, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.24% (4.1963 => 4.2483, std.dev.: 0.0180) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -14.29% (0.1680 => 0.1440, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -17.20% (21.6494 => 17.9251, std.dev.: 0.0458) MultiSource/Applications/ClamAV/clamscan: -16.13% (0.1240 => 0.1040, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: -5.44% (1.1761 => 1.1121, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.56% (3.3282 => 3.2762, std.dev.: 0.0054) MultiSource/Benchmarks/7zip/7zip-benchmark: -1.22% (9.8286 => 9.7086, std.dev.: 0.0362) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -21.98% (0.7280 => 0.5680, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 11:54:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 13:54:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140417185422.C8C6A2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24666?compare_to=24656&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24666, Order: 206467, Start Time: 2014-04-17 14:15:30, End Time: 2014-04-17 19:00:55 To: 24656, Order: 206143, Start Time: 2014-04-14 02:37:30, End Time: 2014-04-14 07:27:02 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 33 (176 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1077 (914 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/badidx: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Regression/C++/EH/class_hierarchy: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 26.09% (0.0920 => 0.1160, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: 18.18% (0.0880 => 0.1040, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: 11.43% (0.1400 => 0.1560, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: 11.11% (0.1440 => 0.1600, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.69% (0.1560 => 0.1680, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.3600 => 0.3800, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 4.97% (0.6440 => 0.6760, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.37% (0.7320 => 0.7640, std.dev.: 0.0115) SingleSource/Regression/C/sumarray2d: 4.17% (0.3840 => 0.4000, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.30% (0.3640 => 0.3760, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 2.10% (2.6680 => 2.7240, std.dev.: 0.0161) MultiSource/Applications/d/make_dparser: 1.96% (4.0841 => 4.1641, std.dev.: 0.0224) MultiSource/Applications/siod/siod: 1.88% (2.7642 => 2.8162, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.75% (1.3721 => 1.3961, std.dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 1.20% (20.0131 => 20.2531, std.dev.: 0.0564) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.13% (7.0920 => 7.1720, std.dev.: 0.0217) MultiSource/Applications/SPASS/SPASS: 1.10% (18.8925 => 19.1006, std.dev.: 0.0665) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (10.1363 => 10.2403, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.02% (1.5641 => 1.5801, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/siod/siod: 13.92% (2.7882 => 3.1762, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.60% (0.9841 => 1.1081, std.dev.: 0.0337) MultiSource/Benchmarks/sim/sim: 1.72% (4.8963 => 4.9803, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout/hash: 1.32% (4.2283 => 4.2843, std.dev.: 0.0151) MultiSource/Applications/sqlite3/sqlite3: 1.26% (4.1403 => 4.1923, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (4.0363 => 4.0843, std.dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.11% (1.0801 => 1.0921, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -17.38% (21.6534 => 17.8891, std.dev.: 0.0426) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.56% (3.3282 => 3.2762, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 1187.18% (0.1240 => 1.5961, std.dev.: 0.0107) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0098) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0119) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 193.65% (0.2520 => 0.7400, std.dev.: 0.0158) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 62.50% (0.0320 => 0.0520, std.dev.: 0.0036) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 60.00% (0.0800 => 0.1280, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0050) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Applications/obsequi/Obsequi: 45.69% (1.3920 => 2.0280, std.dev.: 0.0125) MultiSource/Benchmarks/NPB-serial/is/is: 44.44% (0.0720 => 0.1040, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.68% (1.2481 => 1.5561, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.45% (1.1401 => 1.3961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.77% (1.1761 => 1.4321, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.71% (1.2161 => 1.4801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.54% (1.3001 => 1.5801, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.33% (1.1441 => 1.3881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/tsp/tsp: 21.21% (0.1320 => 0.1600, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.18% (1.1521 => 1.3961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.52% (1.2281 => 1.4801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 19.35% (8.5802 => 10.2403, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.86% (1.2321 => 1.4521, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 15.89% (19.5406 => 22.6447, std.dev.: 0.0427) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.22% (5.3360 => 6.1481, std.dev.: 0.0283) MultiSource/Benchmarks/nbench/nbench: 15.09% (1.3521 => 1.5561, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0061) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.6800 => 0.7640, std.dev.: 0.0115) MultiSource/Applications/sgefa/sgefa: 11.61% (0.4480 => 0.5000, std.dev.: 0.0147) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0100) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 10.46% (0.6120 => 0.6760, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 9.84% (11.3843 => 12.5043, std.dev.: 0.0245) MultiSource/Applications/oggenc/oggenc: 9.48% (6.2844 => 6.8804, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.87% (5.7280 => 6.2360, std.dev.: 0.0331) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.64% (0.3240 => 0.3520, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.11% (11.4440 => 12.3720, std.dev.: 0.0978) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3480 => 0.3760, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.90% (5.6680 => 6.1160, std.dev.: 0.0492) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.52% (0.3680 => 0.3920, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.05% (9.5802 => 10.1602, std.dev.: 0.0639) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0196) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.3600 => 0.3800, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.04% (6.8280 => 7.1720, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.40% (2.0920 => 2.1840, std.dev.: 0.0212) MultiSource/Applications/lua/lua: 4.19% (4.7720 => 4.9720, std.dev.: 0.0361) MultiSource/Benchmarks/MallocBench/gs/gs: 4.09% (5.3840 => 5.6040, std.dev.: 0.0577) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0112) MultiSource/Applications/spiff/spiff: 3.82% (1.0480 => 1.0880, std.dev.: 0.0138) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.81% (49.1529 => 51.0249, std.dev.: 0.1037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.63% (1.4320 => 1.4840, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (2.2081 => 2.2881, std.dev.: 0.0086) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0180) MultiSource/Applications/ClamAV/clamscan: 3.35% (19.2243 => 19.8684, std.dev.: 0.0504) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0116) MultiSource/Applications/treecc/treecc: 2.87% (2.6480 => 2.7240, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 2.63% (24.7575 => 25.4095, std.dev.: 0.0599) MultiSource/Applications/kimwitu++/kc: 2.55% (19.7491 => 20.2531, std.dev.: 0.0564) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.44% (0.4920 => 0.5040, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: 2.00% (39.0726 => 39.8526, std.dev.: 0.0597) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0124 => 6.1164, std.dev.: 0.0147) MultiSource/Applications/SPASS/SPASS: 1.62% (18.7966 => 19.1006, std.dev.: 0.0665) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (16.7083 => 16.9323, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (3.0402 => 3.0762, std.dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.12% (29.3298 => 29.6579, std.dev.: 0.0490) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0241) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0135) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 3.75% (6.8204 => 7.0764, std.dev.: 0.0382) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 3.35% (4.0563 => 4.1923, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.25% (1.0681 => 1.0921, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9724 => 6.0684, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5442 => 2.5802, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (25.4536 => 25.7656, std.dev.: 0.0467) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0087) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.38% (21.6534 => 17.8891, std.dev.: 0.0426) SingleSource/Benchmarks/Linpack/linpack-pc: -16.39% (7.8605 => 6.5724, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.99% (3.4722 => 3.1602, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0844) SingleSource/Benchmarks/BenchmarkGame/n-body: -6.07% (1.7121 => 1.6081, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.96% (5.0963 => 4.9963, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 12:14:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 14:14:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140417191402.EFB4B2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24667?compare_to=24651&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24667, Order: 206467, Start Time: 2014-04-17 14:31:38, End Time: 2014-04-17 19:20:33 To: 24651, Order: 206138, Start Time: 2014-04-13 23:03:24, End Time: 2014-04-14 03:53:31 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 25 (141 on baseline) Performance Improvements: 3 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1084 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 33.33% (0.0600 => 0.0800, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.00% (0.0800 => 0.1000, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/rem: 12.50% (0.1280 => 0.1440, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.00% (0.8000 => 0.8400, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash: 4.24% (0.4720 => 0.4920, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 2.75% (1.1640 => 1.1960, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.40% (0.5000 => 0.5120, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.79% (2.2401 => 2.2801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.76% (2.0481 => 2.0841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.67% (2.1561 => 2.1921, std.dev.: 0.0101) MultiSource/Applications/siod/siod: 1.56% (2.8122 => 2.8562, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.55% (2.3161 => 2.3521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.49% (2.1441 => 2.1761, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 1.35% (5.6480 => 5.7240, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.33% (2.1080 => 2.1360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.21% (2.3121 => 2.3401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.13% (2.1281 => 2.1521, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 17.39% (0.0920 => 0.1080, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 13.59% (2.7962 => 3.1762, std.dev.: 0.0183) MultiSource/Applications/sqlite3/sqlite3: 1.92% (4.1643 => 4.2443, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6574 => 17.8891, std.dev.: 0.0401) SingleSource/Benchmarks/McGill/chomp: -6.44% (1.1801 => 1.1041, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (3.3322 => 3.2762, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0076) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 35.71% (0.0560 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.11% (1.6961 => 2.0881, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.04% (1.6881 => 2.0601, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.93% (1.6961 => 2.0681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.82% (1.6681 => 2.0321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.78% (1.7081 => 2.0801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.77% (1.6721 => 2.0361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.72% (1.7681 => 2.1521, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.63% (1.7201 => 2.0921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.54% (1.7641 => 2.1441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.51% (1.6921 => 2.0561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.51% (1.6921 => 2.0561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.51% (1.8041 => 2.1921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.48% (1.6761 => 2.0361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.43% (1.7921 => 2.1761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.38% (1.7401 => 2.1121, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.33% (1.8001 => 2.1841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.16% (1.7201 => 2.0841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.10% (1.7441 => 2.1121, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.88% (1.7241 => 2.0841, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.76% (1.8881 => 2.2801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.71% (1.6801 => 2.0281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.48% (1.8361 => 2.2121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.22% (1.8201 => 2.1881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.18% (1.9601 => 2.3361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 19.14% (1.9641 => 2.3401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.03% (1.9761 => 2.3521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.38% (1.9801 => 2.3441, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 9.41% (1.0200 => 1.1160, std.dev.: 0.0205) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.14% (0.7840 => 0.8400, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.7280 => 1.8480, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.9920 => 1.0600, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.68% (11.7880 => 12.5760, std.dev.: 0.0687) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (6.7200 => 7.1680, std.dev.: 0.0456) MultiSource/Benchmarks/nbench/nbench: 6.37% (1.8201 => 1.9361, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/oourafft: 6.25% (0.3200 => 0.3400, std.dev.: 0.0047) MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.23% (1.3480 => 1.4320, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.07% (1.6481 => 1.7481, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.62% (0.3560 => 0.3760, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.4160 => 1.4920, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.25% (1.5240 => 1.6040, std.dev.: 0.0224) MultiSource/Applications/Burg/burg: 5.13% (1.5600 => 1.6400, std.dev.: 0.0245) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.05% (9.9842 => 10.4882, std.dev.: 0.0399) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.82% (0.3320 => 0.3480, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0408) MultiSource/Applications/oggenc/oggenc: 4.69% (6.9124 => 7.2365, std.dev.: 0.0181) MultiSource/Applications/d/make_dparser: 4.64% (3.9641 => 4.1481, std.dev.: 0.0250) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.50% (2.0440 => 2.1360, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (1.0001 => 1.0441, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 4.12% (2.6200 => 2.7280, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.07% (0.4920 => 0.5120, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (6.8321 => 7.1041, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.86% (1.0361 => 1.0761, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3200 => 0.3320, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (10.3203 => 10.7043, std.dev.: 0.0423) MultiSource/Applications/siod/siod: 3.63% (2.7562 => 2.8562, std.dev.: 0.0113) MultiSource/Applications/SPASS/SPASS: 3.53% (18.4924 => 19.1446, std.dev.: 0.0749) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.25% (51.1089 => 52.7689, std.dev.: 0.1242) MultiSource/Applications/kimwitu++/kc: 3.24% (19.7371 => 20.3771, std.dev.: 0.0390) MultiSource/Applications/JM/lencod/lencod: 3.23% (22.6287 => 23.3607, std.dev.: 0.0865) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (5.5480 => 5.7240, std.dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.05% (3.0122 => 3.1042, std.dev.: 0.0110) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (16.5963 => 17.0443, std.dev.: 0.0495) MultiSource/Applications/ClamAV/clamscan: 2.59% (20.2445 => 20.7685, std.dev.: 0.0650) MultiSource/Benchmarks/Bullet/bullet: 2.42% (38.9366 => 39.8806, std.dev.: 0.0669) MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (2.7722 => 2.8362, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 2.08% (25.1895 => 25.7136, std.dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0207) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/09-vor/vor: 17.39% (0.0920 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.83% (1.2681 => 1.4561, std.dev.: 0.0250) MultiSource/Applications/siod/siod: 12.30% (2.8282 => 3.1762, std.dev.: 0.0183) MultiSource/Applications/sqlite3/sqlite3: 3.71% (4.0923 => 4.2443, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0155) MultiSource/Applications/minisat/minisat: 3.64% (6.8204 => 7.0684, std.dev.: 0.0317) MultiSource/Applications/lua/lua: 2.81% (21.6534 => 22.2614, std.dev.: 0.1063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bisort/bisort: 1.61% (0.7440 => 0.7560, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.71% (6.2884 => 0.8360, std.dev.: 0.0172) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: -21.00% (2.6481 => 2.0920, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.10% (7.4801 => 6.2760, std.dev.: 0.0272) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.25% (7.5041 => 6.3600, std.dev.: 0.0427) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0072) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -2.54% (13.5243 => 13.1803, std.dev.: 0.0466) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.38% (21.6534 => 17.8891, std.dev.: 0.0401) SingleSource/Benchmarks/Linpack/linpack-pc: -15.49% (7.8005 => 6.5924, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0177) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0243) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -1.10% (11.6527 => 11.5247, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 13:16:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 15:16:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417201635.CE7AD2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24668?compare_to=24663&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24668, Order: 206471, Start Time: 2014-04-17 15:43:15, End Time: 2014-04-17 20:23:08 To: 24663, Order: 206467, Start Time: 2014-04-17 14:08:35, End Time: 2014-04-17 18:49:55 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (102 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 5.77% (0.4160 => 0.4400, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.92% (1.2521 => 1.2761, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.90% (1.2601 => 1.2841, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.57% (1.2761 => 1.2961, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7121 => 1.7321, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.13% (6.7044 => 6.7804, std.dev.: 0.0199) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: -83.33% (0.0240 => 0.0040, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -11.11% (0.1440 => 0.1280, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0064) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.52% (1.1241 => 1.2761, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.00% (1.2361 => 1.3721, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 10.00% (0.3600 => 0.3960, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (10.6960 => 11.5200, std.dev.: 0.0506) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.4120 => 0.4400, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0402) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0106) MultiSource/Applications/lua/lua: 5.13% (4.5200 => 4.7520, std.dev.: 0.0262) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0425) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.83% (5.8000 => 6.0800, std.dev.: 0.0225) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0248) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0173) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (10.4082 => 10.8482, std.dev.: 0.0261) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (4.9200 => 5.1240, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: 3.16% (1.2640 => 1.3040, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0331) MultiSource/Applications/Burg/burg: 3.01% (1.4600 => 1.5040, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0526) MultiSource/Applications/JM/lencod/lencod: 2.72% (17.6165 => 18.0965, std.dev.: 0.0646) MultiSource/Applications/sqlite3/sqlite3: 2.66% (23.7574 => 24.3895, std.dev.: 0.0514) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0401) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.52% (48.1088 => 49.3210, std.dev.: 0.0918) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 2.34% (18.8170 => 19.2571, std.dev.: 0.0272) MultiSource/Benchmarks/Bullet/bullet: 2.14% (37.0925 => 37.8846, std.dev.: 0.0766) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0152) MultiSource/Applications/oggenc/oggenc: 1.86% (5.7964 => 5.9044, std.dev.: 0.0219) MultiSource/Applications/SPASS/SPASS: 1.69% (17.5484 => 17.8444, std.dev.: 0.0561) MultiSource/Applications/ClamAV/clamscan: 1.31% (17.4082 => 17.6362, std.dev.: 0.0478) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (15.2282 => 15.3842, std.dev.: 0.0527) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 13.05% (2.8802 => 3.2562, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (25.8896 => 26.9377, std.dev.: 0.0511) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0096) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0084) MultiSource/Applications/lua/lua: 2.57% (21.1533 => 21.6974, std.dev.: 0.1164) MultiSource/Applications/minisat/minisat: 1.86% (6.6564 => 6.7804, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/mandel-text: -85.71% (0.0280 => 0.0040, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: -5.88% (0.4080 => 0.3840, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 14:05:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 16:05:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417210551.C037D2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24669?compare_to=24668&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24669, Order: 206472, Start Time: 2014-04-17 16:30:39, End Time: 2014-04-17 21:12:24 To: 24668, Order: 206471, Start Time: 2014-04-17 15:43:15, End Time: 2014-04-17 20:23:08 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (106 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.54% (0.1040 => 0.1160, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: 6.38% (0.1880 => 0.2000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 6.25% (0.3200 => 0.3400, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.76% (0.2520 => 0.2640, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.16% (1.3801 => 1.3961, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.66% (0.9441 => 0.9881, std.dev.: 0.0138) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0143) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.45% (0.6640 => 0.7400, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0715) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0362) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0140) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0546) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.83% (5.8000 => 6.0800, std.dev.: 0.0287) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0250) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (4.9200 => 5.1400, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0370) MultiSource/Applications/JM/lencod/lencod: 3.25% (17.6165 => 18.1885, std.dev.: 0.0613) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0128) MultiSource/Applications/sqlite3/sqlite3: 2.78% (23.7574 => 24.4175, std.dev.: 0.0457) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0340) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0127) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.46% (48.1088 => 49.2930, std.dev.: 0.1327) MultiSource/Applications/kimwitu++/kc: 2.36% (18.8170 => 19.2611, std.dev.: 0.0415) MultiSource/Applications/treecc/treecc: 2.29% (2.4480 => 2.5040, std.dev.: 0.0171) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9246, std.dev.: 0.0735) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0154) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0445) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0271) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (25.8896 => 26.9457, std.dev.: 0.0372) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0091) MultiSource/Applications/lua/lua: 2.67% (21.1533 => 21.7174, std.dev.: 0.0644) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0012) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 15:00:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 17:00:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417220041.729F02A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24670?compare_to=24669&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24670, Order: 206475, Start Time: 2014-04-17 17:23:38, End Time: 2014-04-17 22:07:13 To: 24669, Order: 206472, Start Time: 2014-04-17 16:30:39, End Time: 2014-04-17 21:12:24 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 3 (112 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1109 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C/matrixTranspose: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.20% (0.3280 => 0.3680, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.90% (1.1761 => 1.3161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.45% (0.6640 => 0.7400, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (10.6960 => 11.5120, std.dev.: 0.0710) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0429) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (8.1441 => 8.6041, std.dev.: 0.0384) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0157) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0348) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0235) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0504) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0233) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0196) MultiSource/Applications/JM/lencod/lencod: 3.50% (17.6165 => 18.2325, std.dev.: 0.0474) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 3.36% (7.8562 => 8.1202, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (4.9000 => 5.0640, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0556) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0434) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.88% (48.1088 => 49.4930, std.dev.: 0.0520) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.5480 => 1.5920, std.dev.: 0.0136) MultiSource/Applications/siod/siod: 2.80% (2.5721 => 2.6441, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 2.68% (23.7574 => 24.3935, std.dev.: 0.0340) MultiSource/Benchmarks/Bullet/bullet: 2.63% (37.0925 => 38.0686, std.dev.: 0.0588) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 2.23% (18.8170 => 19.2371, std.dev.: 0.0591) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7964 => 5.9084, std.dev.: 0.0183) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 1.69% (17.5484 => 17.8444, std.dev.: 0.0565) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.9561 => 0.9721, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 1.29% (17.4082 => 17.6322, std.dev.: 0.0456) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 12.92% (2.8802 => 3.2522, std.dev.: 0.0206) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0240) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (25.8896 => 26.9457, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0090) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 2.44% (21.1533 => 21.6694, std.dev.: 0.0623) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0082) MultiSource/Applications/aha/aha: -1.94% (2.6762 => 2.6242, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2403 => 4.1963, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 15:45:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 17:45:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417224539.80B032A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24671?compare_to=24670&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24671, Order: 206479, Start Time: 2014-04-17 18:11:55, End Time: 2014-04-17 22:52:12 To: 24670, Order: 206475, Start Time: 2014-04-17 17:23:38, End Time: 2014-04-17 22:07:13 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (113 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 57.14% (0.0280 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.63% (0.1640 => 0.1880, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.11% (0.1080 => 0.1200, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.67% (0.2400 => 0.2560, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 5.08% (0.2360 => 0.2480, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.61% (5.9800 => 6.0760, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.20% (1.3321 => 1.3481, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 12.12% (0.2640 => 0.2960, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0052) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.54% (0.6240 => 0.6960, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.2161 => 1.3481, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.07% (1.1921 => 1.3121, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0113) SingleSource/Benchmarks/McGill/chomp: 8.77% (0.2280 => 0.2480, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.4120 => 0.4440, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.51% (6.0160 => 6.4680, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0615) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0238) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (8.1441 => 8.5681, std.dev.: 0.0462) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (5.8000 => 6.0760, std.dev.: 0.0354) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0384) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (4.9200 => 5.1120, std.dev.: 0.0358) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (4.9000 => 5.0880, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0282) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0598) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.92% (48.1088 => 49.5129, std.dev.: 0.0402) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (7.8562 => 8.0842, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 2.62% (37.0925 => 38.0646, std.dev.: 0.0827) MultiSource/Applications/kimwitu++/kc: 2.62% (18.8170 => 19.3091, std.dev.: 0.0424) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0184) MultiSource/Applications/sqlite3/sqlite3: 2.34% (23.7574 => 24.3135, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0471) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (5.7564 => 5.8164, std.dev.: 0.0175) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (25.8896 => 26.9457, std.dev.: 0.0417) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 2.61% (21.1533 => 21.7054, std.dev.: 0.1952) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0286) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0047) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0538) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.68% (10.8967 => 1.9961, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/huffbench: -19.35% (0.1240 => 0.1000, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/perlin: -16.67% (0.0720 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 16:19:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 18:19:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140417231934.3B6472A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24672?compare_to=24662&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24672, Order: 206485, Start Time: 2014-04-17 18:43:04, End Time: 2014-04-17 23:26:06 To: 24662, Order: 206467, Start Time: 2014-04-17 13:49:17, End Time: 2014-04-17 18:32:32 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (164 on baseline) Performance Improvements: 2 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (918 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2002-10-09-ArrayResolution: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.86% (0.1120 => 0.1320, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.68% (0.3720 => 0.4080, std.dev.: 0.0130) MultiSource/Benchmarks/McCat/09-vor/vor: 8.25% (0.3880 => 0.4200, std.dev.: 0.0076) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 16.67% (0.1680 => 0.1960, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (2.8482 => 2.8122, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.03% (29.6659 => 29.3618, std.dev.: 0.0579) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.15% (11.3687 => 3.0522, std.dev.: 0.0063) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0022) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 295.67% (0.4600 => 1.8201, std.dev.: 0.0091) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0057) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.18% (0.0680 => 0.0960, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0219) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0105) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.00% (0.1200 => 0.1320, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.00% (0.2400 => 0.2640, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.62% (1.1640 => 1.2760, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.68% (1.6121 => 1.7521, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 8.33% (1.0080 => 1.0920, std.dev.: 0.0289) MultiSource/Benchmarks/Olden/bh/bh: 8.26% (0.4840 => 0.5240, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: 8.14% (1.8680 => 2.0200, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.09% (1.4841 => 1.6041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.80% (1.6921 => 1.8241, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0121) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.33% (1.5281 => 1.6401, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (0.2200 => 0.2360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (0.2240 => 0.2400, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.82% (1.5841 => 1.6921, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: 6.63% (1.5080 => 1.6080, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.42% (11.6440 => 12.3920, std.dev.: 0.0591) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (6.4680 => 6.8800, std.dev.: 0.0457) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.12% (9.4842 => 10.0642, std.dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/09-vor/vor: 6.06% (0.3960 => 0.4200, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0279) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (5.8121 => 6.1121, std.dev.: 0.0382) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.92% (0.2440 => 0.2560, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (10.0443 => 10.5283, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0228) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0251) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0193) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.49% (6.5080 => 6.8000, std.dev.: 0.0303) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (5.3600 => 5.5880, std.dev.: 0.0413) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5440 => 6.8160, std.dev.: 0.0552) MultiSource/Applications/JM/lencod/lencod: 4.14% (21.9606 => 22.8688, std.dev.: 0.0502) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0199) MultiSource/Applications/lua/lua: 4.01% (4.7880 => 4.9800, std.dev.: 0.0315) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0221) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0140) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.79% (50.0290 => 51.9250, std.dev.: 0.1285) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 3.51% (18.4404 => 19.0885, std.dev.: 0.0446) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 3.34% (19.0444 => 19.6804, std.dev.: 0.0596) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 3.18% (38.4046 => 39.6246, std.dev.: 0.0672) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0229) MultiSource/Applications/kimwitu++/kc: 2.66% (19.6891 => 20.2131, std.dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (4.1843 => 4.2923, std.dev.: 0.0142) MultiSource/Applications/d/make_dparser: 2.52% (3.9681 => 4.0681, std.dev.: 0.0243) MultiSource/Applications/siod/siod: 2.50% (2.7162 => 2.7842, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (16.3483 => 16.7323, std.dev.: 0.0561) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (6.1044 => 6.1804, std.dev.: 0.0255) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (13.0563 => 13.2003, std.dev.: 0.0279) MultiSource/Applications/lemon/lemon: 1.08% (1.4881 => 1.5041, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.02% (2.1401 => 2.4402, std.dev.: 0.0752) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.78% (0.3600 => 0.3880, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.31% (1.0881 => 1.1241, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.94% (6.6684 => 6.8644, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (4.1003 => 4.2043, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 2.41% (3.9842 => 4.0803, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.28% (8.1245 => 8.2285, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.75% (2.9442 => 0.9200, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.47% (91.8497 => 49.1671, std.dev.: 10.6555) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.38% (50.3031 => 33.0101, std.dev.: 0.2427) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.20% (26.0616 => 17.1491, std.dev.: 0.0761) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.14% (42.1466 => 28.6018, std.dev.: 0.4282) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1097) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.16% (7.7845 => 6.7604, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.06% (0.3400 => 0.3160, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.01% (4.1243 => 4.0003, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.83% (4.8083 => 4.6723, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0167) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3561 => 2.3161, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.12% (4.9923 => 4.9363, std.dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -1.11% (26.6977 => 26.4017, std.dev.: 0.0247) MultiSource/Benchmarks/sim/sim: -1.09% (4.7883 => 4.7363, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 16:35:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 18:35:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140417233514.E4AF52A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24673?compare_to=24671&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24673, Order: 206485, Start Time: 2014-04-17 19:01:10, End Time: 2014-04-17 23:41:49 To: 24671, Order: 206479, Start Time: 2014-04-17 18:11:55, End Time: 2014-04-17 22:52:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (101 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-ManyArguments: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2002-12-13-MishaTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C/callargs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Oscar: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.00% (0.1000 => 0.1200, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.70% (0.3240 => 0.3360, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.58% (1.2641 => 1.2841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.29% (1.2441 => 1.2601, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: 1.20% (1.9961 => 2.0201, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.60% (0.7480 => 0.7600, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 1.19% (2.3601 => 2.3881, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/flops-6: -36.36% (0.0440 => 0.0280, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.27% (2.2081 => 2.1801, std.dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C/callargs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.54% (0.6240 => 0.6960, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.12% (10.6960 => 11.5640, std.dev.: 0.0556) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (6.0160 => 6.4480, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.26% (8.1441 => 8.5721, std.dev.: 0.0541) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0182) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.9200 => 5.1280, std.dev.: 0.0431) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.19% (0.7640 => 0.7960, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0407) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0503) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 2.79% (17.6165 => 18.1085, std.dev.: 0.0655) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0498) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.52% (48.1088 => 49.3209, std.dev.: 0.0792) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0464) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9245, std.dev.: 0.0707) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 2.08% (18.8170 => 19.2091, std.dev.: 0.0481) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0247) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (25.8896 => 26.9577, std.dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.00% (0.6000 => 0.6240, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.26% (0.7360 => 0.7600, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 2.59% (21.1533 => 21.7014, std.dev.: 0.0933) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 1.92% (6.6564 => 6.7844, std.dev.: 0.0263) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0168) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: -22.73% (0.1760 => 0.1360, std.dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.84% (1.2601 => 1.1361, std.dev.: 0.0236) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -1.94% (2.6762 => 2.6242, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 16:42:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 18:42:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140417234226.517EE2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24674?compare_to=24664&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24674, Order: 206485, Start Time: 2014-04-17 19:03:17, End Time: 2014-04-17 23:48:57 To: 24664, Order: 206467, Start Time: 2014-04-17 14:07:14, End Time: 2014-04-17 18:52:54 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 8 (145 on baseline) Performance Improvements: 4 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (930 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.81% (0.4160 => 0.4360, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3040 => 0.3160, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 19.44% (0.2880 => 0.3440, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -35.00% (0.0800 => 0.0520, std.dev.: 0.0107) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.65% (0.0680 => 0.0560, std.dev.: 0.0045) MultiSource/Applications/lua/lua: -1.59% (5.0240 => 4.9440, std.dev.: 0.0264) MultiSource/Applications/ClamAV/clamscan: -1.01% (19.8323 => 19.6323, std.dev.: 0.0717) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.09% (17.6723 => 19.6323, std.dev.: 0.0717) MultiSource/Applications/sqlite3/sqlite3: 1425.42% (1.7001 => 25.9336, std.dev.: 0.0357) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (50.1010 => 51.8130, std.dev.: 0.0923) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.09% (11.3920 => 12.4280, std.dev.: 0.0497) SingleSource/Benchmarks/Misc/oourafft: -73.40% (11.3407 => 3.0162, std.dev.: 0.0126) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1203, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0107) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0092) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Quicksort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 18.75% (0.0640 => 0.0760, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.97% (1.8281 => 2.1201, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.90% (1.8361 => 2.1281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.73% (1.8561 => 2.1481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.70% (1.8601 => 2.1521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.66% (1.9161 => 2.2161, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.19% (2.0281 => 2.3361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.17% (2.1361 => 2.4602, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.97% (1.9241 => 2.2121, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.92% (1.8761 => 2.1561, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: 14.63% (0.3280 => 0.3760, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.95% (1.9761 => 2.2321, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.58% (1.8441 => 2.0761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4122, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.00% (1.9001 => 2.1281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.29% (1.9481 => 2.1681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.11% (0.3240 => 0.3600, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0124) MultiSource/Applications/obsequi/Obsequi: 10.23% (1.8760 => 2.0680, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: 9.72% (0.2880 => 0.3160, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.56% (1.0880 => 1.1920, std.dev.: 0.0371) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.11% (0.7400 => 0.8000, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.14% (0.3360 => 0.3600, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.86% (0.4080 => 0.4360, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3640 => 0.3880, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (6.4800 => 6.9000, std.dev.: 0.0405) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.7280 => 0.7720, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (2.9721 => 3.1322, std.dev.: 0.0174) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0104) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (6.5320 => 6.8520, std.dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.71% (9.6042 => 10.0562, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (5.8281 => 6.0961, std.dev.: 0.0287) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.29% (1.2120 => 1.2640, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 4.19% (10.2283 => 10.6564, std.dev.: 0.0376) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.7480 => 1.8160, std.dev.: 0.0206) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (6.5360 => 6.7760, std.dev.: 0.0448) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0120) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0196) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 3.17% (4.7920 => 4.9440, std.dev.: 0.0264) MultiSource/Applications/hbd/hbd: 3.01% (1.7280 => 1.7800, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (16.3003 => 16.7843, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0116) MultiSource/Applications/SPASS/SPASS: 2.66% (18.5284 => 19.0206, std.dev.: 0.0336) MultiSource/Benchmarks/Bullet/bullet: 2.36% (38.6366 => 39.5486, std.dev.: 0.0824) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0178) MultiSource/Applications/oggenc/oggenc: 2.21% (7.0524 => 7.2085, std.dev.: 0.0341) MultiSource/Applications/JM/lencod/lencod: 2.20% (22.2206 => 22.7087, std.dev.: 0.0733) MultiSource/Applications/kimwitu++/kc: 2.10% (19.8291 => 20.2451, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.48% (2.1201 => 2.4482, std.dev.: 0.0408) MultiSource/Applications/siod/siod: 10.89% (2.8642 => 3.1762, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.17% (0.3240 => 0.3440, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.62% (1.6561 => 1.7161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 3.15% (6.5964 => 6.8044, std.dev.: 0.0405) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9684 => 6.0644, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.54% (10.4007 => 2.0241, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.02% (94.8339 => 49.2911, std.dev.: 9.7063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.34% (49.9431 => 32.7940, std.dev.: 0.2370) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.56% (25.7136 => 17.0851, std.dev.: 0.1502) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.40% (37.0863 => 28.7778, std.dev.: 0.5671) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.72% (7.8165 => 6.7444, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.83% (2.8442 => 2.7922, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.47% (2.4522 => 2.4162, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 16:49:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 18:49:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140417234907.86A642A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24675?compare_to=24666&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24675, Order: 206485, Start Time: 2014-04-17 19:11:15, End Time: 2014-04-17 23:55:40 To: 24666, Order: 206467, Start Time: 2014-04-17 14:15:30, End Time: 2014-04-17 19:00:55 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (165 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (927 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/mason/mason: 26.67% (0.0600 => 0.0760, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.68% (0.2480 => 0.2720, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.65% (0.3440 => 0.3600, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists1: 4.40% (0.3640 => 0.3800, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.03% (1.5601 => 1.5761, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.49% (0.3080 => 0.3280, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.49% (0.7120 => 0.7440, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.73% (1.3881 => 1.3641, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0092) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0084) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 994.87% (0.0760 => 0.8321, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/nestedloop: 317.28% (0.2320 => 0.9681, std.dev.: 0.0163) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 193.65% (0.2520 => 0.7400, std.dev.: 0.0160) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0061) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0078) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0061) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0051) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0042) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0043) MultiSource/Applications/obsequi/Obsequi: 45.11% (1.3920 => 2.0200, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0060) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0153) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 18.84% (8.5802 => 10.1963, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0110) MultiSource/Applications/JM/lencod/lencod: 15.41% (19.5406 => 22.5527, std.dev.: 0.0355) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.92% (5.3360 => 6.1321, std.dev.: 0.0285) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.92% (0.3160 => 0.3600, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 13.31% (1.3521 => 1.5321, std.dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0078) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0170) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 9.45% (11.3843 => 12.4603, std.dev.: 0.0291) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 8.97% (6.2844 => 6.8484, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.94% (5.7280 => 6.2400, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.82% (5.6680 => 6.1680, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.35% (11.4440 => 12.4000, std.dev.: 0.0617) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2440 => 0.2640, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.2520 => 0.2720, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.89% (0.1520 => 0.1640, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.4760 => 1.5760, std.dev.: 0.0301) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.72% (9.5802 => 10.2242, std.dev.: 0.0593) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.7640 => 0.8120, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (1.1240 => 1.1920, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3040 => 0.3200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (5.3840 => 5.6280, std.dev.: 0.0363) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.43% (1.6240 => 1.6960, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/lists1: 4.40% (0.3640 => 0.3800, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (6.8280 => 7.0960, std.dev.: 0.0498) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0392) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.74% (49.1529 => 50.9929, std.dev.: 0.0895) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.63% (1.3240 => 1.3720, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.7320 => 1.7840, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.7600 => 1.8120, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (1.5280 => 1.5720, std.dev.: 0.0155) MultiSource/Applications/ClamAV/clamscan: 2.73% (19.2243 => 19.7484, std.dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 2.57% (24.7575 => 25.3935, std.dev.: 0.0383) MultiSource/Applications/kimwitu++/kc: 2.41% (19.7491 => 20.2251, std.dev.: 0.0445) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 1.67% (39.0726 => 39.7246, std.dev.: 0.0695) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0124 => 6.1044, std.dev.: 0.0231) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0109) SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.74% (1.2401 => 1.4601, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0237) MultiSource/Applications/siod/siod: 6.57% (2.9842 => 3.1802, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.05% (0.9881 => 1.0281, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 3.85% (4.0563 => 4.2123, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 3.58% (6.8204 => 7.0644, std.dev.: 0.0419) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (0.5920 => 0.6120, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.24% (25.4536 => 25.7696, std.dev.: 0.0307) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.78% (11.0207 => 2.0081, std.dev.: 0.0116) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -19.12% (8.9566 => 7.2445, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.22% (21.6534 => 17.9251, std.dev.: 0.0216) SingleSource/Benchmarks/Linpack/linpack-pc: -16.39% (7.8605 => 6.5724, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -9.10% (3.4722 => 3.1562, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0922) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (5.0963 => 5.0163, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 16:50:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 18:50:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140417235053.1D5612A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24676?compare_to=24665&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24676, Order: 206485, Start Time: 2014-04-17 19:11:05, End Time: 2014-04-17 23:57:22 To: 24665, Order: 206467, Start Time: 2014-04-17 14:13:33, End Time: 2014-04-17 19:00:40 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (0 on baseline) Performance Improvements: 3 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray-dbl: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 38.89% (0.0720 => 0.1000, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.76% (0.1360 => 0.1520, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 11.11% (0.1440 => 0.1600, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.3640 => 0.3840, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.14% (1.0521 => 1.0641, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 30.00% (0.0400 => 0.0520, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.40% (3.5042 => 3.5882, std.dev.: 0.0326) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -1.15% (4.1801 => 4.1321, std.dev.: 0.0161) MultiSource/Applications/siod/siod: -1.12% (2.8522 => 2.8202, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.54% (0.1040 => 0.0920, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 17:12:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 19:12:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140418001218.9C28C2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24677?compare_to=24667&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24677, Order: 206485, Start Time: 2014-04-17 19:30:59, End Time: 2014-04-18 00:18:48 To: 24667, Order: 206467, Start Time: 2014-04-17 14:31:38, End Time: 2014-04-17 19:20:33 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (128 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (950 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2160 => 0.2480, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.84% (0.2440 => 0.2680, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/em3d/em3d: 9.43% (0.2120 => 0.2320, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.35% (0.8360 => 0.8640, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/football/football: 1.40% (1.1400 => 1.1560, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -2.38% (2.8562 => 2.7882, std.dev.: 0.0218) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 295.64% (0.4560 => 1.8041, std.dev.: 0.0106) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C++/EH/function_try_block: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.77% (1.6721 => 2.0361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.72% (1.6761 => 2.0401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.71% (1.7321 => 2.1081, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.54% (1.7081 => 2.0761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.51% (1.6921 => 2.0561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.34% (1.7241 => 2.0921, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.33% (1.8001 => 2.1841, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.31% (1.7641 => 2.1401, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.27% (1.7681 => 2.1441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.23% (1.6961 => 2.0561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.97% (1.8881 => 2.2841, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.93% (1.7201 => 2.0801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.36% (1.7481 => 2.1041, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.34% (0.2360 => 0.2840, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.32% (1.9881 => 2.3921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.04% (1.8361 => 2.2041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.08% (1.9081 => 2.2721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.03% (1.9761 => 2.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.99% (1.9801 => 2.3561, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.74% (1.9641 => 2.3321, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.38% (0.6120 => 0.7000, std.dev.: 0.0196) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0060) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0056) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0169) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (11.7880 => 12.6040, std.dev.: 0.0731) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (6.7200 => 7.1760, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.00% (0.2000 => 0.2120, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.7800 => 0.8240, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (1.6481 => 1.7321, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/football/football: 5.09% (1.1000 => 1.1560, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.1440 => 1.2000, std.dev.: 0.0117) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (9.9842 => 10.4722, std.dev.: 0.0497) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0182) MultiSource/Applications/lua/lua: 4.84% (4.7920 => 5.0240, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0041) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0240) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 4.34% (3.9641 => 4.1361, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.11% (2.0440 => 2.1280, std.dev.: 0.0152) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0142) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (6.8321 => 7.1041, std.dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (10.3203 => 10.7044, std.dev.: 0.0503) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0102) MultiSource/Applications/treecc/treecc: 3.51% (2.6200 => 2.7120, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 3.07% (18.4924 => 19.0606, std.dev.: 0.0576) MultiSource/Applications/kimwitu++/kc: 3.02% (19.7371 => 20.3331, std.dev.: 0.0469) MultiSource/Applications/JM/lencod/lencod: 2.99% (22.6287 => 23.3047, std.dev.: 0.0769) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.92% (1.3720 => 1.4120, std.dev.: 0.0147) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.83% (51.1089 => 52.5569, std.dev.: 0.0979) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 2.31% (38.9366 => 39.8366, std.dev.: 0.0935) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (16.5963 => 16.9403, std.dev.: 0.0553) MultiSource/Applications/ClamAV/clamscan: 2.02% (20.2445 => 20.6525, std.dev.: 0.0623) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2203 => 4.2883, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 1.59% (25.1895 => 25.5896, std.dev.: 0.0333) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0244 => 6.1164, std.dev.: 0.0223) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.51% (1.2681 => 1.4521, std.dev.: 0.0130) MultiSource/Applications/siod/siod: 12.30% (2.8282 => 3.1762, std.dev.: 0.0146) MultiSource/Applications/spiff/spiff: 4.21% (2.1841 => 2.2761, std.dev.: 0.0266) MultiSource/Applications/sqlite3/sqlite3: 4.01% (4.0923 => 4.2563, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0315) MultiSource/Applications/lua/lua: 2.90% (21.6534 => 22.2814, std.dev.: 0.1125) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (3.4402 => 3.5322, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (4.2443 => 4.3363, std.dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9604 => 6.0644, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0325) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.26% (6.2884 => 0.8640, std.dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0117) MultiSource/Applications/obsequi/Obsequi: -21.45% (2.6481 => 2.0800, std.dev.: 0.0249) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.47% (7.4801 => 6.2480, std.dev.: 0.0398) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.05% (7.5041 => 6.3000, std.dev.: 0.0379) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -2.69% (13.5243 => 13.1603, std.dev.: 0.0206) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -21.11% (62.4439 => 49.2631, std.dev.: 0.5580) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.74% (21.6534 => 17.8131, std.dev.: 0.0587) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.39% (5.8884 => 5.5123, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -2.71% (5.1603 => 5.0203, std.dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0216) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -1.17% (11.6527 => 11.5167, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 18:07:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 20:07:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418010702.C7F8F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24678?compare_to=24673&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24678, Order: 206491, Start Time: 2014-04-17 20:33:44, End Time: 2014-04-18 01:13:31 To: 24673, Order: 206485, Start Time: 2014-04-17 19:01:10, End Time: 2014-04-17 23:41:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (110 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 100.00% (0.0160 => 0.0320, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 7.04% (0.2840 => 0.3040, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.98% (0.1720 => 0.1840, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.11% (0.7040 => 0.7400, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.55% (0.3520 => 0.3680, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3520 => 0.3640, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.98% (0.3280 => 0.3640, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0104) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.6840 => 0.7400, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.85% (1.3681 => 1.4481, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0442) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0212) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (4.9200 => 5.1320, std.dev.: 0.0373) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0434) MultiSource/Applications/JM/lencod/lencod: 2.88% (17.6165 => 18.1245, std.dev.: 0.0472) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.76% (48.1088 => 49.4369, std.dev.: 0.0661) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0490) MultiSource/Applications/kimwitu++/kc: 2.53% (18.8170 => 19.2931, std.dev.: 0.0406) MultiSource/Applications/sqlite3/sqlite3: 2.41% (23.7574 => 24.3295, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0414) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9125, std.dev.: 0.0983) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7964 => 5.9084, std.dev.: 0.0173) MultiSource/Applications/SPASS/SPASS: 1.69% (17.5484 => 17.8444, std.dev.: 0.0426) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0117) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (25.8896 => 26.9497, std.dev.: 0.0265) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (1.3481 => 1.3921, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0133) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 2.67% (21.1533 => 21.7174, std.dev.: 0.1705) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/misr: -4.55% (0.2640 => 0.2520, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0054) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 19:06:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 21:06:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418020621.ACFB12A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24679?compare_to=24678&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24679, Order: 206501, Start Time: 2014-04-17 21:31:16, End Time: 2014-04-18 02:12:53 To: 24678, Order: 206491, Start Time: 2014-04-17 20:33:44, End Time: 2014-04-18 01:13:31 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (112 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/RealMM: 83.33% (0.0240 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/dt: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.55% (0.2200 => 0.2520, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.60% (1.2481 => 1.2681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.29% (1.2441 => 1.2601, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.00% (0.1000 => 0.1200, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists1: 7.81% (0.2560 => 0.2760, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.48% (3.8442 => 4.0163, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.32% (4.6603 => 4.7683, std.dev.: 0.0376) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.55% (0.2200 => 0.2520, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0734) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.68% (0.7040 => 0.7440, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0132) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0221) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0369) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0167) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0481) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0086) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.72% (17.6165 => 18.0965, std.dev.: 0.0507) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0499) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0244) MultiSource/Benchmarks/Bullet/bullet: 2.40% (37.0925 => 37.9845, std.dev.: 0.0469) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0613) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1890, std.dev.: 0.0303) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.74% (48.1088 => 48.9449, std.dev.: 0.1277) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0146) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0171) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 13.05% (2.8802 => 3.2562, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (25.8896 => 26.9817, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (1.3481 => 1.4001, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0114) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0326) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.80% (6.6564 => 6.7764, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0120) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0287) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -14.15% (7.7485 => 6.6524, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 19:22:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 19:22:20 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140418022223.B72794F9BCBD@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18990 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206549 Blamelist: dexonsmith BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 19:22:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 19:22:20 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140418022223.A66C94F9BCBA@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14552 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206549 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': make[4]: Nothing to be done for `all'. /usr/bin/cmp -s AMDGPUGenIntrinsics.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenIntrinsics.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenIntrinsics.inc.tmp AMDGPUGenIntrinsics.inc /usr/bin/cmp -s AMDGPUGenDFAPacketizer.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenDFAPacketizer.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenDFAPacketizer.inc.tmp AMDGPUGenDFAPacketizer.inc for dir in InstPrinter TargetInfo MCTargetDesc; do \ if ([ ! -f $dir/Makefile ] || \ command test $dir/Makefile -ot /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/$dir/Makefile ); then \ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/autoconf/mkinstalldirs $dir; \ /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/$dir/Makefile $dir/Makefile; \ fi; \ (make -C $dir all ) || exit 1; \ done make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 19:22:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 19:22:20 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140418022223.B5A714F9BCBC@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18990 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206549 Blamelist: dexonsmith BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: lib/Analysis/BlockFrequencyInfoImpl.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Thu 17 Apr 2014 19:16:41 Changed By: dexonsmith Comments: blockfreq: Fixing MSVC after r206548?Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 19:22:19 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 19:22:19 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140418022223.B4FB84F9BCBB@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14552 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206549 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': make[4]: Nothing to be done for `all'. /usr/bin/cmp -s AMDGPUGenIntrinsics.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenIntrinsics.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenIntrinsics.inc.tmp AMDGPUGenIntrinsics.inc /usr/bin/cmp -s AMDGPUGenDFAPacketizer.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenDFAPacketizer.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenDFAPacketizer.inc.tmp AMDGPUGenDFAPacketizer.inc for dir in InstPrinter TargetInfo MCTargetDesc; do \ if ([ ! -f $dir/Makefile ] || \ command test $dir/Makefile -ot /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/$dir/Makefile ); then \ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/autoconf/mkinstalldirs $dir; \ /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/$dir/Makefile $dir/Makefile; \ fi; \ (make -C $dir all ) || exit 1; \ done make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make[4]: Nothing to be done for `all'. make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 19:56:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 19:56:46 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140418025650.2E2A54F9C126@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/732 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 206447 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmplWqskUexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmplWqskUexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp7CHzCaexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp7CHzCaexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvmlab-buildmaster at lab.llvm.org Thu Apr 17 19:57:47 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 17 Apr 2014 19:57:47 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140418025759.163244F9C16A@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18991 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206555 Blamelist: bogner,dexonsmith,grosbach Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Thu Apr 17 20:03:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 22:03:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418030311.588852A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24680?compare_to=24679&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24680, Order: 206503, Start Time: 2014-04-17 22:25:25, End Time: 2014-04-18 03:09:43 To: 24679, Order: 206501, Start Time: 2014-04-17 21:31:16, End Time: 2014-04-18 02:12:53 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (118 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.38% (0.1280 => 0.1400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.04% (0.3960 => 0.4120, std.dev.: 0.0062) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.97% (1.2120 => 1.2480, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.97% (0.4040 => 0.4160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.9561 => 0.9761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.47% (1.3641 => 1.3841, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.05% (4.4843 => 4.5763, std.dev.: 0.0244) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_shift: -21.43% (0.0560 => 0.0440, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2280 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0740) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.45% (1.3641 => 1.4521, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0502) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.15% (1.7080 => 1.7960, std.dev.: 0.0133) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0383) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0167) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0213) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0290) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0350) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0553) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0288) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.59% (48.1088 => 49.3570, std.dev.: 0.0615) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0467) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.9561 => 0.9761, std.dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: 2.04% (18.8170 => 19.2011, std.dev.: 0.0732) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8205, std.dev.: 0.0824) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0462) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0133) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (25.8896 => 26.9737, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (1.3481 => 1.3921, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0093) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 2.70% (21.1533 => 21.7254, std.dev.: 0.0713) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (4.5203 => 4.6283, std.dev.: 0.0066) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.60% (4.5043 => 4.5763, std.dev.: 0.0244) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0643 => 4.1123, std.dev.: 0.0151) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0535) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -14.15% (7.7485 => 6.6524, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.4080 => 0.3720, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 20:44:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 22:44:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418034400.68DB32A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24681?compare_to=24680&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24681, Order: 206507, Start Time: 2014-04-17 23:10:45, End Time: 2014-04-18 03:50:32 To: 24680, Order: 206503, Start Time: 2014-04-17 22:25:25, End Time: 2014-04-18 03:09:43 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (119 on baseline) Performance Improvements: 3 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (975 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 66.67% (0.0240 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.00% (0.0800 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.00% (0.4000 => 0.4320, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash: 5.36% (0.4480 => 0.4720, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.21% (1.2681 => 1.2961, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.86% (1.2881 => 1.3121, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.62% (1.2361 => 1.2561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.49% (1.3401 => 1.3601, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/sumcol: -7.58% (0.2640 => 0.2440, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.46% (0.9761 => 0.9521, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.15% (1.7321 => 1.7121, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.96% (1.1681 => 1.2961, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0460) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0597) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.9200 => 0.9760, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (1.7360 => 1.8240, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0309) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0400) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0357) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.9200 => 5.1040, std.dev.: 0.0327) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0278) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (7.8562 => 8.0922, std.dev.: 0.0233) MultiSource/Applications/sqlite3/sqlite3: 2.96% (23.7574 => 24.4615, std.dev.: 0.0385) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0476) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 2.78% (0.4320 => 0.4440, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0091) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2330, std.dev.: 0.0650) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 2.04% (18.8170 => 19.2011, std.dev.: 0.0258) MultiSource/Benchmarks/Bullet/bullet: 1.91% (37.0925 => 37.8006, std.dev.: 0.0766) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0490) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0088) MultiSource/Applications/ClamAV/clamscan: 1.10% (17.4082 => 17.6002, std.dev.: 0.0408) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 18.02% (0.9321 => 1.1001, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.33% (0.1800 => 0.2040, std.dev.: 0.0093) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.25% (25.8896 => 26.9897, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (1.3481 => 1.4001, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0073) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 2.84% (21.1533 => 21.7534, std.dev.: 0.1883) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 1.80% (6.6564 => 6.7764, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0040) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0429) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.64% (10.8967 => 2.0001, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0056) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 21:19:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 23:19:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140418041913.E78DC2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24682?compare_to=24672&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24682, Order: 206509, Start Time: 2014-04-17 23:43:10, End Time: 2014-04-18 04:25:44 To: 24672, Order: 206485, Start Time: 2014-04-17 18:43:04, End Time: 2014-04-17 23:26:06 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 6 (152 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 8.62% (0.2320 => 0.2520, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.43% (0.6320 => 0.6600, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0044) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.00% (1.3320 => 1.3720, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0054) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0082) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0117) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0043) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: 36.36% (0.0440 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.00% (0.0960 => 0.1200, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.65% (0.2040 => 0.2400, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.02% (1.0240 => 1.1880, std.dev.: 0.0195) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.3640 => 0.4160, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 13.94% (0.6600 => 0.7520, std.dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0096) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.02% (1.5601 => 1.7321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.03% (0.6200 => 0.6760, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0089) MultiSource/Applications/obsequi/Obsequi: 8.99% (1.8680 => 2.0360, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (1.1640 => 1.2520, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.99% (6.4680 => 6.9200, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0111) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0116) SingleSource/UnitTests/Vectorizer/gcc-loops: 6.45% (0.6200 => 0.6600, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.6440 => 12.3560, std.dev.: 0.0760) MultiSource/Applications/Burg/burg: 6.10% (1.5080 => 1.6000, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.97% (0.2680 => 0.2840, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.74% (9.4842 => 10.0282, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (5.8121 => 6.1361, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (1.7401 => 1.8361, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.36% (0.2240 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0259) MultiSource/Applications/spiff/spiff: 5.16% (1.0080 => 1.0600, std.dev.: 0.0201) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0220) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 4.41% (21.9606 => 22.9288, std.dev.: 0.0493) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.7400 => 1.8160, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.30% (6.5080 => 6.7880, std.dev.: 0.0441) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (6.5440 => 6.8240, std.dev.: 0.0487) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (5.3600 => 5.5760, std.dev.: 0.0653) MultiSource/Applications/JM/ldecod/ldecod: 4.02% (10.0443 => 10.4483, std.dev.: 0.0398) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0127) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.63% (1.3240 => 1.3720, std.dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 3.61% (6.9844 => 7.2365, std.dev.: 0.0132) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.59% (50.0290 => 51.8250, std.dev.: 0.0892) MultiSource/Applications/hbd/hbd: 3.46% (1.7360 => 1.7960, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 3.21% (18.4404 => 19.0326, std.dev.: 0.0457) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: 3.10% (2.5840 => 2.6640, std.dev.: 0.0257) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0398) MultiSource/Applications/ClamAV/clamscan: 3.00% (19.0444 => 19.6164, std.dev.: 0.0673) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (16.3483 => 16.7923, std.dev.: 0.0340) MultiSource/Benchmarks/Bullet/bullet: 2.68% (38.4046 => 39.4326, std.dev.: 0.0813) MultiSource/Applications/siod/siod: 2.50% (2.7162 => 2.7842, std.dev.: 0.0141) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0217) MultiSource/Applications/kimwitu++/kc: 2.32% (19.6891 => 20.1451, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.40% (25.6856 => 26.0456, std.dev.: 0.0205) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (13.0563 => 13.2203, std.dev.: 0.0400) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0403) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.64% (6.6684 => 6.8444, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (4.1003 => 4.2043, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (3.9922 => 4.0883, std.dev.: 0.0207) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.91% (3.9842 => 4.0603, std.dev.: 0.0244) MultiSource/Applications/lua/lua: 1.56% (21.7374 => 22.0774, std.dev.: 0.0862) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.32% (91.8497 => 49.3071, std.dev.: 10.1515) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.49% (26.0616 => 17.0731, std.dev.: 0.1147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.22% (50.3031 => 33.0901, std.dev.: 0.1775) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.18% (42.1466 => 28.5858, std.dev.: 0.5072) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1111) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.91% (4.8083 => 4.6683, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.72% (4.1243 => 4.0122, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.83% (2.8442 => 2.7922, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.79% (2.4602 => 2.4162, std.dev.: 0.0105) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0221) MultiSource/Benchmarks/mafft/pairlocalalign: -1.20% (26.6977 => 26.3776, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.01% (1.9761 => 1.9561, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 21:33:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 23:33:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418043333.A7CBA2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24683?compare_to=24681&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24683, Order: 206510, Start Time: 2014-04-17 23:59:11, End Time: 2014-04-18 04:40:03 To: 24681, Order: 206507, Start Time: 2014-04-17 23:10:45, End Time: 2014-04-18 03:50:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (104 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-8: 100.00% (0.0160 => 0.0320, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/objinst: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 14.81% (0.1080 => 0.1240, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.55% (0.2120 => 0.2280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 3.22% (1.4920 => 1.5400, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.25% (1.2801 => 1.2961, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (0.9681 => 0.9921, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (1.2361 => 1.2641, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -26.67% (0.0600 => 0.0440, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 33.33% (0.0480 => 0.0640, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.87% (0.3680 => 0.4080, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0429) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.95% (10.6960 => 11.3320, std.dev.: 0.0805) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0100) MultiSource/Applications/Burg/burg: 5.48% (1.4600 => 1.5400, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0171) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0345) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0499) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3800 => 1.4360, std.dev.: 0.0214) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0400) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0326) MultiSource/Applications/sqlite3/sqlite3: 2.74% (23.7574 => 24.4095, std.dev.: 0.0452) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.71% (48.1088 => 49.4129, std.dev.: 0.0535) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.5480 => 1.5880, std.dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0418) MultiSource/Applications/kimwitu++/kc: 2.30% (18.8170 => 19.2491, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0149) MultiSource/Benchmarks/Bullet/bullet: 1.87% (37.0925 => 37.7846, std.dev.: 0.0877) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0165) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0600) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0226) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0424) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0090) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (25.8896 => 26.9417, std.dev.: 0.0300) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0100) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.70% (0.4440 => 0.4560, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 2.67% (21.1533 => 21.7174, std.dev.: 0.1846) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0182) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0100) SingleSource/UnitTests/AtomicOps: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0199) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 21:44:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 23:44:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140418044448.B06242A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24684?compare_to=24674&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24684, Order: 206510, Start Time: 2014-04-18 00:05:54, End Time: 2014-04-18 04:51:23 To: 24674, Order: 206485, Start Time: 2014-04-17 19:03:17, End Time: 2014-04-17 23:48:57 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 6 (128 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/UnitTests/2002-05-02-CastTest: 100.00% (0.0160 => 0.0320, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/factor: 66.67% (0.0240 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 6.56% (0.2440 => 0.2600, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.84% (0.2480 => 0.2600, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 3.46% (1.1560 => 1.1960, std.dev.: 0.0111) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 12.06% (17.6723 => 19.8044, std.dev.: 0.0478) MultiSource/Applications/sqlite3/sqlite3: 1429.89% (1.7001 => 26.0096, std.dev.: 0.0788) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.65% (50.1010 => 51.9290, std.dev.: 0.0800) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.0520 => 1.0800, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.81% (11.3920 => 12.3960, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0095) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1243, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7124, std.dev.: 0.0144) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0103) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.08% (0.1560 => 0.1920, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.16% (1.8361 => 2.0961, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.17% (2.1121 => 2.3481, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.42% (1.9201 => 2.1201, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 10.17% (0.2360 => 0.2600, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.89% (1.8601 => 2.0441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: 8.74% (1.8760 => 2.0400, std.dev.: 0.0240) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 7.48% (1.0160 => 1.0920, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4920 => 0.5280, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.26% (1.2120 => 1.3000, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.9960 => 1.0560, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (6.4800 => 6.8520, std.dev.: 0.0536) MultiSource/Applications/hexxagon/hexxagon: 5.65% (1.1320 => 1.1960, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.00% (9.6042 => 10.0842, std.dev.: 0.0380) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (5.8281 => 6.0961, std.dev.: 0.0327) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (6.5320 => 6.8160, std.dev.: 0.0449) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.2283 => 10.6684, std.dev.: 0.0311) MultiSource/Applications/minisat/minisat: 4.25% (0.8480 => 0.8840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0090) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (6.5360 => 6.7560, std.dev.: 0.0402) MultiSource/Applications/lua/lua: 3.09% (4.7920 => 4.9400, std.dev.: 0.0434) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (16.3003 => 16.7963, std.dev.: 0.0628) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 2.85% (18.5284 => 19.0566, std.dev.: 0.0334) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.3960 => 5.5440, std.dev.: 0.0393) MultiSource/Applications/JM/lencod/lencod: 2.61% (22.2206 => 22.8007, std.dev.: 0.0608) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 2.15% (38.6366 => 39.4686, std.dev.: 0.0806) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0159) MultiSource/Applications/kimwitu++/kc: 1.94% (19.8291 => 20.2131, std.dev.: 0.0561) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0281) MultiSource/Applications/siod/siod: 1.89% (2.7522 => 2.8042, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0372) MultiSource/Applications/siod/siod: 11.03% (2.8642 => 3.1802, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 4.42% (1.9921 => 2.0801, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.14% (4.4803 => 4.5763, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9684 => 6.0644, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (4.0003 => 4.0643, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.69% (10.4007 => 2.0081, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.74% (2.9562 => 0.9240, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.75% (1.5881 => 1.0521, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.17% (94.8339 => 49.1511, std.dev.: 9.7948) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.06% (49.9431 => 32.9301, std.dev.: 0.1703) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.62% (25.7136 => 17.0691, std.dev.: 0.1624) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.22% (37.0863 => 28.4738, std.dev.: 0.5475) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.66% (7.8165 => 6.7484, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -12.08% (2.7482 => 2.4162, std.dev.: 0.0915) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.94% (1.2681 => 1.1801, std.dev.: 0.0295) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.78% (2.7522 => 2.6482, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3521 => 2.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0197) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 21:49:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 23:49:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140418044914.22D2F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24685?compare_to=24675&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24685, Order: 206539, Start Time: 2014-04-18 00:12:39, End Time: 2014-04-18 04:55:45 To: 24675, Order: 206485, Start Time: 2014-04-17 19:11:15, End Time: 2014-04-17 23:55:40 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 6 (153 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 26.67% (0.0600 => 0.0760, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.62% (0.4520 => 0.5000, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.74% (0.7320 => 0.7960, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.59% (0.3640 => 0.3880, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -33.33% (0.0600 => 0.0400, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2337.50% (0.0320 => 0.7800, std.dev.: 0.0118) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0072) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 327.63% (0.2320 => 0.9921, std.dev.: 0.0151) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 203.17% (0.2520 => 0.7640, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0050) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0091) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0053) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0088) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.98% (0.7040 => 1.0840, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: 42.82% (1.3920 => 1.9880, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.05% (0.1520 => 0.1840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 18.70% (8.5802 => 10.1843, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.31% (1.1361 => 1.3441, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.18% (0.0880 => 0.1040, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 17.83% (1.1441 => 1.3481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 15.50% (19.5406 => 22.5687, std.dev.: 0.0453) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.32% (5.3360 => 6.1001, std.dev.: 0.0417) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0122) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 10.71% (0.4480 => 0.4960, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.19% (0.4320 => 0.4760, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.26% (0.6480 => 0.7080, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.94% (5.7280 => 6.2400, std.dev.: 0.0447) MultiSource/Benchmarks/mafft/pairlocalalign: 8.92% (11.3843 => 12.4003, std.dev.: 0.0334) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 8.34% (6.2844 => 6.8084, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.15% (0.7360 => 0.7960, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.90% (5.6680 => 6.1160, std.dev.: 0.0483) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.31% (11.4440 => 12.2800, std.dev.: 0.1002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (9.5802 => 10.2122, std.dev.: 0.0567) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.40% (1.6240 => 1.7280, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 4.61% (4.7720 => 4.9920, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.7600 => 1.8360, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.10% (6.8280 => 7.1080, std.dev.: 0.0459) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.65% (0.7680 => 0.7960, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0166) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.54% (49.1529 => 50.8929, std.dev.: 0.0861) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0473) MultiSource/Applications/ClamAV/clamscan: 2.79% (19.2243 => 19.7603, std.dev.: 0.0623) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.33% (24.7575 => 25.3335, std.dev.: 0.0618) MultiSource/Applications/kimwitu++/kc: 2.25% (19.7491 => 20.1931, std.dev.: 0.0504) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 1.24% (39.0726 => 39.5566, std.dev.: 0.0554) MultiSource/Applications/SPASS/SPASS: 1.19% (18.7966 => 19.0205, std.dev.: 0.0425) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0228) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0172) MultiSource/Applications/siod/siod: 6.70% (2.9842 => 3.1842, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0416) MultiSource/Applications/sqlite3/sqlite3: 3.45% (4.0563 => 4.1963, std.dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5442 => 2.5802, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (25.4536 => 25.7856, std.dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.66% (21.6534 => 17.8291, std.dev.: 0.0482) SingleSource/Benchmarks/Linpack/linpack-pc: -16.39% (7.8605 => 6.5724, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0611) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.0963 => 5.0123, std.dev.: 0.0224) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 21:54:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Apr 2014 23:54:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140418045405.C93EC2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24686?compare_to=24676&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24686, Order: 206539, Start Time: 2014-04-18 00:14:27, End Time: 2014-04-18 05:00:39 To: 24676, Order: 206485, Start Time: 2014-04-17 19:11:05, End Time: 2014-04-17 23:57:22 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1101 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-CastToBool: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.55% (0.2120 => 0.2280, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 3.70% (0.3240 => 0.3360, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (2.1440 => 2.1920, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.14% (1.7521 => 1.7721, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 200.00% (0.0080 => 0.0240, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 22:17:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 00:17:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140418051739.648262A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24687?compare_to=24677&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24687, Order: 206539, Start Time: 2014-04-18 00:35:43, End Time: 2014-04-18 05:24:13 To: 24677, Order: 206485, Start Time: 2014-04-17 19:30:59, End Time: 2014-04-18 00:18:48 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (138 on baseline) Performance Improvements: 4 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.08% (0.0520 => 0.0640, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.11% (0.1080 => 0.1200, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 7.14% (0.2800 => 0.3000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.4160 => 0.4320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.8120 => 1.8480, std.dev.: 0.0112) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.7481 => 1.7721, std.dev.: 0.0070) MultiSource/Applications/siod/siod: 1.29% (2.7882 => 2.8242, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.37% (0.9681 => 1.0201, std.dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: -50.00% (0.0240 => 0.0120, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.68% (2.0921 => 2.0361, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.53% (2.3561 => 2.3201, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.34% (2.3921 => 2.3601, std.dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0041) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0094) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0048) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 50.00% (0.0400 => 0.0600, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.91% (1.7681 => 2.1201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.81% (1.6961 => 2.0321, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.67% (1.7081 => 2.0441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.57% (1.6761 => 2.0041, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 18.80% (1.8081 => 2.1481, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.10% (1.7241 => 2.0361, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/puzzle: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.14% (1.9601 => 2.2961, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.38% (0.1040 => 0.1200, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.11% (0.6120 => 0.6800, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.7280 => 1.8480, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.9920 => 1.0560, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.58% (0.8601 => 0.9081, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.56% (11.7880 => 12.4440, std.dev.: 0.0799) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (1.2400 => 1.3080, std.dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.4160 => 1.4920, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.36% (6.7200 => 7.0800, std.dev.: 0.0606) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (1.6481 => 1.7321, std.dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0192) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.45% (9.9842 => 10.4282, std.dev.: 0.0422) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.20% (1.5240 => 1.5880, std.dev.: 0.0206) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0471) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0083) MultiSource/Applications/d/make_dparser: 3.73% (3.9641 => 4.1121, std.dev.: 0.0278) MultiSource/Applications/oggenc/oggenc: 3.70% (6.9124 => 7.1684, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (2.0440 => 2.1120, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (6.8321 => 7.0561, std.dev.: 0.0233) MultiSource/Applications/SPASS/SPASS: 3.25% (18.4924 => 19.0925, std.dev.: 0.0510) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 3.18% (10.3203 => 10.6484, std.dev.: 0.0374) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.97% (1.3480 => 1.3880, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 2.86% (19.7371 => 20.3011, std.dev.: 0.0367) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.82% (51.1089 => 52.5489, std.dev.: 0.1123) MultiSource/Applications/JM/lencod/lencod: 2.62% (22.6287 => 23.2207, std.dev.: 0.0756) MultiSource/Applications/siod/siod: 2.47% (2.7562 => 2.8242, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (5.5480 => 5.6720, std.dev.: 0.0459) MultiSource/Applications/ClamAV/clamscan: 1.96% (20.2445 => 20.6405, std.dev.: 0.0903) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 1.91% (38.9366 => 39.6806, std.dev.: 0.0438) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.71% (16.5963 => 16.8803, std.dev.: 0.0517) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 1.54% (25.1895 => 25.5776, std.dev.: 0.0401) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0244 => 6.1044, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 12.16% (2.8282 => 3.1722, std.dev.: 0.0172) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.40% (1.0921 => 1.1401, std.dev.: 0.0178) MultiSource/Applications/sqlite3/sqlite3: 3.71% (4.0923 => 4.2443, std.dev.: 0.0142) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0277) MultiSource/Applications/lua/lua: 2.84% (21.6534 => 22.2694, std.dev.: 0.1225) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9604 => 6.0644, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0203 => 4.0723, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.58% (6.2884 => 0.8440, std.dev.: 0.0139) SingleSource/UnitTests/Vector/constpool: -81.63% (10.9087 => 2.0041, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0048) MultiSource/Applications/obsequi/Obsequi: -21.60% (2.6481 => 2.0760, std.dev.: 0.0229) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.10% (7.5041 => 6.2960, std.dev.: 0.0606) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.99% (7.4801 => 6.2840, std.dev.: 0.0436) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0056) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (13.5243 => 13.1243, std.dev.: 0.0353) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6534 => 17.8851, std.dev.: 0.0391) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (0.9281 => 0.8561, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -1.64% (8.3085 => 8.1725, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -1.20% (11.6527 => 11.5127, std.dev.: 0.0101) MultiSource/Applications/aha/aha: -1.10% (2.9122 => 2.8802, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 23:02:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 01:02:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418060220.631712A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24688?compare_to=24683&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24688, Order: 206541, Start Time: 2014-04-18 01:29:16, End Time: 2014-04-18 06:08:52 To: 24683, Order: 206510, Start Time: 2014-04-17 23:59:11, End Time: 2014-04-18 04:40:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (101 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0560 => 0.0680, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 16.67% (0.0960 => 0.1120, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.16% (1.3920 => 1.4360, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.28% (1.2481 => 1.2641, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 16.67% (0.1200 => 0.1400, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (5.8044 => 5.7404, std.dev.: 0.0243) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.63% (0.4560 => 0.4440, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.38% (0.3760 => 0.4000, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0090) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0319) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0247) MultiSource/Applications/Burg/burg: 4.38% (1.4600 => 1.5240, std.dev.: 0.0211) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.9200 => 5.1280, std.dev.: 0.0355) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0281) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0467) MultiSource/Applications/sqlite3/sqlite3: 2.36% (23.7574 => 24.3175, std.dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0085) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1930, std.dev.: 0.1084) MultiSource/Applications/JM/lencod/lencod: 2.23% (17.6165 => 18.0085, std.dev.: 0.0789) MultiSource/Applications/kimwitu++/kc: 2.02% (18.8170 => 19.1971, std.dev.: 0.0311) MultiSource/Benchmarks/Bullet/bullet: 1.59% (37.0925 => 37.6806, std.dev.: 0.0758) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (7.8562 => 7.9802, std.dev.: 0.0481) MultiSource/Applications/SPASS/SPASS: 1.50% (17.5484 => 17.8124, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (25.8896 => 26.9697, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0080) MultiSource/Applications/lua/lua: 2.74% (21.1533 => 21.7334, std.dev.: 0.1085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.56% (6.6564 => 6.7604, std.dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0233) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 17 23:57:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 01:57:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418065719.4CD432A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24689?compare_to=24688&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24689, Order: 206548, Start Time: 2014-04-18 02:22:30, End Time: 2014-04-18 07:03:51 To: 24688, Order: 206541, Start Time: 2014-04-18 01:29:16, End Time: 2014-04-18 06:08:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (103 on baseline) Performance Improvements: 4 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/treeadd/treeadd: 85.71% (0.0280 => 0.0520, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.52% (0.1680 => 0.1840, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 2.44% (1.1480 => 1.1760, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.53% (1.1641 => 1.2401, std.dev.: 0.0132) SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 1.88% (21.7334 => 22.1414, std.dev.: 0.1435) MultiSource/Benchmarks/sim/sim: 1.62% (4.6803 => 4.7563, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/hash: 1.52% (4.2243 => 4.2883, std.dev.: 0.0242) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/recursive-throw: -71.43% (0.0280 => 0.0080, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -5.88% (4.6963 => 4.4203, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.01% (1.3961 => 1.3401, std.dev.: 0.0163) MultiSource/Applications/sqlite3/sqlite3: -2.42% (4.1243 => 4.0243, std.dev.: 0.0198) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.00% (0.1600 => 0.1840, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.45% (1.3641 => 1.4521, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0584) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0375) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.59% (0.4360 => 0.4560, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0286) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (8.1441 => 8.4481, std.dev.: 0.0501) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0382) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0390) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0404) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0282) MultiSource/Applications/JM/lencod/lencod: 2.16% (17.6165 => 17.9965, std.dev.: 0.0561) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0093) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.09% (48.1088 => 49.1130, std.dev.: 0.0800) MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.97% (1.2200 => 1.2440, std.dev.: 0.0091) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: 1.73% (37.0925 => 37.7325, std.dev.: 0.0779) MultiSource/Applications/sqlite3/sqlite3: 1.70% (23.7574 => 24.1615, std.dev.: 0.0263) MultiSource/Applications/kimwitu++/kc: 1.70% (18.8170 => 19.1370, std.dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0140) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0390) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 4.67% (21.1533 => 22.1414, std.dev.: 0.1435) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.14% (25.8896 => 26.7017, std.dev.: 0.0486) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0338) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0079) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0299) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 00:57:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 02:57:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418075703.EA2EA2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24690?compare_to=24689&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24690, Order: 206556, Start Time: 2014-04-18 03:19:25, End Time: 2014-04-18 08:03:37 To: 24689, Order: 206548, Start Time: 2014-04-18 02:22:30, End Time: 2014-04-18 07:03:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 26 (113 on baseline) Performance Improvements: 4 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1082 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 37.50% (0.0640 => 0.0880, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.1000 => 0.1200, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.17% (1.0840 => 1.1400, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.35% (0.3680 => 0.3840, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.41% (0.3520 => 0.3640, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.18% (1.2841 => 1.3121, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.99% (2.0120 => 2.0520, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.69% (4.9800 => 5.0640, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.57% (1.2721 => 1.2921, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.22% (1.3081 => 1.3241, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.11% (24.1615 => 24.4295, std.dev.: 0.0411) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: 6.15% (4.4203 => 4.6923, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.54% (3.9682 => 4.1483, std.dev.: 0.0550) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.3401 => 1.3961, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.80% (0.3160 => 0.3280, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.63% (0.6080 => 0.6240, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.48% (4.0243 => 4.1243, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.81% (1.2401 => 1.1681, std.dev.: 0.0109) MultiSource/Applications/lua/lua: -2.02% (22.1414 => 21.6934, std.dev.: 0.1500) SingleSource/Benchmarks/McGill/queens: -1.97% (2.2281 => 2.1841, std.dev.: 0.0152) MultiSource/Benchmarks/BitBench/five11/five11: -1.88% (2.3441 => 2.3001, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 15.79% (0.0760 => 0.0880, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.07% (1.1921 => 1.3121, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0808) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.77% (0.6240 => 0.6600, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0437) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0124) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0435) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0167) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0285) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0140) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0447) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (4.9000 => 5.0640, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0482) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0404) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 2.83% (23.7574 => 24.4295, std.dev.: 0.0411) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0509) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2329, std.dev.: 0.0737) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8166, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 1.72% (18.8170 => 19.1410, std.dev.: 0.0471) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0147) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0437) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.00% (0.6000 => 0.6240, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (25.8896 => 26.9057, std.dev.: 0.0323) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.81% (3.9962 => 4.1483, std.dev.: 0.0550) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0117) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 2.55% (21.1533 => 21.6934, std.dev.: 0.1500) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0107) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0309) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.0123 => 5.0803, std.dev.: 0.0234) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0446) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.68% (10.8967 => 1.9961, std.dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (2.3881 => 2.2521, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3361 => 2.3001, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.35% (2.0681 => 2.0401, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 01:29:29 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 01:29:29 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140418082930.47D284F9EBBC@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14561 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206565 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.ModuleIsIn (17762 of 17763) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17763 of 17763) 1 warning(s) in tests. Testing Time: 360.62s ******************** Failing Tests (1): LLVM :: MC/AsmParser/directive_seh.s Expected Passes : 17613 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::directive_seh.s': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/MC/AsmParser/directive_seh.s:6:10: error: expected string not found in input # CHECK: .seh_savereg 6, 16 ^ :34:2: note: scanning from here movq %rsi, 16(%rsp) ^ :36:2: note: possible intended match here .seh_savereg %rbp, 16 ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 01:29:29 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 01:29:29 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140418082930.48E864F9EBBD@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14561 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206565 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.ModuleIsIn (17762 of 17763) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17763 of 17763) 1 warning(s) in tests. Testing Time: 360.62s ******************** Failing Tests (1): LLVM :: MC/AsmParser/directive_seh.s Expected Passes : 17613 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::directive_seh.s': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/MC/AsmParser/directive_seh.s:6:10: error: expected string not found in input # CHECK: .seh_savereg 6, 16 ^ :34:2: note: scanning from here movq %rsi, 16(%rsp) ^ :36:2: note: possible intended match here .seh_savereg %rbp, 16 ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 01:29:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 01:29:30 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140418082930.491AF4F9EBBE@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18999 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206565 Blamelist: kcc,yrnkrn BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 01:29:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 01:29:30 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140418082930.4A6B24F9EBBF@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/18999 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206565 Blamelist: kcc,yrnkrn BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: lib/Transforms/Instrumentation/AddressSanitizer.cpp test/Instrumentation/AddressSanitizer/coverage.ll On: http://10.1.1.2/svn/llvm-project For: llvm At: Fri 18 Apr 2014 01:10:41 Changed By: kcc Comments: [asan] one more workaround for PR17409: don't do BB-level coverage instrumentation if there are more than N (=1500) basic blocks. This makes ASanCoverage work on libjpeg_turbo/jchuff.c used by Chrome, which has 1824 BBsProperties: File: lib/MC/MCAsmStreamer.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Fri 18 Apr 2014 01:16:41 Changed By: yrnkrn Comments: Patch by Ray Donnelly. Emit WIN64 SEH registers by name instead of just number. Properties: LOGS: From llvm-testresults at cs.uiuc.edu Fri Apr 18 01:52:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 03:52:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418085232.D0B192A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24691?compare_to=24690&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24691, Order: 206557, Start Time: 2014-04-18 04:19:19, End Time: 2014-04-18 08:59:05 To: 24690, Order: 206556, Start Time: 2014-04-18 03:19:25, End Time: 2014-04-18 08:03:37 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (99 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 21.05% (0.0760 => 0.0920, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.16% (0.1520 => 0.1720, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary2: 7.04% (0.2840 => 0.3040, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.88% (0.3400 => 0.3600, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.28% (0.7480 => 0.7800, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.15% (1.3001 => 1.3281, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/lists: -1.60% (6.0124 => 5.9164, std.dev.: 0.0340) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0112) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0536) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.71% (1.1921 => 1.2721, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0124) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0438) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0491) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0233) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0367) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0182) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0411) MultiSource/Applications/sqlite3/sqlite3: 2.69% (23.7574 => 24.3975, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0335) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.29% (48.1088 => 49.2089, std.dev.: 0.0609) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0099) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 1.67% (37.0925 => 37.7125, std.dev.: 0.0823) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1290, std.dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0400) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0222) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (25.8896 => 26.9337, std.dev.: 0.0406) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0073) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 2.74% (21.1533 => 21.7334, std.dev.: 0.1283) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.74% (6.6564 => 6.7724, std.dev.: 0.0310) SingleSource/Benchmarks/Shootout/lists: 1.72% (5.8164 => 5.9164, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0232) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0044) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 02:07:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 04:07:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140418090751.2EC002A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24692?compare_to=24682&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24692, Order: 206557, Start Time: 2014-04-18 04:31:29, End Time: 2014-04-18 09:14:25 To: 24682, Order: 206509, Start Time: 2014-04-17 23:43:10, End Time: 2014-04-18 04:25:44 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (152 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Regression/C++/EH/class_hierarchy: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Regression/C/test_indvars: 18.18% (0.0880 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.90% (0.1240 => 0.1400, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.43% (0.1400 => 0.1560, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0040) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (1.0120 => 1.0560, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.27% (1.5920 => 1.6440, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/flops: 2.44% (0.4920 => 0.5040, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.05% (0.5840 => 0.5960, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.89% (1.0601 => 1.0801, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0120) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0073) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 295.67% (0.4600 => 1.8201, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.02% (1.0240 => 1.1880, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.91% (0.1760 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 13.46% (0.2080 => 0.2360, std.dev.: 0.0093) SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0136) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.32% (0.6200 => 0.6840, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: 9.59% (0.5840 => 0.6400, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (1.0240 => 1.1160, std.dev.: 0.0253) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: 8.57% (1.8680 => 2.0280, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0127) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.49% (0.4240 => 0.4600, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0100) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.80% (1.4361 => 1.5481, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.04% (0.2840 => 0.3040, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.86% (6.4680 => 6.9120, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 6.75% (1.0080 => 1.0760, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (11.6440 => 12.3880, std.dev.: 0.0680) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.22% (1.4801 => 1.5721, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.38% (1.5600 => 1.6440, std.dev.: 0.0176) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (9.4842 => 9.9922, std.dev.: 0.0453) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0147) MultiSource/Applications/Burg/burg: 5.31% (1.5080 => 1.5880, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (5.8121 => 6.1121, std.dev.: 0.0356) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 4.41% (21.9606 => 22.9288, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (6.5440 => 6.8280, std.dev.: 0.0401) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 4.18% (5.3600 => 5.5840, std.dev.: 0.0559) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (6.5080 => 6.7760, std.dev.: 0.0391) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 3.98% (10.0443 => 10.4443, std.dev.: 0.0510) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.91% (50.0290 => 51.9850, std.dev.: 0.0514) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0084) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0157) MultiSource/Applications/lua/lua: 3.76% (4.7880 => 4.9680, std.dev.: 0.0306) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0166) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 3.26% (6.9844 => 7.2124, std.dev.: 0.0216) MultiSource/Applications/hbd/hbd: 3.23% (1.7360 => 1.7920, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 3.12% (18.4404 => 19.0165, std.dev.: 0.0424) MultiSource/Applications/ClamAV/clamscan: 3.07% (19.0444 => 19.6284, std.dev.: 0.0654) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0215) MultiSource/Applications/d/make_dparser: 2.82% (3.9681 => 4.0801, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (16.3483 => 16.7803, std.dev.: 0.0394) MultiSource/Benchmarks/Bullet/bullet: 2.62% (38.4046 => 39.4126, std.dev.: 0.0716) MultiSource/Applications/kimwitu++/kc: 2.36% (19.6891 => 20.1531, std.dev.: 0.0617) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (4.1843 => 4.2803, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 1.86% (0.8600 => 0.8760, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 1.23% (25.6856 => 26.0016, std.dev.: 0.0458) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.64% (2.1401 => 2.4962, std.dev.: 0.0316) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.33% (0.7200 => 0.7440, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: 3.13% (7.4205 => 7.6525, std.dev.: 0.0336) MultiSource/Applications/sqlite3/sqlite3: 2.61% (3.9842 => 4.0883, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (3.9922 => 4.0923, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.44% (4.1003 => 4.2003, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 2.08% (21.7374 => 22.1894, std.dev.: 0.0620) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 1.13% (8.1245 => 8.2165, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.02% (2.7442 => 2.7722, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0252) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.16% (91.8497 => 49.4511, std.dev.: 10.0511) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.55% (26.0616 => 17.0571, std.dev.: 0.1201) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.35% (50.3031 => 33.0261, std.dev.: 0.1779) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -33.37% (42.1466 => 28.0818, std.dev.: 0.5446) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1088) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.91% (4.1243 => 4.0042, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0088) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.83% (2.8442 => 2.7922, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0103) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0146) MultiSource/Benchmarks/mafft/pairlocalalign: -1.26% (26.6977 => 26.3616, std.dev.: 0.0407) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.01% (1.9761 => 1.9561, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 02:36:02 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 02:36:02 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140418093602.C89704F9F400@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19000 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206566 Blamelist: yrnkrn Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Fri Apr 18 02:36:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 04:36:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140418093605.B3ACC2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24693?compare_to=24684&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24693, Order: 206557, Start Time: 2014-04-18 04:57:01, End Time: 2014-04-18 09:42:38 To: 24684, Order: 206510, Start Time: 2014-04-18 00:05:54, End Time: 2014-04-18 04:51:23 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 16 (150 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (925 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 133.33% (0.0120 => 0.0280, std.dev.: 0.0030) SingleSource/Regression/C++/EH/throw_rethrow_test: 60.00% (0.0200 => 0.0320, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/treeadd/treeadd: 40.00% (0.0400 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: 19.05% (0.0840 => 0.1000, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.82% (0.2720 => 0.2960, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.21% (0.4440 => 0.4760, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/18-imp/imp: 4.46% (0.4480 => 0.4680, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.95% (0.3040 => 0.3160, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 3.32% (1.5640 => 1.6160, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.4160 => 0.4280, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.70% (2.3481 => 2.3881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.37% (2.0441 => 2.0721, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.18% (2.0281 => 2.0521, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.94% (0.9721 => 1.0201, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.47% (1.2961 => 1.3281, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.95% (17.6723 => 19.7844, std.dev.: 0.0510) MultiSource/Applications/sqlite3/sqlite3: 1428.00% (1.7001 => 25.9776, std.dev.: 0.0356) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.54% (50.1010 => 51.8770, std.dev.: 0.0825) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0309) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.09% (11.3920 => 12.4280, std.dev.: 0.0568) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0374) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1283, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0146) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0100) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 200.00% (0.0080 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/EH/throw_rethrow_test: 166.67% (0.0120 => 0.0320, std.dev.: 0.0018) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0067) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.00% (0.1920 => 0.2400, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 19.35% (0.2480 => 0.2960, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.96% (1.9521 => 2.2441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0150) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.4160 => 0.4760, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.94% (1.8081 => 2.0601, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.72% (1.9241 => 2.1881, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.51% (1.8361 => 2.0841, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (1.8361 => 2.0521, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.40% (1.8601 => 2.0721, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.47% (1.9481 => 2.1521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.43% (0.6360 => 0.6960, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0109) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0236) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.24% (0.3400 => 0.3680, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.6960 => 1.8160, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0339) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 5.76% (1.5280 => 1.6160, std.dev.: 0.0182) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9960 => 1.0480, std.dev.: 0.0157) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.19% (0.6160 => 0.6480, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.78% (6.5320 => 6.8440, std.dev.: 0.0327) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.5640 => 1.6360, std.dev.: 0.0217) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.58% (9.6042 => 10.0442, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.49% (0.9801 => 1.0241, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (5.8281 => 6.0641, std.dev.: 0.0542) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (10.2283 => 10.6284, std.dev.: 0.0347) MultiSource/Applications/treecc/treecc: 3.86% (2.5880 => 2.6880, std.dev.: 0.0245) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0130) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.7480 => 1.8120, std.dev.: 0.0193) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0159) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.38% (1.3000 => 1.3440, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.24% (6.5360 => 6.7480, std.dev.: 0.0455) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.5040 => 1.5520, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (5.3960 => 5.5560, std.dev.: 0.0520) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (16.3003 => 16.7763, std.dev.: 0.0611) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0147) MultiSource/Applications/SPASS/SPASS: 2.72% (18.5284 => 19.0325, std.dev.: 0.0483) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (2.3401 => 2.4002, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (2.1240 => 2.1760, std.dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: 2.41% (22.2206 => 22.7567, std.dev.: 0.0689) MultiSource/Benchmarks/Bullet/bullet: 2.29% (38.6366 => 39.5206, std.dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0138) MultiSource/Applications/d/make_dparser: 2.11% (3.9761 => 4.0601, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 2.06% (19.8291 => 20.2371, std.dev.: 0.0473) MultiSource/Applications/siod/siod: 1.89% (2.7522 => 2.8042, std.dev.: 0.0116) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.48% (2.1201 => 2.4482, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 11.03% (2.8642 => 3.1802, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 2.24% (6.5964 => 6.7444, std.dev.: 0.0358) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (4.0003 => 4.0763, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 1.13% (8.1285 => 8.2205, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.73% (10.4007 => 2.0041, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.81% (0.6880 => 0.6480, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.09% (94.8339 => 49.2271, std.dev.: 9.4934) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.75% (49.9431 => 33.0861, std.dev.: 0.1761) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.59% (25.7136 => 17.0771, std.dev.: 0.1446) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.55% (37.0863 => 28.3538, std.dev.: 0.5893) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1144) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -13.61% (7.8165 => 6.7524, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.36% (1.2681 => 1.2001, std.dev.: 0.0239) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.75% (4.1123 => 4.0403, std.dev.: 0.0092) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.47% (2.4522 => 2.4162, std.dev.: 0.0118) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 02:37:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 04:37:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140418093741.F25012A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24694?compare_to=24685&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24694, Order: 206557, Start Time: 2014-04-18 05:01:33, End Time: 2014-04-18 09:44:14 To: 24685, Order: 206539, Start Time: 2014-04-18 00:12:39, End Time: 2014-04-18 04:55:45 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 11 (166 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (922 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 33.33% (0.0720 => 0.0960, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 20.00% (0.0800 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5800 => 0.5920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.79% (1.3441 => 1.3681, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 37.50% (0.0320 => 0.0440, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (0.6040 => 0.6240, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2560 => 0.2400, std.dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2362.50% (0.0320 => 0.7880, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 994.87% (0.0760 => 0.8321, std.dev.: 0.0060) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0092) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 200.00% (0.2520 => 0.7560, std.dev.: 0.0127) SingleSource/UnitTests/2002-05-03-NotTest: 200.00% (0.0080 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0052) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0036) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0056) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0054) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: 44.83% (1.3920 => 2.0160, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0086) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/misr: 31.25% (0.0640 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.00% (0.1600 => 0.2000, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.19% (1.2401 => 1.5401, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0092) MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.42% (1.1361 => 1.3681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.79% (1.1321 => 1.3561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 18.95% (1.1401 => 1.3561, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.77% (1.1721 => 1.3921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 18.66% (1.1361 => 1.3481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 18.60% (8.5802 => 10.1763, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.57% (1.2521 => 1.4721, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.67% (1.2001 => 1.4001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.18% (1.3841 => 1.6081, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 15.33% (19.5406 => 22.5367, std.dev.: 0.0417) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.92% (5.3360 => 6.1321, std.dev.: 0.0299) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0127) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0118) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 9.21% (11.3843 => 12.4323, std.dev.: 0.0271) MultiSource/Applications/oggenc/oggenc: 8.66% (6.2844 => 6.8284, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.64% (0.6480 => 0.7040, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.52% (5.7280 => 6.2160, std.dev.: 0.0503) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.90% (5.6680 => 6.1160, std.dev.: 0.0457) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (11.4440 => 12.3200, std.dev.: 0.0749) MultiSource/Benchmarks/McCat/08-main/main: 7.14% (0.3360 => 0.3600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.01% (9.5802 => 10.2522, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0054) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.7640 => 0.8120, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.23% (1.4760 => 1.5680, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.43% (1.6240 => 1.6960, std.dev.: 0.0220) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2760 => 0.2880, std.dev.: 0.0038) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: 3.94% (5.3840 => 5.5960, std.dev.: 0.0250) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.50% (49.1529 => 50.8729, std.dev.: 0.1028) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (6.8280 => 7.0520, std.dev.: 0.0508) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.4320 => 1.4760, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 2.77% (19.2243 => 19.7564, std.dev.: 0.0474) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.7600 => 1.8080, std.dev.: 0.0177) MultiSource/Applications/sqlite3/sqlite3: 2.62% (24.7575 => 25.4055, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5800 => 0.5920, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 1.90% (19.7491 => 20.1251, std.dev.: 0.0570) MultiSource/Benchmarks/Bullet/bullet: 1.27% (39.0726 => 39.5686, std.dev.: 0.0561) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0124 => 6.0844, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0155) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (0.5920 => 0.6240, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.12% (1.6521 => 1.7201, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: 3.87% (6.8204 => 7.0844, std.dev.: 0.0245) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 3.55% (4.0563 => 4.2003, std.dev.: 0.0185) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.91% (1.1001 => 1.1321, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (4.1083 => 4.1883, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (25.4536 => 25.7816, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0443 => 4.0963, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.26% (3.4802 => 3.5242, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0080) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.68% (21.6534 => 17.8251, std.dev.: 0.0507) SingleSource/Benchmarks/Linpack/linpack-pc: -16.39% (7.8605 => 6.5724, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.41% (3.4722 => 3.1802, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: -8.33% (0.2880 => 0.2640, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0879) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: -3.10% (2.7082 => 2.6242, std.dev.: 0.0247) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0149) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.0963 => 5.0123, std.dev.: 0.0206) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 02:46:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 04:46:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140418094618.A8E292A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24695?compare_to=24686&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24695, Order: 206557, Start Time: 2014-04-18 05:06:21, End Time: 2014-04-18 09:52:49 To: 24686, Order: 206539, Start Time: 2014-04-18 00:14:27, End Time: 2014-04-18 05:00:39 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1097 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/2002-10-09-ArrayResolution: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C/matrixTranspose: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.33% (0.0480 => 0.0640, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.16% (0.3800 => 0.3920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.65% (1.9361 => 1.9681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.35% (1.7801 => 1.8041, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.52% (0.7080 => 0.7400, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.44% (3.8362 => 3.9682, std.dev.: 0.0435) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 03:11:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 05:11:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140418101140.4220F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24696?compare_to=24687&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24696, Order: 206557, Start Time: 2014-04-18 05:29:51, End Time: 2014-04-18 10:18:12 To: 24687, Order: 206539, Start Time: 2014-04-18 00:35:43, End Time: 2014-04-18 05:24:13 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (137 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-11-VaListArg: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.00% (0.1000 => 0.1120, std.dev.: 0.0027) MultiSource/Applications/aha/aha: 9.68% (0.1240 => 0.1360, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.4480 => 0.4720, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists: 3.90% (0.3080 => 0.3200, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.64% (0.9081 => 0.9321, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.36% (2.0361 => 2.0841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.60% (2.0041 => 2.0361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.37% (2.0441 => 2.0721, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.63% (0.3440 => 0.3840, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 7.02% (0.4560 => 0.4880, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 500.00% (0.0040 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 294.76% (0.4560 => 1.8001, std.dev.: 0.0128) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.48% (1.6761 => 2.0361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.48% (1.7321 => 2.1041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.95% (1.6801 => 2.0321, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.88% (1.7241 => 2.0841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.92% (1.9881 => 2.3841, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.64% (0.2360 => 0.2800, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: 17.65% (0.1360 => 0.1600, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0141) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0062) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0044) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.27% (0.4400 => 0.4720, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.35% (11.7880 => 12.5360, std.dev.: 0.0799) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.17% (3.5002 => 3.7162, std.dev.: 0.0290) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.7200 => 0.7640, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.95% (6.7200 => 7.1200, std.dev.: 0.0520) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.5240 => 1.6080, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.7280 => 1.8200, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/lists: 5.26% (0.3040 => 0.3200, std.dev.: 0.0027) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.04% (1.3480 => 1.4160, std.dev.: 0.0177) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.97% (9.9842 => 10.4802, std.dev.: 0.0418) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0196) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0374) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0223) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0268) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 3.82% (6.9124 => 7.1764, std.dev.: 0.0256) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (6.8321 => 7.0881, std.dev.: 0.0321) MultiSource/Applications/SPASS/SPASS: 3.64% (18.4924 => 19.1647, std.dev.: 0.0421) MultiSource/Applications/JM/ldecod/ldecod: 3.41% (10.3203 => 10.6724, std.dev.: 0.0385) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (5.5480 => 5.7240, std.dev.: 0.0286) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (2.0440 => 2.1040, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 2.74% (22.6287 => 23.2487, std.dev.: 0.0674) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.62% (51.1089 => 52.4489, std.dev.: 0.1541) MultiSource/Applications/kimwitu++/kc: 2.55% (19.7371 => 20.2411, std.dev.: 0.0501) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (3.0122 => 3.0882, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 2.32% (2.7562 => 2.8202, std.dev.: 0.0184) MultiSource/Applications/ClamAV/clamscan: 2.05% (20.2445 => 20.6605, std.dev.: 0.0469) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.0244 => 6.1364, std.dev.: 0.0237) MultiSource/Benchmarks/Bullet/bullet: 1.80% (38.9366 => 39.6366, std.dev.: 0.1236) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (16.5963 => 16.8923, std.dev.: 0.0743) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.52% (25.1895 => 25.5736, std.dev.: 0.0311) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 19.39% (0.9281 => 1.1081, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 12.30% (2.8282 => 3.1762, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 3.71% (4.0923 => 4.2443, std.dev.: 0.0106) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0362) MultiSource/Applications/lua/lua: 2.83% (21.6534 => 22.2654, std.dev.: 0.1479) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (4.2443 => 4.3403, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (2.5322 => 2.5802, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9604 => 6.0644, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.64% (6.2884 => 0.8400, std.dev.: 0.0185) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.45% (1.5881 => 1.1681, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.58% (7.4801 => 6.2400, std.dev.: 0.0561) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.53% (7.5041 => 6.2640, std.dev.: 0.0409) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0072) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -2.93% (13.5243 => 13.1283, std.dev.: 0.0414) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -40.00% (0.0600 => 0.0360, std.dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6534 => 17.8851, std.dev.: 0.0423) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.25% (5.8884 => 5.5203, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0290) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7603 => 4.6763, std.dev.: 0.0213) MultiSource/Applications/JM/lencod/lencod: -1.64% (8.3085 => 8.1725, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -1.13% (11.6527 => 11.5207, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -1.10% (2.9122 => 2.8802, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 03:14:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 05:14:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418101403.0982E2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24697?compare_to=24691&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24697, Order: 206558, Start Time: 2014-04-18 05:38:29, End Time: 2014-04-18 10:20:35 To: 24691, Order: 206557, Start Time: 2014-04-18 04:19:19, End Time: 2014-04-18 08:59:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (109 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 23.53% (0.0680 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.09% (0.1760 => 0.1920, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.19% (0.6680 => 0.6960, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3480 => 0.3600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4800 => 0.4960, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.10% (1.1440 => 1.1680, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.30% (1.2321 => 1.2481, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.09% (0.1760 => 0.1920, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.93% (1.2441 => 1.2681, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 1.69% (5.9164 => 6.0164, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.28% (0.9361 => 0.9481, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0018) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0053) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 27.78% (0.0720 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.54% (0.6240 => 0.6960, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2160 => 0.2320, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0550) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.84% (1.5200 => 1.6240, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0459) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (10.4082 => 10.8122, std.dev.: 0.0317) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0542) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0209) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0492) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0350) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (7.8562 => 8.0922, std.dev.: 0.0301) MultiSource/Applications/sqlite3/sqlite3: 2.85% (23.7574 => 24.4335, std.dev.: 0.0425) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0556) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.49% (48.1088 => 49.3049, std.dev.: 0.0913) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0415) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.61% (37.0925 => 37.6886, std.dev.: 0.0724) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0119) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0514) MultiSource/Applications/ClamAV/clamscan: 1.22% (17.4082 => 17.6202, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (15.2282 => 15.4002, std.dev.: 0.0302) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0202) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (25.8896 => 26.9457, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 2.70% (21.1533 => 21.7254, std.dev.: 0.0623) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.4080 => 0.3720, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 03:47:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 05:47:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418104739.3491F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24698?compare_to=24697&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24698, Order: 206559, Start Time: 2014-04-18 06:14:35, End Time: 2014-04-18 10:54:11 To: 24697, Order: 206558, Start Time: 2014-04-18 05:38:29, End Time: 2014-04-18 10:20:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (102 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 36.36% (0.0440 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (0.2160 => 0.2280, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.46% (0.4480 => 0.4680, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 1.71% (4.6760 => 4.7560, std.dev.: 0.0226) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/obsequi/Obsequi: 2.54% (2.0441 => 2.0961, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.20% (1.6240 => 1.5720, std.dev.: 0.0185) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.77% (1.2361 => 1.3321, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.59% (10.6960 => 11.5080, std.dev.: 0.0415) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.58% (6.0160 => 6.4720, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.07% (1.2521 => 1.3281, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 5.22% (4.5200 => 4.7560, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0316) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0525) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (1.5200 => 1.5720, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0405) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (10.4082 => 10.7202, std.dev.: 0.0447) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0344) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0306) MultiSource/Applications/sqlite3/sqlite3: 2.46% (23.7574 => 24.3415, std.dev.: 0.0510) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0338) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.08% (48.1088 => 49.1090, std.dev.: 0.1243) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0567) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 1.35% (37.0925 => 37.5925, std.dev.: 0.1089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0159) MultiSource/Applications/SPASS/SPASS: 1.03% (17.5484 => 17.7284, std.dev.: 0.0471) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (25.8896 => 26.9417, std.dev.: 0.0302) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (1.3481 => 1.4001, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0105) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 2.38% (21.1533 => 21.6574, std.dev.: 0.1291) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 1.86% (6.6564 => 6.7804, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0050) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0472) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/mason/mason: -15.79% (0.0760 => 0.0640, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 04:42:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 06:42:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418114253.8CB412A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24699?compare_to=24698&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24699, Order: 206561, Start Time: 2014-04-18 07:07:53, End Time: 2014-04-18 11:49:22 To: 24698, Order: 206559, Start Time: 2014-04-18 06:14:35, End Time: 2014-04-18 10:54:11 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (107 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/FloatPrecision: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/fixups: 200.00% (0.0080 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.74% (0.0920 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.74% (0.0920 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.29% (0.2240 => 0.2560, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: 6.38% (0.1880 => 0.2000, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.28% (1.2481 => 1.2641, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 2.19% (0.7320 => 0.7480, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/pi: -1.62% (0.7400 => 0.7280, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.55% (1.2721 => 1.3681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (10.6960 => 11.4960, std.dev.: 0.0589) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0545) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.53% (1.7360 => 1.8320, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0557) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0283) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.9200 => 5.1280, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0404) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0609) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0390) MultiSource/Applications/sqlite3/sqlite3: 2.64% (23.7574 => 24.3855, std.dev.: 0.0709) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0366) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2329, std.dev.: 0.0921) MultiSource/Applications/kimwitu++/kc: 2.11% (18.8170 => 19.2131, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.5480 => 1.5800, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0124) MultiSource/Benchmarks/Bullet/bullet: 1.61% (37.0925 => 37.6886, std.dev.: 0.0625) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0166) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (25.8896 => 26.9577, std.dev.: 0.0276) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0104) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 2.61% (21.1533 => 21.7054, std.dev.: 0.1982) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.86% (6.6564 => 6.7804, std.dev.: 0.0310) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0448) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -21.05% (0.0760 => 0.0600, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.89% (1.2601 => 1.1481, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (2.3881 => 2.2521, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 05:44:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 07:44:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418124448.AA6812A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24700?compare_to=24699&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24700, Order: 206562, Start Time: 2014-04-18 08:07:11, End Time: 2014-04-18 12:51:23 To: 24699, Order: 206561, Start Time: 2014-04-18 07:07:53, End Time: 2014-04-18 11:49:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (108 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/function_try_block: 100.00% (0.0160 => 0.0320, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 57.14% (0.0280 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.2520 => 0.2720, std.dev.: 0.0067) SingleSource/Benchmarks/Linpack/linpack-pc: 3.75% (0.3200 => 0.3320, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.65% (0.9041 => 0.9281, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.45% (1.3761 => 1.3961, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 15.54% (1.0041 => 1.1601, std.dev.: 0.0484) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.99% (3.3682 => 3.5362, std.dev.: 0.0507) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -21.43% (0.0560 => 0.0440, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.33% (0.3000 => 0.3280, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (10.6960 => 11.3560, std.dev.: 0.0778) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (8.1441 => 8.5641, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0068) SingleSource/Benchmarks/Linpack/linpack-pc: 5.06% (0.3160 => 0.3320, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0480) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0235) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0386) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 2.54% (23.7574 => 24.3615, std.dev.: 0.0637) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0369) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0358) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0245) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.94% (48.1088 => 49.0409, std.dev.: 0.1169) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0154) MultiSource/Applications/kimwitu++/kc: 1.79% (18.8170 => 19.1531, std.dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.55% (2.8322 => 2.8762, std.dev.: 0.0119) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0127) MultiSource/Benchmarks/Bullet/bullet: 1.35% (37.0925 => 37.5925, std.dev.: 0.0759) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0087) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.62% (3.3802 => 3.5362, std.dev.: 0.0507) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (25.8896 => 26.9577, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (1.3481 => 1.3921, std.dev.: 0.0095) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 2.46% (21.1533 => 21.6734, std.dev.: 0.1052) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0022) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0429) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: -2.05% (2.3361 => 2.2881, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 06:35:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 08:35:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418133551.8FFA62A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24701?compare_to=24700&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24701, Order: 206565, Start Time: 2014-04-18 09:02:38, End Time: 2014-04-18 13:42:25 To: 24700, Order: 206562, Start Time: 2014-04-18 08:07:11, End Time: 2014-04-18 12:51:23 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (113 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (978 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-02-DependentPHI: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/PR10189: 200.00% (0.0080 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0880 => 0.1040, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.00% (0.1000 => 0.1160, std.dev.: 0.0057) MultiSource/Applications/aha/aha: 14.81% (0.1080 => 0.1240, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: 5.66% (0.2120 => 0.2240, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.49% (1.3401 => 1.3601, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 1.22% (1.3161 => 1.3321, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0048) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.6840 => 0.7400, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0611) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0419) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0130) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0344) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0515) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0345) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0573) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0182) MultiSource/Applications/sqlite3/sqlite3: 2.86% (23.7574 => 24.4375, std.dev.: 0.0453) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0245) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0068) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.33% (48.1088 => 49.2290, std.dev.: 0.0666) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0100) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1130, std.dev.: 0.0608) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 1.37% (37.0925 => 37.6006, std.dev.: 0.1065) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0480) MultiSource/Applications/ClamAV/clamscan: 1.15% (17.4082 => 17.6082, std.dev.: 0.0571) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 4.14% (25.8896 => 26.9617, std.dev.: 0.0327) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (1.3481 => 1.3921, std.dev.: 0.0063) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 2.67% (21.1533 => 21.7174, std.dev.: 0.2147) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0215) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0643 => 4.1123, std.dev.: 0.0185) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0404) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -26.32% (0.0760 => 0.0560, std.dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0044) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: -1.17% (2.3841 => 2.3561, std.dev.: 0.0109) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 06:54:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 08:54:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140418135432.163732A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24702?compare_to=24692&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24702, Order: 206566, Start Time: 2014-04-18 09:17:58, End Time: 2014-04-18 14:01:07 To: 24692, Order: 206557, Start Time: 2014-04-18 04:31:29, End Time: 2014-04-18 09:14:25 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (159 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (923 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.34% (0.1160 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.8240 => 1.8720, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.19% (1.6761 => 1.6961, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.08% (1.8561 => 1.8761, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 5.86% (0.9561 => 1.0121, std.dev.: 0.0116) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0063) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0098) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0086) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0069) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/fldry: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.52% (0.1080 => 0.1280, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0098) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.56% (0.2360 => 0.2680, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.6600 => 0.7480, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0239) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.05% (0.3320 => 0.3720, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.49% (0.3480 => 0.3880, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.57% (1.8161 => 2.0081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.72% (1.4401 => 1.5801, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 9.09% (0.4840 => 0.5280, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0145) MultiSource/Applications/obsequi/Obsequi: 8.78% (1.8680 => 2.0320, std.dev.: 0.0232) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.59% (1.7400 => 1.8720, std.dev.: 0.0104) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.34% (1.5801 => 1.6961, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.70% (11.6440 => 12.4240, std.dev.: 0.0492) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (6.4680 => 6.9000, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.53% (0.7960 => 0.8480, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: 6.37% (1.5080 => 1.6040, std.dev.: 0.0214) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0168) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.99% (9.4842 => 10.0522, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.97% (1.5401 => 1.6321, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.85% (5.8121 => 6.1521, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.85% (1.4361 => 1.5201, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (6.5440 => 6.8880, std.dev.: 0.0392) MultiSource/Benchmarks/MallocBench/gs/gs: 5.22% (5.3600 => 5.6400, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.92% (6.5080 => 6.8280, std.dev.: 0.0421) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.5600 => 1.6360, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.82% (1.6601 => 1.7401, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0161) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.0443 => 10.4963, std.dev.: 0.0427) MultiSource/Applications/JM/lencod/lencod: 4.45% (21.9606 => 22.9368, std.dev.: 0.0505) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (2.0440 => 2.1320, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0132) MultiSource/Applications/treecc/treecc: 4.02% (2.5840 => 2.6880, std.dev.: 0.0220) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.02% (50.0290 => 52.0410, std.dev.: 0.0932) MultiSource/Applications/lua/lua: 3.84% (4.7880 => 4.9720, std.dev.: 0.0349) MultiSource/Applications/oggenc/oggenc: 3.84% (6.9844 => 7.2525, std.dev.: 0.0136) MultiSource/Applications/SPASS/SPASS: 3.71% (18.4404 => 19.1246, std.dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 3.26% (19.0444 => 19.6644, std.dev.: 0.0612) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0173) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0134) MultiSource/Applications/kimwitu++/kc: 2.82% (19.6891 => 20.2451, std.dev.: 0.0383) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (16.3483 => 16.8083, std.dev.: 0.0653) MultiSource/Benchmarks/Bullet/bullet: 2.32% (38.4046 => 39.2966, std.dev.: 0.0882) MultiSource/Applications/hbd/hbd: 2.30% (1.7360 => 1.7760, std.dev.: 0.0147) MultiSource/Applications/d/make_dparser: 2.22% (3.9681 => 4.0561, std.dev.: 0.0243) MultiSource/Applications/sqlite3/sqlite3: 1.51% (25.6856 => 26.0736, std.dev.: 0.0305) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.44% (6.1044 => 6.1924, std.dev.: 0.0154) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (13.0563 => 13.2203, std.dev.: 0.0398) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.96% (2.1401 => 2.4602, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0203) MultiSource/Applications/sqlite3/sqlite3: 2.81% (3.9842 => 4.0963, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (4.1003 => 4.2043, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0294) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 2.02% (21.7374 => 22.1774, std.dev.: 0.1138) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.57% (2.9442 => 0.8960, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.18% (91.8497 => 49.4351, std.dev.: 10.3109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.34% (26.0616 => 17.1131, std.dev.: 0.1301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.33% (50.3031 => 33.0341, std.dev.: 0.1595) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.13% (42.1466 => 28.6058, std.dev.: 0.7178) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.68% (3.1122 => 2.3441, std.dev.: 0.1142) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -3.78% (2.7522 => 2.6482, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.83% (4.8083 => 4.6723, std.dev.: 0.0473) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.81% (4.1243 => 4.0083, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3561 => 2.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.79% (2.4602 => 2.4162, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0164) MultiSource/Benchmarks/mafft/pairlocalalign: -1.08% (26.6977 => 26.4096, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.01% (1.9761 => 1.9561, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 07:24:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 09:24:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140418142446.38FFE2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24703?compare_to=24694&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24703, Order: 206575, Start Time: 2014-04-18 09:48:15, End Time: 2014-04-18 14:31:20 To: 24694, Order: 206557, Start Time: 2014-04-18 05:01:33, End Time: 2014-04-18 09:44:14 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (148 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/lists: 21.05% (0.0760 => 0.0920, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.87% (0.1840 => 0.2040, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.07% (1.0800 => 1.1240, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.59% (0.4640 => 0.4760, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.06% (1.3561 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.78% (1.3481 => 1.3721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.49% (1.6081 => 1.6321, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/McGill/misr: -19.05% (0.0840 => 0.0680, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -16.67% (0.0960 => 0.0800, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0070) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0090) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0094) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0107) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0097) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0065) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0038) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0275) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 27.27% (0.0880 => 0.1120, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 19.50% (1.2921 => 1.5441, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.39% (1.1761 => 1.4041, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.75% (0.0640 => 0.0760, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.60% (0.1720 => 0.2040, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0142) MultiSource/Applications/JM/ldecod/ldecod: 18.56% (8.5802 => 10.1723, std.dev.: 0.0297) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.89% (1.2521 => 1.4761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.96% (1.3681 => 1.6001, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 15.29% (19.5406 => 22.5287, std.dev.: 0.0601) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.09% (5.3360 => 6.0881, std.dev.: 0.0345) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 13.02% (1.3521 => 1.5281, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0232) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 9.03% (11.3843 => 12.4123, std.dev.: 0.0287) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.94% (5.7280 => 6.2400, std.dev.: 0.0275) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.6680 => 6.1480, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (11.4440 => 12.4040, std.dev.: 0.0402) MultiSource/Applications/oggenc/oggenc: 8.27% (6.2844 => 6.8044, std.dev.: 0.0193) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.65% (0.6800 => 0.7320, std.dev.: 0.0194) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (9.5802 => 10.2322, std.dev.: 0.0434) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 4.61% (4.7720 => 4.9920, std.dev.: 0.0249) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (5.3840 => 5.6160, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (6.8280 => 7.0960, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.4120 => 0.4280, std.dev.: 0.0054) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.39% (49.1529 => 50.8209, std.dev.: 0.1040) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (1.5280 => 1.5720, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (2.7282 => 2.8002, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 2.60% (19.2243 => 19.7244, std.dev.: 0.0647) MultiSource/Applications/sqlite3/sqlite3: 2.39% (24.7575 => 25.3495, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 1.66% (19.7491 => 20.0771, std.dev.: 0.0692) MultiSource/Benchmarks/Bullet/bullet: 1.21% (39.0726 => 39.5446, std.dev.: 0.0480) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.53% (3.9842 => 4.2843, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 => 0.3200, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 3.55% (4.0563 => 4.2003, std.dev.: 0.0193) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0521) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (4.2403 => 4.3123, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.30% (25.4536 => 25.7856, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.78% (11.0207 => 2.0081, std.dev.: 0.0102) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.27% (21.6534 => 17.9131, std.dev.: 0.0493) SingleSource/Benchmarks/Linpack/linpack-pc: -16.34% (7.8605 => 6.5764, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0012) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.1018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.69% (2.9242 => 2.8162, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0201) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 07:26:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 09:26:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140418142604.D36972A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24704?compare_to=24693&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24704, Order: 206575, Start Time: 2014-04-18 09:46:46, End Time: 2014-04-18 14:32:41 To: 24693, Order: 206557, Start Time: 2014-04-18 04:57:01, End Time: 2014-04-18 09:42:38 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 12 (134 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/UnitTests/AtomicOps: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Regression/C/casts: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 36.36% (0.0440 => 0.0600, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 33.33% (0.0600 => 0.0800, std.dev.: 0.0076) MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.76% (0.2040 => 0.2280, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 11.54% (0.1040 => 0.1160, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.6480 => 0.6640, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.73% (2.0841 => 2.1201, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.11% (0.2960 => 0.2720, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.36% (17.6723 => 19.6803, std.dev.: 0.0683) MultiSource/Applications/sqlite3/sqlite3: 1422.83% (1.7001 => 25.8896, std.dev.: 0.0588) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.57% (50.1010 => 51.8890, std.dev.: 0.0861) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (1.0520 => 1.1080, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.08% (11.3920 => 12.3120, std.dev.: 0.0813) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0097) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1083, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0134) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0042) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/ffbench: 19.23% (0.1040 => 0.1240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.97% (1.8281 => 2.1201, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.47% (1.8361 => 2.1201, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.01% (1.8921 => 2.1761, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0151) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.4160 => 0.4760, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.93% (1.9521 => 2.2241, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.45% (2.1121 => 2.3961, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.06% (1.8081 => 2.0081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2280 => 0.2520, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0162) MultiSource/Applications/obsequi/Obsequi: 10.02% (1.8760 => 2.0640, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (1.0880 => 1.1760, std.dev.: 0.0340) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.93% (2.9721 => 3.1482, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 5.51% (1.0160 => 1.0720, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.7280 => 0.7680, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.37% (6.4800 => 6.8280, std.dev.: 0.0484) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.17% (0.2320 => 0.2440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (5.8281 => 6.1081, std.dev.: 0.0359) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (9.6042 => 10.0642, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0148) MultiSource/Applications/Burg/burg: 4.19% (1.5280 => 1.5920, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5320 => 6.8040, std.dev.: 0.0419) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (1.8440 => 1.9200, std.dev.: 0.0208) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0158) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (10.2283 => 10.6284, std.dev.: 0.0381) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 3.63% (5.3960 => 5.5920, std.dev.: 0.0400) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (1.6641 => 1.7201, std.dev.: 0.0138) MultiSource/Applications/lua/lua: 3.09% (4.7920 => 4.9400, std.dev.: 0.0311) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0590) MultiSource/Applications/SPASS/SPASS: 2.85% (18.5284 => 19.0564, std.dev.: 0.0298) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1600 => 2.2200, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (16.3003 => 16.7243, std.dev.: 0.0523) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (2.3401 => 2.4002, std.dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 2.25% (22.2206 => 22.7207, std.dev.: 0.0558) MultiSource/Applications/oggenc/oggenc: 2.21% (7.0524 => 7.2085, std.dev.: 0.0225) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.5040 => 1.5360, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0119) MultiSource/Benchmarks/Bullet/bullet: 2.01% (38.6366 => 39.4126, std.dev.: 0.0579) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0293) MultiSource/Applications/siod/siod: 1.89% (2.7522 => 2.8042, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 1.82% (19.8291 => 20.1891, std.dev.: 0.0344) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.85% (2.1201 => 2.4562, std.dev.: 0.0497) MultiSource/Applications/siod/siod: 11.03% (2.8642 => 3.1802, std.dev.: 0.0161) MultiSource/Benchmarks/llubenchmark/llu: 5.30% (5.0603 => 5.3283, std.dev.: 0.0984) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.3725 => 7.6765, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 2.91% (6.5964 => 6.7884, std.dev.: 0.0419) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (4.0003 => 4.0803, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1285 => 8.2165, std.dev.: 0.0226) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.26% (94.8339 => 49.0711, std.dev.: 10.0797) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.02% (49.9431 => 32.9541, std.dev.: 0.2922) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.84% (25.7136 => 17.0131, std.dev.: 0.1381) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.83% (37.0863 => 28.6178, std.dev.: 0.5345) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.61% (7.8165 => 6.7524, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.16% (0.1960 => 0.1800, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0065) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0409) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0255) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0086) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.47% (2.4522 => 2.4162, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.00% (1.5921 => 1.5761, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 07:37:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 09:37:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140418143732.27F322A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24705?compare_to=24695&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24705, Order: 206576, Start Time: 2014-04-18 09:57:29, End Time: 2014-04-18 14:44:06 To: 24695, Order: 206557, Start Time: 2014-04-18 05:06:21, End Time: 2014-04-18 09:52:49 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1102 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-LocalTypeTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2009-12-07-StructReturn: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 40.00% (0.0400 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.00% (0.1200 => 0.1320, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.89% (0.1520 => 0.1640, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.92% (0.2440 => 0.2560, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.29% (1.8641 => 1.8881, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -7.32% (0.1640 => 0.1520, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0149) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 07:59:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 09:59:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418145911.436512A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24706?compare_to=24701&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24706, Order: 206577, Start Time: 2014-04-18 10:24:37, End Time: 2014-04-18 15:05:45 To: 24701, Order: 206565, Start Time: 2014-04-18 09:02:38, End Time: 2014-04-18 13:42:25 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 4 (96 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1108 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-26-Shorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.27% (0.6560 => 0.6840, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.45% (0.5800 => 0.6000, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0056) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 29.17% (0.0960 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.55% (1.2721 => 1.3681, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0718) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.2161 => 1.2961, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (6.0160 => 6.3600, std.dev.: 0.0407) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0429) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0190) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0389) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0461) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0370) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0382) MultiSource/Benchmarks/mafft/pairlocalalign: 2.77% (10.4082 => 10.6962, std.dev.: 0.0514) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0327) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2369, std.dev.: 0.0881) MultiSource/Applications/sqlite3/sqlite3: 2.32% (23.7574 => 24.3095, std.dev.: 0.0764) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0359) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1290, std.dev.: 0.0535) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 1.52% (37.0925 => 37.6565, std.dev.: 0.0910) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 13.05% (2.8802 => 3.2562, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.97% (25.8896 => 26.9177, std.dev.: 0.0220) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0224) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 2.70% (21.1533 => 21.7254, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.9443 => 5.0003, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.64% (10.8967 => 2.0001, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/pi: -50.00% (0.0240 => 0.0120, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.94% (2.6762 => 2.6242, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3361 => 2.3001, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 08:04:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 10:04:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140418150422.5E0702A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24707?compare_to=24696&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24707, Order: 206577, Start Time: 2014-04-18 10:22:13, End Time: 2014-04-18 15:10:59 To: 24696, Order: 206557, Start Time: 2014-04-18 05:29:51, End Time: 2014-04-18 10:18:12 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (116 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1108 (962 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 14.29% (0.0840 => 0.0960, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 3.25% (0.4920 => 0.5080, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.00% (0.0800 => 0.0920, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 296.51% (0.4560 => 1.8081, std.dev.: 0.0111) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0050) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.08% (1.7081 => 2.0681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.71% (1.6801 => 2.0281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.36% (1.7481 => 2.1041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.02% (1.7241 => 2.0521, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.85% (1.8881 => 2.2441, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0085) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0189) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0232) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0215) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (11.7880 => 12.4840, std.dev.: 0.0591) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2280 => 0.2400, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.24% (0.9920 => 1.0440, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/football/football: 5.09% (1.1000 => 1.1560, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (1.2400 => 1.3000, std.dev.: 0.0189) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0372) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0173) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.09% (9.9842 => 10.3922, std.dev.: 0.0544) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0206) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.86% (1.3480 => 1.4000, std.dev.: 0.0173) MultiSource/Applications/d/make_dparser: 3.83% (3.9641 => 4.1161, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (6.8321 => 7.0921, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0203) MultiSource/Applications/JM/ldecod/ldecod: 3.60% (10.3203 => 10.6923, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (0.3400 => 0.3520, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 3.41% (6.9124 => 7.1484, std.dev.: 0.0190) MultiSource/Applications/SPASS/SPASS: 3.27% (18.4924 => 19.0966, std.dev.: 0.0399) MultiSource/Benchmarks/Olden/bh/bh: 3.25% (0.4920 => 0.5080, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.91% (51.1089 => 52.5969, std.dev.: 0.0988) MultiSource/Applications/kimwitu++/kc: 2.82% (19.7371 => 20.2931, std.dev.: 0.0405) MultiSource/Applications/JM/lencod/lencod: 2.55% (22.6287 => 23.2048, std.dev.: 0.0643) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 2.09% (20.2445 => 20.6685, std.dev.: 0.0648) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (16.5963 => 16.9083, std.dev.: 0.0624) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 1.78% (38.9366 => 39.6286, std.dev.: 0.0997) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 1.41% (25.1895 => 25.5455, std.dev.: 0.0578) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 17.67% (0.9281 => 1.0921, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.00% (0.0800 => 0.0920, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.25% (1.2681 => 1.4361, std.dev.: 0.0534) MultiSource/Applications/siod/siod: 12.45% (2.8282 => 3.1802, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 3.85% (2.1841 => 2.2681, std.dev.: 0.0273) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0512) MultiSource/Applications/sqlite3/sqlite3: 3.03% (4.0923 => 4.2163, std.dev.: 0.0234) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 2.86% (21.6534 => 22.2734, std.dev.: 0.1920) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.20% (5.0963 => 5.2083, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (2.5322 => 2.5802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9604 => 6.0644, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0184) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (4.2443 => 4.3083, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0203 => 4.0723, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0140) SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0146) SingleSource/Regression/C++/EH/dead_try_block: -80.00% (0.0200 => 0.0040, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/nestedloop: -60.32% (2.9642 => 1.1761, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.70% (1.5881 => 1.1641, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0074) MultiSource/Applications/obsequi/Obsequi: -21.76% (2.6481 => 2.0720, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.17% (7.4801 => 6.1960, std.dev.: 0.0483) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.67% (7.5041 => 6.3280, std.dev.: 0.0338) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: -3.05% (13.5243 => 13.1123, std.dev.: 0.0303) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -40.00% (0.0600 => 0.0360, std.dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.35% (21.6534 => 17.8971, std.dev.: 0.0338) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0173) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -1.54% (8.3085 => 8.1805, std.dev.: 0.0372) MultiSource/Applications/aha/aha: -1.24% (2.9122 => 2.8762, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.22% (2.6202 => 2.5882, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -1.13% (11.6527 => 11.5207, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 08:35:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 10:35:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418153556.914242A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24708?compare_to=24706&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24708, Order: 206580, Start Time: 2014-04-18 11:03:08, End Time: 2014-04-18 15:42:30 To: 24706, Order: 206577, Start Time: 2014-04-18 10:24:37, End Time: 2014-04-18 15:05:45 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (98 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/UnitTests/2003-07-09-SignedArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 40.00% (0.0400 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 24.14% (0.1160 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: 21.43% (0.0560 => 0.0680, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 17.39% (0.1840 => 0.2160, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.81% (0.1080 => 0.1240, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.2880 => 0.3040, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.39% (0.7080 => 0.7320, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (0.2360 => 0.2480, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4121 => 1.4321, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.00% (0.6000 => 0.5880, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0056) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0091) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.10% (1.2401 => 1.3281, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0572) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.88% (1.2201 => 1.3041, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.67% (1.2601 => 1.3441, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (6.0160 => 6.3680, std.dev.: 0.0336) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0208) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0182) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 2.36% (17.6165 => 18.0325, std.dev.: 0.0463) MultiSource/Applications/sqlite3/sqlite3: 2.32% (23.7574 => 24.3095, std.dev.: 0.0380) MultiSource/Benchmarks/mafft/pairlocalalign: 2.31% (10.4082 => 10.6482, std.dev.: 0.0436) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0244) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.96% (48.1088 => 49.0529, std.dev.: 0.1009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0106) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 1.53% (18.8170 => 19.1050, std.dev.: 0.0497) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 1.39% (37.0925 => 37.6086, std.dev.: 0.0635) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.5040 => 0.5360, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (25.8896 => 26.9497, std.dev.: 0.0256) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0096) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 2.67% (21.1533 => 21.7174, std.dev.: 0.1025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0119) MultiSource/Applications/lemon/lemon: -1.73% (1.3841 => 1.3601, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0069) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 09:46:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 11:46:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418164631.B44BB2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24709?compare_to=24708&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24709, Order: 206583, Start Time: 2014-04-18 12:11:30, End Time: 2014-04-18 16:53:05 To: 24708, Order: 206580, Start Time: 2014-04-18 11:03:08, End Time: 2014-04-18 15:42:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (101 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 3.74% (0.4280 => 0.4440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.15% (1.3041 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (1.3241 => 1.3441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.51% (1.3281 => 1.3481, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.78% (0.3600 => 0.3880, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/power/power: 1.21% (1.3241 => 1.3401, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: -44.44% (0.0360 => 0.0200, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0069) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0169) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.91% (1.2161 => 1.3001, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: 6.85% (0.2920 => 0.3120, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0367) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0180) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0138) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0118) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0288) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0348) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0470) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0231) MultiSource/Applications/JM/lencod/lencod: 2.29% (17.6165 => 18.0205, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0492) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.96% (48.1088 => 49.0529, std.dev.: 0.1107) MultiSource/Benchmarks/Bullet/bullet: 1.62% (37.0925 => 37.6926, std.dev.: 0.0578) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1210, std.dev.: 0.0391) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (7.8562 => 7.9762, std.dev.: 0.0367) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 13.47% (2.8802 => 3.2682, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (25.8896 => 26.9417, std.dev.: 0.0260) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (1.3481 => 1.4001, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0083) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 2.61% (21.1533 => 21.7054, std.dev.: 0.1515) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.79% (10.8967 => 1.9841, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (2.3881 => 2.2521, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 10:50:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 12:50:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418175043.F2C3B2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24710?compare_to=24709&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24710, Order: 206585, Start Time: 2014-04-18 13:13:24, End Time: 2014-04-18 17:57:16 To: 24709, Order: 206583, Start Time: 2014-04-18 12:11:30, End Time: 2014-04-18 16:53:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 21 (111 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/2003-08-11-VaListArg: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.38% (0.1040 => 0.1200, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.38% (0.1040 => 0.1200, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.11% (0.1480 => 0.1600, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 5.97% (0.2680 => 0.2840, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.08% (1.3001 => 1.3401, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.65% (0.9041 => 0.9281, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.35% (1.3601 => 1.3921, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.81% (1.3241 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.55% (1.2881 => 1.3081, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.8682 => 2.9082, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.28% (1.2521 => 1.2681, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 1.17% (5.8244 => 5.8924, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.98% (3.4922 => 3.5962, std.dev.: 0.0359) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0165) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.18% (0.6240 => 0.7000, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (10.6960 => 11.3680, std.dev.: 0.0776) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0073) MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.06% (1.1880 => 1.2600, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0405) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0377) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (4.9200 => 5.1120, std.dev.: 0.0392) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (5.8400 => 6.0520, std.dev.: 0.0316) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0427) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0331) MultiSource/Applications/JM/lencod/lencod: 2.79% (17.6165 => 18.1085, std.dev.: 0.0707) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 2.54% (23.7574 => 24.3615, std.dev.: 0.0398) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0376) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.42% (48.1088 => 49.2730, std.dev.: 0.0853) MultiSource/Applications/kimwitu++/kc: 2.08% (18.8170 => 19.2091, std.dev.: 0.0378) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 1.50% (17.5484 => 17.8124, std.dev.: 0.0407) MultiSource/Benchmarks/Bullet/bullet: 1.39% (37.0925 => 37.6086, std.dev.: 0.0905) MultiSource/Applications/ClamAV/clamscan: 1.13% (17.4082 => 17.6042, std.dev.: 0.0567) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0092) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.38% (3.3802 => 3.5282, std.dev.: 0.0524) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (25.8896 => 26.9337, std.dev.: 0.0389) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (1.3481 => 1.3921, std.dev.: 0.0053) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 2.46% (21.1533 => 21.6734, std.dev.: 0.1828) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 1.56% (6.6564 => 6.7604, std.dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0059) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0379) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.68% (10.8967 => 1.9961, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 11:41:59 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 11:41:59 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140418184203.4E1814FA4A1E@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/733 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 206493 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpIr_9oFexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpIr_9oFexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpv3XJfWexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpv3XJfWexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Fri Apr 18 11:37:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 13:37:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418183759.785E12A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24711?compare_to=24710&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24711, Order: 206592, Start Time: 2014-04-18 14:04:46, End Time: 2014-04-18 18:44:33 To: 24710, Order: 206585, Start Time: 2014-04-18 13:13:24, End Time: 2014-04-18 17:57:16 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (115 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (976 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 200.00% (0.0080 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/2003-07-06-IntOverflow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/ccc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/bigstack: 57.14% (0.0280 => 0.0440, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.62% (0.1480 => 0.1800, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/distray/distray: 14.81% (0.1080 => 0.1240, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1360 => 0.1480, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.67% (0.2400 => 0.2560, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.82% (0.6640 => 0.6960, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 4.22% (0.9480 => 0.9880, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.33% (1.3761 => 1.4081, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.50% (1.3321 => 1.3521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.23% (1.3041 => 1.3201, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.46% (6.3004 => 6.3924, std.dev.: 0.0357) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.33% (3.9202 => 3.9722, std.dev.: 0.0185) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0012) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.50% (0.1600 => 0.1880, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0091) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.49% (1.1841 => 1.3201, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.69% (1.2721 => 1.4081, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0550) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0421) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.9200 => 0.9760, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (1.3800 => 1.4560, std.dev.: 0.0128) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0537) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C/football/football: 4.22% (0.9480 => 0.9880, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.9200 => 5.1040, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0466) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0263) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0547) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0103) MultiSource/Applications/treecc/treecc: 2.61% (2.4480 => 2.5120, std.dev.: 0.0147) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.51% (48.1088 => 49.3170, std.dev.: 0.1093) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0500) MultiSource/Applications/sqlite3/sqlite3: 2.32% (23.7574 => 24.3095, std.dev.: 0.0537) MultiSource/Applications/kimwitu++/kc: 2.17% (18.8170 => 19.2251, std.dev.: 0.0403) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 1.71% (37.0925 => 37.7286, std.dev.: 0.0648) MultiSource/Applications/SPASS/SPASS: 1.50% (17.5484 => 17.8124, std.dev.: 0.0454) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: 1.03% (17.4082 => 17.5882, std.dev.: 0.0513) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0111) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.97% (25.8896 => 26.9177, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0049) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 2.59% (21.1533 => 21.7014, std.dev.: 0.0683) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 2.00% (5.0123 => 5.1123, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/pi: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/mason/mason: -15.79% (0.0760 => 0.0640, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0197) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0070) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 11:59:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 13:59:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140418185931.438E52A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24712?compare_to=24702&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24712, Order: 206594, Start Time: 2014-04-18 14:23:22, End Time: 2014-04-18 19:06:05 To: 24702, Order: 206566, Start Time: 2014-04-18 09:17:58, End Time: 2014-04-18 14:01:07 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 20 (173 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (909 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/Vector/sumarray-dbl: 66.67% (0.0240 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.64% (1.1000 => 1.2280, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.42% (0.3800 => 0.4120, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.41% (0.2160 => 0.2320, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (0.2240 => 0.2400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.1480 => 1.2000, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary2: 4.00% (0.3000 => 0.3120, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.52% (0.6360 => 0.6520, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.11% (1.5201 => 1.5521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.96% (1.6321 => 1.6641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.57% (1.5281 => 1.5521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.32% (1.8161 => 1.8401, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.21% (1.6561 => 1.6761, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/strcat: -16.22% (0.1480 => 0.1240, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.29% (11.3687 => 3.0362, std.dev.: 0.0100) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0124) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0069) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0057) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 25.81% (0.1240 => 0.1560, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0053) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 20.00% (0.0800 => 0.0960, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.55% (0.6200 => 0.7040, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.19% (0.3640 => 0.4120, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.77% (0.1880 => 0.2120, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.45% (1.8161 => 2.0241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.38% (1.6521 => 1.8401, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.23% (1.4601 => 1.6241, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.05% (1.5521 => 1.7081, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.04% (1.1160 => 1.2280, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.92% (1.6121 => 1.7721, std.dev.: 0.0110) MultiSource/Applications/obsequi/Obsequi: 9.85% (1.8680 => 2.0520, std.dev.: 0.0176) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.69% (1.5281 => 1.6761, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.68% (1.7761 => 1.9481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.30% (1.4201 => 1.5521, std.dev.: 0.0085) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (1.0240 => 1.1120, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.7841 => 1.9361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.43% (0.3320 => 0.3600, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.19% (1.4161 => 1.5321, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.08% (1.4361 => 1.5521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.05% (1.5401 => 1.6641, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.95% (0.7040 => 0.7600, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.85% (1.5801 => 1.7041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.82% (1.4841 => 1.6001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.69% (1.4561 => 1.5681, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: 7.25% (0.2760 => 0.2960, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (0.2240 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0122) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.90% (1.7401 => 1.8601, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.87% (1.1640 => 1.2440, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.82% (1.5841 => 1.6921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.76% (0.2960 => 0.3160, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (6.4680 => 6.9040, std.dev.: 0.0335) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0174) MultiSource/Applications/hexxagon/hexxagon: 6.38% (1.1280 => 1.2000, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.8440 => 1.9600, std.dev.: 0.0115) SingleSource/Benchmarks/Linpack/linpack-pc: 6.17% (0.3240 => 0.3440, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.6440 => 12.3560, std.dev.: 0.0749) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.06% (5.8121 => 6.1641, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0120) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.73% (0.7680 => 0.8120, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.44% (9.4842 => 10.0002, std.dev.: 0.0494) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.16% (0.6200 => 0.6520, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (1.7921 => 1.8801, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.79% (1.4201 => 1.4881, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: 4.46% (21.9606 => 22.9408, std.dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0158) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.0443 => 10.4843, std.dev.: 0.0281) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0108) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.27% (1.3120 => 1.3680, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (6.5080 => 6.7760, std.dev.: 0.0385) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (6.5440 => 6.8080, std.dev.: 0.0501) MultiSource/Applications/lua/lua: 4.01% (4.7880 => 4.9800, std.dev.: 0.0303) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.85% (50.0290 => 51.9570, std.dev.: 0.1193) MultiSource/Applications/hbd/hbd: 3.69% (1.7360 => 1.8000, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 3.61% (6.9844 => 7.2365, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0125) MultiSource/Applications/SPASS/SPASS: 3.43% (18.4404 => 19.0725, std.dev.: 0.0298) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (5.3600 => 5.5360, std.dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0240) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: 2.94% (19.0444 => 19.6044, std.dev.: 0.0799) MultiSource/Applications/kimwitu++/kc: 2.86% (19.6891 => 20.2531, std.dev.: 0.0330) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0060) MultiSource/Applications/treecc/treecc: 2.63% (2.5840 => 2.6520, std.dev.: 0.0232) MultiSource/Benchmarks/Bullet/bullet: 2.57% (38.4046 => 39.3926, std.dev.: 0.0936) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.25% (16.3483 => 16.7163, std.dev.: 0.0609) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (6.1044 => 6.1804, std.dev.: 0.0251) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (13.0563 => 13.2083, std.dev.: 0.0337) MultiSource/Applications/sqlite3/sqlite3: 1.12% (25.6856 => 25.9736, std.dev.: 0.0358) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0272) SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.28% (2.1401 => 2.4242, std.dev.: 0.0577) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 11.05% (2.8602 => 3.1762, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.28% (1.5921 => 1.6761, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (4.1003 => 4.2043, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 2.46% (6.6684 => 6.8324, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0217) MultiSource/Applications/sqlite3/sqlite3: 2.11% (3.9842 => 4.0683, std.dev.: 0.0197) MultiSource/Applications/lua/lua: 1.82% (21.7374 => 22.1334, std.dev.: 0.1378) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1245 => 8.2125, std.dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.99% (10.6247 => 2.0201, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.43% (2.9442 => 0.9000, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.34% (91.8497 => 49.2871, std.dev.: 9.6510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.36% (50.3031 => 33.0181, std.dev.: 0.1606) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.21% (26.0616 => 17.1451, std.dev.: 0.0777) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.87% (42.1466 => 28.2938, std.dev.: 0.5332) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1122) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.06% (0.3400 => 0.3160, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -3.78% (2.7522 => 2.6482, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.81% (4.1243 => 4.0083, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0208) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0174) MultiSource/Benchmarks/sim/sim: -1.09% (4.7883 => 4.7363, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: -1.06% (26.6977 => 26.4137, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.01% (1.9761 => 1.9561, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 12:30:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 14:30:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140418193006.9BA5F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24713?compare_to=24703&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24713, Order: 206594, Start Time: 2014-04-18 14:53:29, End Time: 2014-04-18 19:36:43 To: 24703, Order: 206575, Start Time: 2014-04-18 09:48:15, End Time: 2014-04-18 14:31:20 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (166 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (925 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/pointer_method2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 18.18% (0.0880 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.12% (0.3400 => 0.3880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.36% (0.2240 => 0.2360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 4.27% (0.4680 => 0.4880, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.21% (0.7600 => 0.7920, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 3.33% (0.8400 => 0.8680, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.28% (1.4041 => 1.4361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.07% (1.5441 => 1.5761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.56% (1.5361 => 1.5601, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.35% (1.7760 => 1.8000, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.31% (0.9161 => 0.9281, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.43% (1.4001 => 1.4201, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2362.50% (0.0320 => 0.7880, std.dev.: 0.0124) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0082) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0084) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0090) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 192.06% (0.2520 => 0.7360, std.dev.: 0.0187) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0025) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0068) SingleSource/Regression/C/test_indvars: 100.00% (0.0320 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0069) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0047) SingleSource/Regression/C++/pointer_method2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.00% (0.7040 => 1.0560, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: 44.25% (1.3920 => 2.0080, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.13% (1.2401 => 1.5641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.00% (1.2481 => 1.5601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.71% (1.2161 => 1.4801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.54% (1.3001 => 1.5801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.33% (1.1441 => 1.3881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.16% (1.1721 => 1.4201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.78% (1.2321 => 1.4881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.77% (1.1361 => 1.3721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.66% (1.2001 => 1.4481, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.52% (1.2281 => 1.4801, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.80% (1.2321 => 1.4761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.25% (1.2881 => 1.5361, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.23% (0.1040 => 0.1240, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0130) MultiSource/Applications/JM/ldecod/ldecod: 19.07% (8.5802 => 10.2163, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.60% (0.1720 => 0.2040, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.18% (0.0880 => 0.1040, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.57% (1.2521 => 1.4721, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.53% (1.2321 => 1.4481, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 15.29% (19.5406 => 22.5287, std.dev.: 0.0756) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.92% (5.3360 => 6.1321, std.dev.: 0.0228) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.33% (1.7400 => 1.9720, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0036) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.08% (5.7280 => 6.2480, std.dev.: 0.0305) MultiSource/Benchmarks/mafft/pairlocalalign: 8.71% (11.3843 => 12.3763, std.dev.: 0.0618) MultiSource/Applications/oggenc/oggenc: 8.59% (6.2844 => 6.8244, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.54% (5.6680 => 6.1520, std.dev.: 0.0504) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.14% (11.4440 => 12.3760, std.dev.: 0.0410) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.78% (0.3600 => 0.3880, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.2200 => 0.2360, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.42% (0.8721 => 0.9281, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.05% (9.5802 => 10.1602, std.dev.: 0.0714) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.89% (0.7360 => 0.7720, std.dev.: 0.0139) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0262) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 4.11% (4.7720 => 4.9680, std.dev.: 0.0350) MultiSource/Benchmarks/MallocBench/gs/gs: 3.94% (5.3840 => 5.5960, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (6.8280 => 7.0760, std.dev.: 0.0469) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.58% (49.1529 => 50.9129, std.dev.: 0.1223) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.7680 => 0.7920, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 2.50% (24.7575 => 25.3775, std.dev.: 0.0485) MultiSource/Applications/ClamAV/clamscan: 2.41% (19.2243 => 19.6884, std.dev.: 0.0646) MultiSource/Applications/kimwitu++/kc: 2.27% (19.7491 => 20.1971, std.dev.: 0.0306) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0124 => 6.0924, std.dev.: 0.0218) MultiSource/Benchmarks/Bullet/bullet: 1.27% (39.0726 => 39.5686, std.dev.: 0.0671) MultiSource/Applications/SPASS/SPASS: 1.13% (18.7966 => 19.0086, std.dev.: 0.0510) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.95% (0.1720 => 0.1960, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.54% (3.9842 => 4.3243, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0217) MultiSource/Applications/minisat/minisat: 4.22% (6.8204 => 7.1084, std.dev.: 0.0448) MultiSource/Applications/sqlite3/sqlite3: 3.85% (4.0563 => 4.2123, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.43% (1.4001 => 1.4201, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (25.4536 => 25.7576, std.dev.: 0.0203) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.82% (11.0207 => 2.0041, std.dev.: 0.0106) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.51% (21.6534 => 17.8611, std.dev.: 0.0603) SingleSource/Benchmarks/Linpack/linpack-pc: -16.44% (7.8605 => 6.5684, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0953) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.0963 => 5.0283, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 12:33:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 14:33:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140418193326.B9FAD2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24714?compare_to=24704&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24714, Order: 206594, Start Time: 2014-04-18 14:54:31, End Time: 2014-04-18 19:40:02 To: 24704, Order: 206575, Start Time: 2014-04-18 09:46:46, End Time: 2014-04-18 14:32:41 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 22 (156 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (919 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2005-11-29-LongSwitch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/UnitTests/Vector/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 27.27% (0.0880 => 0.1120, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2440 => 0.2560, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 4.82% (0.3320 => 0.3480, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (1.1080 => 1.1400, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.97% (1.0161 => 1.0361, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.8480 => 0.8640, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.78% (2.0241 => 2.0601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.54% (2.0841 => 2.1161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.45% (2.2001 => 2.2321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.35% (2.0801 => 2.1081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.26% (2.2241 => 2.2521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.21% (2.3161 => 2.3441, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (6.1244 => 6.1964, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.15% (2.0841 => 2.1081, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.61% (1.2241 => 1.2561, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -30.00% (0.0800 => 0.0560, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.29% (17.6723 => 19.6683, std.dev.: 0.0790) MultiSource/Applications/sqlite3/sqlite3: 1424.48% (1.7001 => 25.9176, std.dev.: 0.0547) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.70% (50.1010 => 51.9530, std.dev.: 0.1069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (1.0520 => 1.1080, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.71% (11.3920 => 12.3840, std.dev.: 0.0706) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0086) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1283, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0154) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0082) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0052) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/UnitTests/Vector/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: 45.45% (0.0440 => 0.0640, std.dev.: 0.0053) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0060) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.63% (1.8281 => 2.1321, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 16.59% (1.8561 => 2.1641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.59% (1.8081 => 2.1081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 16.26% (1.8201 => 2.1161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.91% (1.8601 => 2.1561, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.87% (1.9161 => 2.2201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.86% (1.8921 => 2.1921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.82% (1.9721 => 2.2841, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.79% (0.3040 => 0.3520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.58% (2.0281 => 2.3441, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.37% (1.9521 => 2.2521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.35% (1.8761 => 2.1641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.85% (1.9121 => 2.1961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.02% (2.1121 => 2.4082, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.32% (1.7721 => 2.0081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.25% (2.1441 => 2.4282, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 13.19% (1.8201 => 2.0601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.95% (1.9761 => 2.2321, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.83% (1.8081 => 2.0401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.63% (1.9001 => 2.1401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.58% (1.8441 => 2.0761, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 12.36% (2.1041 => 2.3641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 12.13% (1.8801 => 2.1081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.13% (1.8801 => 2.1081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.08% (1.9201 => 2.1521, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.00% (0.1000 => 0.1120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.89% (2.0521 => 2.2961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.80% (2.0681 => 2.3121, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (1.8361 => 2.0521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.70% (1.9481 => 2.1761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.40% (1.8601 => 2.0721, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 11.11% (0.1440 => 0.1600, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0208) MultiSource/Applications/obsequi/Obsequi: 10.02% (1.8760 => 2.0640, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.20% (0.3480 => 0.3800, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.64% (0.3240 => 0.3520, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.95% (0.7040 => 0.7600, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (6.4800 => 6.8640, std.dev.: 0.0359) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0132) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0172) MultiSource/Applications/Burg/burg: 5.76% (1.5280 => 1.6160, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 5.64% (1.7721 => 1.8721, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.9960 => 1.0520, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C/football/football: 5.17% (1.0840 => 1.1400, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (0.4760 => 0.5000, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.03% (1.7480 => 1.8360, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.78% (6.5320 => 6.8440, std.dev.: 0.0486) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (5.8281 => 6.1041, std.dev.: 0.0286) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (9.6042 => 10.0482, std.dev.: 0.0438) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.8280 => 0.8640, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (10.2283 => 10.6644, std.dev.: 0.0321) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 3.94% (1.7280 => 1.7960, std.dev.: 0.0224) MultiSource/Applications/lua/lua: 3.92% (4.7920 => 4.9800, std.dev.: 0.0263) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.72% (1.5040 => 1.5600, std.dev.: 0.0110) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.65% (1.3160 => 1.3640, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.58% (1.5640 => 1.6200, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (2.1240 => 2.2000, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (2.1600 => 2.2320, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (5.3960 => 5.5720, std.dev.: 0.0490) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (16.3003 => 16.7803, std.dev.: 0.0532) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (6.5360 => 6.7240, std.dev.: 0.0546) MultiSource/Applications/SPASS/SPASS: 2.68% (18.5284 => 19.0246, std.dev.: 0.0696) MultiSource/Applications/oggenc/oggenc: 2.67% (7.0524 => 7.2405, std.dev.: 0.0208) MultiSource/Applications/treecc/treecc: 2.63% (2.5880 => 2.6560, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: 2.54% (22.2206 => 22.7847, std.dev.: 0.0607) MultiSource/Benchmarks/Bullet/bullet: 2.33% (38.6366 => 39.5366, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0141) MultiSource/Applications/siod/siod: 2.03% (2.7522 => 2.8082, std.dev.: 0.0176) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0210) MultiSource/Applications/kimwitu++/kc: 1.88% (19.8291 => 20.2011, std.dev.: 0.0414) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (13.0363 => 13.2003, std.dev.: 0.0377) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.17% (1.0241 => 1.0361, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7842 => 2.8122, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 20.78% (0.9241 => 1.1161, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.97% (2.1201 => 2.4162, std.dev.: 0.0591) MultiSource/Applications/siod/siod: 11.17% (2.8642 => 3.1842, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 3.42% (7.3725 => 7.6245, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0370) MultiSource/Benchmarks/Olden/tsp/tsp: 2.17% (1.2881 => 1.3161, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (4.0003 => 4.0803, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9684 => 6.0684, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 1.13% (8.1285 => 8.2205, std.dev.: 0.0331) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.69% (10.4007 => 2.0081, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.92% (94.8339 => 49.3911, std.dev.: 8.7780) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.86% (49.9431 => 33.0341, std.dev.: 0.2124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.48% (25.7136 => 17.1051, std.dev.: 0.1233) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.37% (37.0863 => 28.4178, std.dev.: 0.4460) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1092) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0059) SingleSource/Benchmarks/Linpack/linpack-pc: -13.66% (7.8165 => 6.7484, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: -2.21% (2.3521 => 2.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.75% (4.1123 => 4.0403, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 12:46:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 14:46:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140418194623.DAF532A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24715?compare_to=24705&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24715, Order: 206594, Start Time: 2014-04-18 15:06:04, End Time: 2014-04-18 19:52:57 To: 24705, Order: 206576, Start Time: 2014-04-18 09:57:29, End Time: 2014-04-18 14:44:06 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 19 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/FloatMM: 71.43% (0.0280 => 0.0480, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/recursive: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 31.58% (0.0760 => 0.1000, std.dev.: 0.0060) SingleSource/Regression/C/sumarraymalloc: 16.67% (0.0960 => 0.1120, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Oscar: 15.79% (0.0760 => 0.0880, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.33% (0.1800 => 0.2040, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/em3d/em3d: 9.43% (0.2120 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: 5.77% (0.2080 => 0.2200, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.31% (1.0401 => 1.0641, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.05% (10.3362 => 10.5482, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.71% (1.8681 => 1.9001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.70% (2.1121 => 2.1481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.59% (2.0081 => 2.0401, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.52% (1.8481 => 1.8761, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 18.75% (0.1280 => 0.1520, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.85% (0.3120 => 0.3240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.94% (3.9202 => 3.9962, std.dev.: 0.0201) SingleSource/Benchmarks/Dhrystone/dry: 1.76% (0.6800 => 0.6920, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0112) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 13:02:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 15:02:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418200244.80D412A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24716?compare_to=24711&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24716, Order: 206595, Start Time: 2014-04-18 15:28:00, End Time: 2014-04-18 20:09:17 To: 24711, Order: 206592, Start Time: 2014-04-18 14:04:46, End Time: 2014-04-18 18:44:33 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (112 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-20-LoopBug2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.33% (0.2880 => 0.3120, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.78% (0.3600 => 0.3880, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/strcat: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.33% (0.3000 => 0.3280, std.dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0118) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (10.6960 => 11.5480, std.dev.: 0.0779) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0388) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/bh/bh: 4.71% (0.3400 => 0.3560, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0238) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0469) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0361) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.9200 => 5.1040, std.dev.: 0.0528) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0380) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0343) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.75% (0.4360 => 0.4480, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 2.61% (23.7574 => 24.3775, std.dev.: 0.0291) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.44% (48.1088 => 49.2808, std.dev.: 0.0726) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0402) MultiSource/Applications/kimwitu++/kc: 2.04% (18.8170 => 19.2011, std.dev.: 0.0792) MultiSource/Benchmarks/Bullet/bullet: 1.68% (37.0925 => 37.7165, std.dev.: 0.1064) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.2480 => 1.2680, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0170) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0180) MultiSource/Applications/SPASS/SPASS: 1.19% (17.5484 => 17.7564, std.dev.: 0.0533) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0087) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (25.8896 => 26.9537, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0071) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 2.84% (21.1533 => 21.7534, std.dev.: 0.1485) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0314) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (5.0123 => 5.1083, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0304) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0070) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: -1.71% (2.3361 => 2.2961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 13:15:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 15:15:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140418201524.EFB9B2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24717?compare_to=24707&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24717, Order: 206613, Start Time: 2014-04-18 15:33:15, End Time: 2014-04-18 20:21:59 To: 24707, Order: 206577, Start Time: 2014-04-18 10:22:13, End Time: 2014-04-18 15:10:59 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 25 (149 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1087 (930 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2002-10-12-StructureArgs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/2002-12-13-MishaTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.67% (0.0480 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.22% (0.1080 => 0.1320, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.76% (0.1360 => 0.1520, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.94% (0.2520 => 0.2720, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.46% (0.2680 => 0.2880, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.84% (0.2480 => 0.2600, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3040 => 0.3160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 2.68% (0.4480 => 0.4600, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (1.0161 => 1.0321, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.48% (2.1601 => 2.1921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.38% (2.0361 => 2.0641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.36% (2.0521 => 2.0801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.34% (2.0921 => 2.1201, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.25% (2.2441 => 2.2721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.14% (2.0961 => 2.1201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.10% (2.1721 => 2.1961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.02% (2.3641 => 2.3881, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.00% (0.1600 => 0.1760, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.00% (0.2400 => 0.2520, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 1.04% (6.8924 => 6.9644, std.dev.: 0.0244) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 296.51% (0.4560 => 1.8081, std.dev.: 0.0119) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 250.00% (0.0080 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2002-12-13-MishaTest: 133.33% (0.0120 => 0.0280, std.dev.: 0.0020) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.40% (1.7321 => 2.1201, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 22.01% (1.7081 => 2.0841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.82% (1.6681 => 2.0321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.75% (1.6921 => 2.0601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.72% (1.6761 => 2.0401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.70% (1.6961 => 2.0641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.56% (1.7441 => 2.1201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.55% (1.8001 => 2.1881, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/dt: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.28% (1.6921 => 2.0521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.24% (1.8081 => 2.1921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.16% (1.7201 => 2.0841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.11% (1.7241 => 2.0881, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.84% (1.8041 => 2.1801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.65% (1.7241 => 2.0801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.61% (1.9801 => 2.3881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.36% (1.7481 => 2.1041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.34% (1.8881 => 2.2721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.13% (1.8281 => 2.1961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.12% (1.9881 => 2.3881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.08% (1.9081 => 2.2721, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.98% (1.9601 => 2.3321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.94% (1.9641 => 2.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.82% (1.9761 => 2.3481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.18% (1.9801 => 2.3401, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 9.02% (1.0200 => 1.1120, std.dev.: 0.0136) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.33% (0.2400 => 0.2600, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.66% (0.9920 => 1.0680, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0258) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (6.7200 => 7.1560, std.dev.: 0.0333) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.45% (11.7880 => 12.5480, std.dev.: 0.0492) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.30% (1.5240 => 1.6200, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.25% (1.7280 => 1.8360, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.15% (0.2600 => 0.2760, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (1.4160 => 1.4960, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (1.6481 => 1.7321, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 5.01% (4.7920 => 5.0320, std.dev.: 0.0333) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0146) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (9.9842 => 10.4402, std.dev.: 0.0447) MultiSource/Benchmarks/McCat/18-imp/imp: 4.39% (0.4560 => 0.4760, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0279) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (6.8321 => 7.1081, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 3.88% (6.9124 => 7.1804, std.dev.: 0.0156) MultiSource/Applications/d/make_dparser: 3.73% (3.9641 => 4.1121, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: 3.29% (18.4924 => 19.1006, std.dev.: 0.0713) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 3.18% (10.3203 => 10.6484, std.dev.: 0.0376) MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.95% (22.6287 => 23.2968, std.dev.: 0.0528) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.89% (51.1089 => 52.5849, std.dev.: 0.0846) MultiSource/Applications/kimwitu++/kc: 2.82% (19.7371 => 20.2931, std.dev.: 0.0310) MultiSource/Applications/treecc/treecc: 2.75% (2.6200 => 2.6920, std.dev.: 0.0255) MultiSource/Applications/siod/siod: 2.47% (2.7562 => 2.8242, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 2.11% (20.2445 => 20.6725, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (2.2721 => 2.3201, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (16.5963 => 16.9003, std.dev.: 0.0549) MultiSource/Benchmarks/Bullet/bullet: 1.83% (38.9366 => 39.6486, std.dev.: 0.0938) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0219) MultiSource/Applications/sqlite3/sqlite3: 1.41% (25.1895 => 25.5456, std.dev.: 0.0343) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 24.52% (7.3405 => 9.1406, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 12.16% (2.8282 => 3.1722, std.dev.: 0.0088) MultiSource/Applications/minisat/minisat: 3.58% (6.8204 => 7.0644, std.dev.: 0.0461) MultiSource/Applications/sqlite3/sqlite3: 3.32% (4.0923 => 4.2283, std.dev.: 0.0170) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0110) MultiSource/Applications/lua/lua: 2.92% (21.6534 => 22.2854, std.dev.: 0.0852) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.44% (3.4402 => 3.5242, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (5.0963 => 5.2123, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0147) SingleSource/UnitTests/Vector/constpool: -81.59% (10.9087 => 2.0081, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0089) SingleSource/Regression/C++/EH/dead_try_block: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.19% (1.5881 => 1.1721, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: -21.91% (2.6481 => 2.0680, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.59% (7.4801 => 6.1640, std.dev.: 0.0766) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.26% (7.5041 => 6.2840, std.dev.: 0.0726) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -3.16% (13.5243 => 13.0963, std.dev.: 0.0493) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.29% (21.6534 => 17.9091, std.dev.: 0.0337) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: -1.59% (8.3085 => 8.1765, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -1.17% (11.6527 => 11.5167, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 13:37:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 15:37:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418203735.474732A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24718?compare_to=24716&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24718, Order: 206614, Start Time: 2014-04-18 16:04:43, End Time: 2014-04-18 20:44:09 To: 24716, Order: 206595, Start Time: 2014-04-18 15:28:00, End Time: 2014-04-18 20:09:17 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (117 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (973 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 18.75% (0.0640 => 0.0760, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.73% (0.2040 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.00% (0.7000 => 0.7280, std.dev.: 0.0099) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.30% (1.2120 => 1.2520, std.dev.: 0.0113) MultiSource/Applications/Burg/burg: 3.28% (1.4640 => 1.5120, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.7200 => 0.7360, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 13.64% (0.1760 => 0.2000, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.84% (0.2480 => 0.2600, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 2.45% (1.3041 => 1.3361, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -75.00% (0.0160 => 0.0040, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 27.78% (0.0720 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0093) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0442) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0435) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0072) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.39% (1.1880 => 1.2520, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0197) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0432) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0144) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0327) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0436) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0197) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (4.9000 => 5.0640, std.dev.: 0.0229) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.95% (1.2200 => 1.2560, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0602) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0462) MultiSource/Applications/sqlite3/sqlite3: 2.31% (23.7574 => 24.3055, std.dev.: 0.0374) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0420) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.06% (48.1088 => 49.1009, std.dev.: 0.1333) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (5.8400 => 5.9600, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0436) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 1.70% (37.0925 => 37.7246, std.dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0508) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 33.33% (0.0600 => 0.0800, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (25.8896 => 26.9497, std.dev.: 0.0257) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0098) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0091) MultiSource/Applications/lua/lua: 2.72% (21.1533 => 21.7294, std.dev.: 0.1688) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0323) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.53% (0.6320 => 0.6480, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: 1.83% (1.3121 => 1.3361, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0195) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (2.3881 => 2.2521, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -1.94% (2.6762 => 2.6242, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 14:56:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 16:56:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418215648.9DAFD2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24719?compare_to=24718&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24719, Order: 206616, Start Time: 2014-04-18 17:21:17, End Time: 2014-04-18 22:03:22 To: 24718, Order: 206614, Start Time: 2014-04-18 16:04:43, End Time: 2014-04-18 20:44:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (111 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/AtomicOps: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/UnitTests/Threads/tls: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.00% (0.1000 => 0.1160, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: 6.25% (0.1920 => 0.2040, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 5.97% (0.2680 => 0.2840, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.15% (1.3041 => 1.3321, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0117) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.90% (1.2121 => 1.3321, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0130) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0835) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (8.1441 => 8.5761, std.dev.: 0.0433) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0487) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0441) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0515) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (10.4082 => 10.8282, std.dev.: 0.0153) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (5.8400 => 6.0400, std.dev.: 0.0418) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 3.27% (17.6165 => 18.1925, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0322) MultiSource/Applications/sqlite3/sqlite3: 2.74% (23.7574 => 24.4095, std.dev.: 0.0313) MultiSource/Applications/kimwitu++/kc: 2.45% (18.8170 => 19.2771, std.dev.: 0.0521) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0448) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.41% (48.1088 => 49.2689, std.dev.: 0.0796) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0197) MultiSource/Benchmarks/Bullet/bullet: 2.01% (37.0925 => 37.8366, std.dev.: 0.0915) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 1.46% (17.5484 => 17.8044, std.dev.: 0.0400) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 4.14% (25.8896 => 26.9617, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0102) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 2.72% (21.1533 => 21.7294, std.dev.: 0.1254) MultiSource/Applications/spiff/spiff: 2.71% (2.0641 => 2.1201, std.dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0169) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -14.15% (7.7485 => 6.6524, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (2.3881 => 2.2521, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.94% (2.6762 => 2.6242, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 15:37:28 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 15:37:28 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140418223728.F15034FA71FC@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14603 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206664 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17772 of 17773) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17773 of 17773) 1 warning(s) in tests. Testing Time: 366.30s ******************** Failing Tests (1): Clang :: Modules/compiler_builtins_arm.m Expected Passes : 17623 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::compiler_builtins_arm.m': 5 clang 0x000000010941c81a llvm::llvm_unreachable_internal(char const*, char const*, unsigned int) + 474 6 clang 0x00000001083ed342 clang::Module::isAvailable(clang::LangOptions const&, clang::TargetInfo const&, std::__1::pair, std::__1::allocator >, bool>&, clang::Module::HeaderDirective&) const + 274 7 clang 0x0000000107561be5 clang::GenerateModuleAction::BeginSourceFileAction(clang::CompilerInstance&, llvm::StringRef) + 885 8 clang 0x000000010755f44b clang::FrontendAction::BeginSourceFile(clang::CompilerInstance&, clang::FrontendInputFile const&) + 3355 9 clang 0x0000000107533fd1 clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) + 977 10 clang 0x00000001094188ac llvm::CrashRecoveryContext::RunSafely(void (*)(void*), void*) + 236 11 clang 0x0000000109418a89 _ZL26RunSafelyOnThread_DispatchPv + 25 12 clang 0x000000010943d47d _ZL24ExecuteOnThread_DispatchPv + 13 13 libsystem_c.dylib 0x00007fff9440d8bf _pthread_start + 335 14 libsystem_c.dylib 0x00007fff94410b75 thread_start + 13 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.script: line 2: 96841 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -cc1 -internal-isystem /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include -fsyntax-only -triple thumbv7-none-linux-gnueabihf -target-abi aapcs -target-cpu cortex-a8 -mfloat-abi hard -std=c99 -fmodules -fmodules-cache-path=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.tmp -D__need_wint_t /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/compiler_builtins_arm.m -verify -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 15:37:28 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 15:37:28 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140418223728.F29714FA71FD@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14603 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206664 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17772 of 17773) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17773 of 17773) 1 warning(s) in tests. Testing Time: 366.30s ******************** Failing Tests (1): Clang :: Modules/compiler_builtins_arm.m Expected Passes : 17623 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::compiler_builtins_arm.m': 5 clang 0x000000010941c81a llvm::llvm_unreachable_internal(char const*, char const*, unsigned int) + 474 6 clang 0x00000001083ed342 clang::Module::isAvailable(clang::LangOptions const&, clang::TargetInfo const&, std::__1::pair, std::__1::allocator >, bool>&, clang::Module::HeaderDirective&) const + 274 7 clang 0x0000000107561be5 clang::GenerateModuleAction::BeginSourceFileAction(clang::CompilerInstance&, llvm::StringRef) + 885 8 clang 0x000000010755f44b clang::FrontendAction::BeginSourceFile(clang::CompilerInstance&, clang::FrontendInputFile const&) + 3355 9 clang 0x0000000107533fd1 clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) + 977 10 clang 0x00000001094188ac llvm::CrashRecoveryContext::RunSafely(void (*)(void*), void*) + 236 11 clang 0x0000000109418a89 _ZL26RunSafelyOnThread_DispatchPv + 25 12 clang 0x000000010943d47d _ZL24ExecuteOnThread_DispatchPv + 13 13 libsystem_c.dylib 0x00007fff9440d8bf _pthread_start + 335 14 libsystem_c.dylib 0x00007fff94410b75 thread_start + 13 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.script: line 2: 96841 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -cc1 -internal-isystem /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include -fsyntax-only -triple thumbv7-none-linux-gnueabihf -target-abi aapcs -target-cpu cortex-a8 -mfloat-abi hard -std=c99 -fmodules -fmodules-cache-path=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.tmp -D__need_wint_t /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/compiler_builtins_arm.m -verify -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 15:37:29 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 15:37:29 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140418223729.26D324FA71FE@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19041 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206664 Blamelist: benlangmuir,rnk BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 15:37:29 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 15:37:29 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140418223729.26D9E4FA71FF@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19041 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206664 Blamelist: benlangmuir,rnk BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: docs/CMakeLists.txt On: http://10.1.1.2/svn/llvm-project For: cfe At: Fri 18 Apr 2014 15:06:41 Changed By: rnk Comments: Add support for building Sphinx documentation when being inside LLVM source tree and using CMake Patch by Daniel Liew !Properties: Files: docs/ClangFormatStyleOptions.rst docs/Modules.rst On: http://10.1.1.2/svn/llvm-project For: cfe At: Fri 18 Apr 2014 15:06:41 Changed By: rnk Comments: Fix sphinx-build warnings in clang docs.Properties: Files: include/clang/Basic/Module.h lib/Basic/Module.cpp lib/Frontend/FrontendActions.cpp lib/Lex/ModuleMap.cpp test/Modules/Inputs/submodules/module.map test/Modules/missing-header.m test/Modules/submodules.cpp On: http://10.1.1.2/svn/llvm-project For: cfe At: Fri 18 Apr 2014 15:16:41 Changed By: benlangmuir Comments: Don't build modules with (submodules with) missing headers Unless they are in submodules that aren't available anyway, due to requirements not being met. Also, mark children as unavailable when the parent is.Properties: LOGS: From llvm-testresults at cs.uiuc.edu Fri Apr 18 15:57:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 17:57:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418225730.7AC5C2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24720?compare_to=24719&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24720, Order: 206627, Start Time: 2014-04-18 18:19:32, End Time: 2014-04-18 23:04:03 To: 24719, Order: 206616, Start Time: 2014-04-18 17:21:17, End Time: 2014-04-18 22:03:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 21 (109 on baseline) Performance Improvements: 3 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1088 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/UnitTests/initp1: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 18.52% (0.1080 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.4440 => 0.4760, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.02% (0.3320 => 0.3520, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.74% (0.7480 => 0.7760, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.48% (0.4600 => 0.4760, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 40.00% (0.0400 => 0.0560, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 11.69% (1.3001 => 1.4521, std.dev.: 0.0323) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 8.18% (0.4400 => 0.4760, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.55% (1.1601 => 1.2361, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.65% (0.3440 => 0.3600, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 2.15% (21.7294 => 22.1974, std.dev.: 0.1556) SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.97% (4.6723 => 4.7643, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.8481 => 0.8641, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (2.3201 => 2.3481, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: 1.02% (6.6524 => 6.7204, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -5.71% (4.6923 => 4.4243, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -1.66% (4.1003 => 4.0323, std.dev.: 0.0144) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0127) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.45% (0.3760 => 0.4040, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0328) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0751) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9200 => 0.9720, std.dev.: 0.0119) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0532) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0318) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0430) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0472) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0140) MultiSource/Applications/JM/lencod/lencod: 3.09% (17.6165 => 18.1605, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0381) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.36% (48.1088 => 49.2449, std.dev.: 0.1109) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0421) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0161) MultiSource/Benchmarks/Bullet/bullet: 1.91% (37.0925 => 37.8005, std.dev.: 0.1096) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0223) MultiSource/Applications/sqlite3/sqlite3: 1.75% (23.7574 => 24.1735, std.dev.: 0.0514) MultiSource/Applications/kimwitu++/kc: 1.53% (18.8170 => 19.1050, std.dev.: 0.0486) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0147) MultiSource/Applications/SPASS/SPASS: 1.46% (17.5484 => 17.8044, std.dev.: 0.0500) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (15.2282 => 15.3842, std.dev.: 0.0596) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.14% (0.3360 => 0.3600, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 6.76% (1.3601 => 1.4521, std.dev.: 0.0323) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 4.94% (21.1533 => 22.1974, std.dev.: 0.1556) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0082) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0433) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: -6.86% (0.4080 => 0.3800, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 16:10:05 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 16:10:05 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140418231005.70E994FA7691@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14604 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206665 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17772 of 17773) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17773 of 17773) 1 warning(s) in tests. Testing Time: 357.57s ******************** Failing Tests (1): Clang :: Modules/compiler_builtins_arm.m Expected Passes : 17623 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::compiler_builtins_arm.m': 5 clang 0x000000011098481a llvm::llvm_unreachable_internal(char const*, char const*, unsigned int) + 474 6 clang 0x000000010f955342 clang::Module::isAvailable(clang::LangOptions const&, clang::TargetInfo const&, std::__1::pair, std::__1::allocator >, bool>&, clang::Module::HeaderDirective&) const + 274 7 clang 0x000000010eac9be5 clang::GenerateModuleAction::BeginSourceFileAction(clang::CompilerInstance&, llvm::StringRef) + 885 8 clang 0x000000010eac744b clang::FrontendAction::BeginSourceFile(clang::CompilerInstance&, clang::FrontendInputFile const&) + 3355 9 clang 0x000000010ea9bfd1 clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) + 977 10 clang 0x00000001109808ac llvm::CrashRecoveryContext::RunSafely(void (*)(void*), void*) + 236 11 clang 0x0000000110980a89 _ZL26RunSafelyOnThread_DispatchPv + 25 12 clang 0x00000001109a547d _ZL24ExecuteOnThread_DispatchPv + 13 13 libsystem_c.dylib 0x00007fff9440d8bf _pthread_start + 335 14 libsystem_c.dylib 0x00007fff94410b75 thread_start + 13 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.script: line 2: 93681 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -cc1 -internal-isystem /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include -fsyntax-only -triple thumbv7-none-linux-gnueabihf -target-abi aapcs -target-cpu cortex-a8 -mfloat-abi hard -std=c99 -fmodules -fmodules-cache-path=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.tmp -D__need_wint_t /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/compiler_builtins_arm.m -verify -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 16:41:59 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 16:41:59 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140418234159.AB66A4FA7BA4@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14605 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206667 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17777 of 17778) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17778 of 17778) 1 warning(s) in tests. Testing Time: 328.41s ******************** Failing Tests (1): Clang :: Modules/compiler_builtins_arm.m Expected Passes : 17628 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::compiler_builtins_arm.m': 5 clang 0x00000001047e940a llvm::llvm_unreachable_internal(char const*, char const*, unsigned int) + 474 6 clang 0x00000001037afc42 clang::Module::isAvailable(clang::LangOptions const&, clang::TargetInfo const&, std::__1::pair, std::__1::allocator >, bool>&, clang::Module::HeaderDirective&) const + 274 7 clang 0x00000001029244e5 clang::GenerateModuleAction::BeginSourceFileAction(clang::CompilerInstance&, llvm::StringRef) + 885 8 clang 0x0000000102921d4b clang::FrontendAction::BeginSourceFile(clang::CompilerInstance&, clang::FrontendInputFile const&) + 3355 9 clang 0x00000001028f68d1 clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) + 977 10 clang 0x00000001047e549c llvm::CrashRecoveryContext::RunSafely(void (*)(void*), void*) + 236 11 clang 0x00000001047e5679 _ZL26RunSafelyOnThread_DispatchPv + 25 12 clang 0x000000010480a06d _ZL24ExecuteOnThread_DispatchPv + 13 13 libsystem_c.dylib 0x00007fff9440d8bf _pthread_start + 335 14 libsystem_c.dylib 0x00007fff94410b75 thread_start + 13 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.script: line 2: 90515 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -cc1 -internal-isystem /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include -fsyntax-only -triple thumbv7-none-linux-gnueabihf -target-abi aapcs -target-cpu cortex-a8 -mfloat-abi hard -std=c99 -fmodules -fmodules-cache-path=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.tmp -D__need_wint_t /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/compiler_builtins_arm.m -verify -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 18 16:40:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 18:40:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140418234042.369D92A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24721?compare_to=24720&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24721, Order: 206631, Start Time: 2014-04-18 19:07:18, End Time: 2014-04-18 23:47:15 To: 24720, Order: 206627, Start Time: 2014-04-18 18:19:32, End Time: 2014-04-18 23:04:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 19 (106 on baseline) Performance Improvements: 5 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1088 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: 28.57% (0.1120 => 0.1440, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_isamax: 23.81% (0.0840 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/rem: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.60% (0.6840 => 0.7360, std.dev.: 0.0178) MultiSource/Applications/hexxagon/hexxagon: 2.11% (1.1360 => 1.1600, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.52% (1.3161 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.23% (1.3001 => 1.3161, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 20.83% (0.0960 => 0.1160, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 6.30% (0.9521 => 1.0121, std.dev.: 0.0141) SingleSource/UnitTests/Vectorizer/gcc-loops: 6.15% (4.4243 => 4.6963, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (1.3441 => 1.3961, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.85% (0.3120 => 0.3240, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.69% (4.0323 => 4.1003, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.50% (1.2361 => 1.1681, std.dev.: 0.0107) MultiSource/Applications/lua/lua: -2.18% (22.1974 => 21.7134, std.dev.: 0.0663) SingleSource/Benchmarks/McGill/queens: -1.97% (2.2281 => 2.1841, std.dev.: 0.0162) MultiSource/Benchmarks/sim/sim: -1.85% (4.7643 => 4.6763, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.90% (1.1761 => 1.3161, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0708) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0325) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (8.1441 => 8.5681, std.dev.: 0.0424) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (4.9200 => 5.1400, std.dev.: 0.0358) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0223) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0309) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0491) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0262) MultiSource/Applications/lua/lua: 3.10% (4.5200 => 4.6600, std.dev.: 0.0436) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0408) MultiSource/Applications/treecc/treecc: 2.78% (2.4480 => 2.5160, std.dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.4400 => 1.4800, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 2.74% (23.7574 => 24.4095, std.dev.: 0.0550) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0101) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.38% (48.1088 => 49.2530, std.dev.: 0.0884) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0374) MultiSource/Applications/kimwitu++/kc: 1.93% (18.8170 => 19.1810, std.dev.: 0.0683) MultiSource/Benchmarks/Bullet/bullet: 1.89% (37.0925 => 37.7925, std.dev.: 0.0810) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0421) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (15.2282 => 15.4042, std.dev.: 0.0398) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0486) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (25.8896 => 26.9297, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 2.65% (21.1533 => 21.7134, std.dev.: 0.0663) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 1.44% (6.6564 => 6.7524, std.dev.: 0.0338) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 17:05:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 19:05:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419000504.F40592A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24722?compare_to=24712&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24722, Order: 206631, Start Time: 2014-04-18 19:28:57, End Time: 2014-04-19 00:11:40 To: 24712, Order: 206594, Start Time: 2014-04-18 14:23:22, End Time: 2014-04-18 19:06:05 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (162 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (920 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.00% (0.0800 => 0.0920, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.23% (0.2600 => 0.2840, std.dev.: 0.0076) SingleSource/Regression/C/bigstack: 6.25% (0.1920 => 0.2040, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 6.00% (0.4000 => 0.4240, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.17% (0.2320 => 0.2440, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 3.19% (0.3760 => 0.3880, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.7600 => 0.7840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.88% (1.4881 => 1.5161, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.06% (1.8881 => 1.9081, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 2.81% (1.2801 => 1.3161, std.dev.: 0.0132) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4641 => 1.4801, std.dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0119) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0105) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0083) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 20.00% (0.0800 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.02% (1.0240 => 1.1880, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.00% (0.0800 => 0.0920, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.26% (0.4240 => 0.4760, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.26% (1.4561 => 1.6201, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.11% (0.1440 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.97% (0.6200 => 0.6880, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.96% (1.4601 => 1.6201, std.dev.: 0.0085) SingleSource/Regression/C/bigstack: 10.87% (0.1840 => 0.2040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.57% (1.8161 => 2.0081, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.42% (1.6121 => 1.7801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.34% (1.5481 => 1.7081, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.23% (0.7040 => 0.7760, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0133) MultiSource/Applications/obsequi/Obsequi: 10.06% (1.8680 => 2.0560, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.91% (1.7361 => 1.9081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (1.5521 => 1.7041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/05-eks/eks: 9.09% (0.6600 => 0.7200, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.65% (1.4801 => 1.6081, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.33% (0.7680 => 0.8320, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.30% (1.7841 => 1.9321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.29% (1.4481 => 1.5681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.24% (1.4561 => 1.5761, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.48% (6.4680 => 6.9520, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/09-vor/vor: 7.07% (0.3960 => 0.4240, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.02% (0.2280 => 0.2440, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 6.90% (1.5080 => 1.6120, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (11.6440 => 12.3760, std.dev.: 0.0633) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (5.8121 => 6.1241, std.dev.: 0.0426) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/chomp: 5.00% (0.2400 => 0.2520, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.98% (9.4842 => 9.9562, std.dev.: 0.0607) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 4.81% (0.7480 => 0.7840, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0296) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 4.34% (10.0443 => 10.4803, std.dev.: 0.0347) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (6.5440 => 6.8240, std.dev.: 0.0477) MultiSource/Applications/treecc/treecc: 4.18% (2.5840 => 2.6920, std.dev.: 0.0195) MultiSource/Applications/JM/lencod/lencod: 4.17% (21.9606 => 22.8768, std.dev.: 0.0472) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 4.10% (5.3600 => 5.5800, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (6.5080 => 6.7640, std.dev.: 0.0357) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 3.84% (4.7880 => 4.9720, std.dev.: 0.0423) MultiSource/Applications/oggenc/oggenc: 3.84% (6.9844 => 7.2525, std.dev.: 0.0153) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.78% (50.0290 => 51.9210, std.dev.: 0.0665) SingleSource/Benchmarks/Linpack/linpack-pc: 3.70% (0.3240 => 0.3360, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 3.65% (18.4404 => 19.1126, std.dev.: 0.0516) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 3.53% (2.7162 => 2.8122, std.dev.: 0.0103) MultiSource/Applications/ClamAV/clamscan: 3.34% (19.0444 => 19.6803, std.dev.: 0.0767) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0184) MultiSource/Benchmarks/sim/sim: 3.19% (0.3760 => 0.3880, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (16.3483 => 16.8123, std.dev.: 0.0446) MultiSource/Benchmarks/Bullet/bullet: 2.78% (38.4046 => 39.4726, std.dev.: 0.0642) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0254) MultiSource/Applications/kimwitu++/kc: 2.58% (19.6891 => 20.1971, std.dev.: 0.0630) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.57% (6.1044 => 6.2004, std.dev.: 0.0240) MultiSource/Applications/sqlite3/sqlite3: 1.40% (25.6856 => 26.0456, std.dev.: 0.0525) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (13.0563 => 13.2203, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.18% (1.0201 => 1.0321, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.14% (2.1401 => 2.4642, std.dev.: 0.0380) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (3.9922 => 4.0963, std.dev.: 0.0154) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.0881 => 1.1161, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 2.51% (3.9842 => 4.0843, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.44% (4.1003 => 4.2003, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0359) MultiSource/Applications/lua/lua: 1.80% (21.7374 => 22.1294, std.dev.: 0.0663) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.19% (91.8497 => 49.4271, std.dev.: 10.3142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.78% (50.3031 => 32.8100, std.dev.: 0.2225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.08% (26.0616 => 17.1811, std.dev.: 0.1030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.62% (42.1466 => 28.3978, std.dev.: 0.6565) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1097) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.53% (0.3400 => 0.3280, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.91% (4.1243 => 4.0042, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.83% (4.8083 => 4.6723, std.dev.: 0.0292) MultiSource/Benchmarks/BitBench/five11/five11: -2.21% (2.3561 => 2.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -1.27% (26.6977 => 26.3576, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.9923 => 4.9323, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.01% (1.9761 => 1.9561, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 17:14:14 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 17:14:14 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140419001414.8B4764FA8011@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14606 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206670 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17777 of 17778) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17778 of 17778) 1 warning(s) in tests. Testing Time: 328.42s ******************** Failing Tests (1): Clang :: Modules/compiler_builtins_arm.m Expected Passes : 17628 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::compiler_builtins_arm.m': 5 clang 0x000000010c4df40a llvm::llvm_unreachable_internal(char const*, char const*, unsigned int) + 474 6 clang 0x000000010b4a5b42 clang::Module::isAvailable(clang::LangOptions const&, clang::TargetInfo const&, std::__1::pair, std::__1::allocator >, bool>&, clang::Module::HeaderDirective&) const + 274 7 clang 0x000000010a61a3e5 clang::GenerateModuleAction::BeginSourceFileAction(clang::CompilerInstance&, llvm::StringRef) + 885 8 clang 0x000000010a617c4b clang::FrontendAction::BeginSourceFile(clang::CompilerInstance&, clang::FrontendInputFile const&) + 3355 9 clang 0x000000010a5ec7d1 clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) + 977 10 clang 0x000000010c4db49c llvm::CrashRecoveryContext::RunSafely(void (*)(void*), void*) + 236 11 clang 0x000000010c4db679 _ZL26RunSafelyOnThread_DispatchPv + 25 12 clang 0x000000010c50006d _ZL24ExecuteOnThread_DispatchPv + 13 13 libsystem_c.dylib 0x00007fff9440d8bf _pthread_start + 335 14 libsystem_c.dylib 0x00007fff94410b75 thread_start + 13 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.script: line 2: 87376 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -cc1 -internal-isystem /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include -fsyntax-only -triple thumbv7-none-linux-gnueabihf -target-abi aapcs -target-cpu cortex-a8 -mfloat-abi hard -std=c99 -fmodules -fmodules-cache-path=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.tmp -D__need_wint_t /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/compiler_builtins_arm.m -verify -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 18 17:36:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 19:36:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140419003629.571F52A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24723?compare_to=24713&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24723, Order: 206632, Start Time: 2014-04-18 20:00:02, End Time: 2014-04-19 00:43:04 To: 24713, Order: 206594, Start Time: 2014-04-18 14:53:29, End Time: 2014-04-18 19:36:43 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 21 (162 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2006-01-23-UnionInit: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.54% (0.1040 => 0.1160, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.43% (0.1400 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.00% (0.1200 => 0.1320, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.7880 => 0.8320, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/neural/neural: 5.56% (0.2160 => 0.2280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: 5.00% (0.2400 => 0.2520, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.70% (0.3240 => 0.3360, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3320 => 0.3440, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 3.31% (1.0880 => 1.1240, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.26% (0.7360 => 0.7600, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.90% (1.4721 => 1.5001, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (10.1602 => 10.2682, std.dev.: 0.0282) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.00% (0.3200 => 0.3360, std.dev.: 0.0022) MultiSource/Benchmarks/llubenchmark/llu: 3.79% (5.1723 => 5.3683, std.dev.: 0.0630) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.10% (1.6761 => 1.7281, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2337.50% (0.0320 => 0.7800, std.dev.: 0.0121) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0098) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0119) SingleSource/UnitTests/Vector/multiplies: 300.00% (0.0280 => 0.1120, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0181) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0049) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0055) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0054) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0200) MultiSource/Applications/obsequi/Obsequi: 45.40% (1.3920 => 2.0240, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 37.50% (0.1600 => 0.2200, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0089) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/Queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.96% (1.2481 => 1.5721, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.30% (1.1841 => 1.4481, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.29% (1.2921 => 1.5801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.12% (1.1361 => 1.3761, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (1.1441 => 1.3841, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.86% (1.1881 => 1.4241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 17.95% (8.5802 => 10.1203, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 15.60% (19.5406 => 22.5887, std.dev.: 0.0473) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.22% (5.3360 => 6.1481, std.dev.: 0.0346) MultiSource/Benchmarks/nbench/nbench: 15.09% (1.3521 => 1.5561, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.07% (0.2920 => 0.3360, std.dev.: 0.0043) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 14.00% (0.2000 => 0.2280, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.33% (1.7400 => 1.9720, std.dev.: 0.0172) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 9.49% (11.3843 => 12.4643, std.dev.: 0.0400) MultiSource/Applications/aha/aha: 9.09% (0.1320 => 0.1440, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 8.91% (6.2844 => 6.8444, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.90% (0.7640 => 0.8320, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (11.4440 => 12.3480, std.dev.: 0.0890) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.82% (5.7280 => 6.1760, std.dev.: 0.0533) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.27% (5.6680 => 6.0800, std.dev.: 0.0565) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.18% (9.5802 => 10.2682, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.4760 => 1.5760, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.65% (1.6240 => 1.7320, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 5.24% (1.0680 => 1.1240, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (6.8280 => 7.1480, std.dev.: 0.0476) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 4.61% (4.7720 => 4.9920, std.dev.: 0.0198) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.1480 => 1.2000, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 4.09% (5.3840 => 5.6040, std.dev.: 0.0441) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7600 => 1.8240, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (2.2081 => 2.2881, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3320 => 0.3440, std.dev.: 0.0039) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.56% (49.1529 => 50.9049, std.dev.: 0.0612) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 3.18% (19.2243 => 19.8364, std.dev.: 0.0432) MultiSource/Applications/lambda-0_1_3/lambda: 2.83% (0.8480 => 0.8720, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 2.73% (24.7575 => 25.4335, std.dev.: 0.0566) MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (2.7282 => 2.8002, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 2.37% (19.7491 => 20.2171, std.dev.: 0.0264) MultiSource/Applications/treecc/treecc: 2.27% (2.6480 => 2.7080, std.dev.: 0.0220) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0124 => 6.1044, std.dev.: 0.0241) MultiSource/Applications/SPASS/SPASS: 1.45% (18.7966 => 19.0686, std.dev.: 0.0424) MultiSource/Benchmarks/Bullet/bullet: 1.24% (39.0726 => 39.5566, std.dev.: 0.1195) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0164) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.00% (0.3000 => 0.3360, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.43% (3.9842 => 4.2803, std.dev.: 0.0182) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0199) MultiSource/Benchmarks/llubenchmark/llu: 4.84% (5.1203 => 5.3683, std.dev.: 0.0630) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.35% (3.3122 => 3.4562, std.dev.: 0.0463) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0237) MultiSource/Applications/sqlite3/sqlite3: 3.55% (4.0563 => 4.2003, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5442 => 2.5802, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0159) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (25.4536 => 25.7896, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.82% (11.0207 => 2.0041, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.57% (21.6534 => 17.8491, std.dev.: 0.0550) SingleSource/Benchmarks/Linpack/linpack-pc: -16.39% (7.8605 => 6.5724, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -8.99% (3.4722 => 3.1602, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0870) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.05% (2.0601 => 1.9561, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.19% (2.9162 => 2.8522, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.0963 => 5.0123, std.dev.: 0.0187) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 17:46:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 17:46:35 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140419004635.8335F4FA84BF@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14607 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206671 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17777 of 17778) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17778 of 17778) 1 warning(s) in tests. Testing Time: 328.23s ******************** Failing Tests (1): Clang :: Modules/compiler_builtins_arm.m Expected Passes : 17628 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::compiler_builtins_arm.m': 5 clang 0x00000001031f240a llvm::llvm_unreachable_internal(char const*, char const*, unsigned int) + 474 6 clang 0x00000001021b8b42 clang::Module::isAvailable(clang::LangOptions const&, clang::TargetInfo const&, std::__1::pair, std::__1::allocator >, bool>&, clang::Module::HeaderDirective&) const + 274 7 clang 0x000000010132d3e5 clang::GenerateModuleAction::BeginSourceFileAction(clang::CompilerInstance&, llvm::StringRef) + 885 8 clang 0x000000010132ac4b clang::FrontendAction::BeginSourceFile(clang::CompilerInstance&, clang::FrontendInputFile const&) + 3355 9 clang 0x00000001012ff7d1 clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) + 977 10 clang 0x00000001031ee49c llvm::CrashRecoveryContext::RunSafely(void (*)(void*), void*) + 236 11 clang 0x00000001031ee679 _ZL26RunSafelyOnThread_DispatchPv + 25 12 clang 0x000000010321306d _ZL24ExecuteOnThread_DispatchPv + 13 13 libsystem_c.dylib 0x00007fff9440d8bf _pthread_start + 335 14 libsystem_c.dylib 0x00007fff94410b75 thread_start + 13 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.script: line 2: 84232 Illegal instruction: 4 /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -cc1 -internal-isystem /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include -fsyntax-only -triple thumbv7-none-linux-gnueabihf -target-abi aapcs -target-cpu cortex-a8 -mfloat-abi hard -std=c99 -fmodules -fmodules-cache-path=/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Modules/Output/compiler_builtins_arm.m.tmp -D__need_wint_t /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/compiler_builtins_arm.m -verify -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 18 17:42:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 19:42:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140419004236.0D8702A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24724?compare_to=24714&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24724, Order: 206632, Start Time: 2014-04-18 20:03:14, End Time: 2014-04-19 00:49:10 To: 24714, Order: 206594, Start Time: 2014-04-18 14:54:31, End Time: 2014-04-18 19:40:02 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 10 (133 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C/matrixTranspose: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.36% (0.2240 => 0.2360, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (0.9441 => 0.9641, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 28.57% (0.0840 => 0.1080, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 8.82% (0.6800 => 0.7400, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/hash: 4.72% (0.5080 => 0.5320, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.70% (17.6723 => 19.7403, std.dev.: 0.0760) MultiSource/Applications/sqlite3/sqlite3: 1427.06% (1.7001 => 25.9616, std.dev.: 0.0508) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.74% (50.1010 => 51.9770, std.dev.: 0.1013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (1.0520 => 1.1240, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (11.3920 => 12.3480, std.dev.: 0.0849) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0106) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1043, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0099) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0107) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0160 => 0.0320, std.dev.: 0.0056) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-6: 44.44% (0.0360 => 0.0520, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 23.08% (0.1040 => 0.1280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 16.04% (1.8201 => 2.1121, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.97% (1.8281 => 2.1201, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.69% (1.8361 => 2.1241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.66% (1.9161 => 2.2161, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.36% (2.1361 => 2.4642, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.21% (1.9721 => 2.2721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.14% (1.8761 => 2.1601, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.90% (1.9601 => 2.2521, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.80% (1.8921 => 2.1721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.83% (1.8081 => 2.0401, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.64% (1.7721 => 1.9961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4121, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.42% (1.8361 => 2.0641, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.18% (1.8601 => 2.0681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.88% (1.9481 => 2.1601, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.81% (0.7400 => 0.8200, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.19% (1.0880 => 1.1880, std.dev.: 0.0353) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.70% (0.1840 => 0.2000, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 8.66% (1.0160 => 1.1040, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.56% (0.8881 => 0.9641, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: 8.10% (1.8760 => 2.0280, std.dev.: 0.0237) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.3760 => 0.4040, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (6.4800 => 6.9040, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0067) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0314) MultiSource/Benchmarks/nbench/nbench: 5.42% (1.7721 => 1.8681, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.2360 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (9.6042 => 10.0722, std.dev.: 0.0352) MultiSource/Applications/sgefa/sgefa: 4.55% (0.6160 => 0.6440, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.47% (6.5320 => 6.8240, std.dev.: 0.0445) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.29% (1.2120 => 1.2640, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.19% (5.8281 => 6.0721, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.11% (2.3401 => 2.4362, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.07% (2.1600 => 2.2480, std.dev.: 0.0141) MultiSource/Applications/SIBsim4/SIBsim4: 4.04% (1.7841 => 1.8561, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.9960 => 1.0360, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: 4.00% (5.3960 => 5.6120, std.dev.: 0.0461) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (10.2283 => 10.6364, std.dev.: 0.0375) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.7480 => 1.8120, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (6.5360 => 6.7720, std.dev.: 0.0473) MultiSource/Applications/lua/lua: 3.51% (4.7920 => 4.9600, std.dev.: 0.0371) MultiSource/Applications/hbd/hbd: 3.47% (1.7280 => 1.7880, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.39% (16.3003 => 16.8523, std.dev.: 0.0354) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.25% (0.6160 => 0.6360, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 3.09% (2.5880 => 2.6680, std.dev.: 0.0188) MultiSource/Applications/SPASS/SPASS: 2.98% (18.5284 => 19.0806, std.dev.: 0.0581) MultiSource/Applications/oggenc/oggenc: 2.89% (7.0524 => 7.2565, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (4.2243 => 4.3323, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 2.34% (22.2206 => 22.7407, std.dev.: 0.0655) MultiSource/Benchmarks/Bullet/bullet: 2.34% (38.6366 => 39.5406, std.dev.: 0.0767) MultiSource/Applications/kimwitu++/kc: 2.12% (19.8291 => 20.2491, std.dev.: 0.0333) MultiSource/Applications/siod/siod: 1.89% (2.7522 => 2.8042, std.dev.: 0.0195) MultiSource/Applications/d/make_dparser: 1.71% (3.9761 => 4.0441, std.dev.: 0.0236) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 22.73% (0.0880 => 0.1080, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0672) MultiSource/Applications/siod/siod: 11.03% (2.8642 => 3.1802, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 3.52% (6.5964 => 6.8284, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (4.0003 => 4.0683, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0149) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.33% (0.6880 => 0.6720, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.14% (94.8339 => 49.1791, std.dev.: 10.2224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.69% (49.9431 => 33.1181, std.dev.: 0.1693) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.45% (25.7136 => 17.1131, std.dev.: 0.0745) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.57% (3.0722 => 2.3481, std.dev.: 0.1131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.39% (37.0863 => 28.7818, std.dev.: 0.5916) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -13.61% (7.8165 => 6.7524, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.79% (1.2681 => 1.2201, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7722 => 2.7162, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 17:55:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 19:55:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419005540.59CF82A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24725?compare_to=24715&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24725, Order: 206632, Start Time: 2014-04-18 20:15:30, End Time: 2014-04-19 01:02:16 To: 24715, Order: 206594, Start Time: 2014-04-18 15:06:04, End Time: 2014-04-18 19:52:57 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1097 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/2011-03-28-Bitfield: 200.00% (0.0080 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: 33.33% (0.0360 => 0.0480, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.00% (0.0800 => 0.0920, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 10.17% (0.2360 => 0.2600, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.2520 => 0.2720, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 3.15% (0.5080 => 0.5240, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 1.28% (2.8042 => 2.8402, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.22% (12.4720 => 12.6240, std.dev.: 0.0391) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 7.72% (1.0361 => 1.1161, std.dev.: 0.0265) MultiSource/Benchmarks/Olden/tsp/tsp: 1.83% (1.3081 => 1.3321, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 18:05:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 20:05:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419010523.E28092A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24726?compare_to=24721&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24726, Order: 206637, Start Time: 2014-04-18 20:31:51, End Time: 2014-04-19 01:11:56 To: 24721, Order: 206631, Start Time: 2014-04-18 19:07:18, End Time: 2014-04-18 23:47:15 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (114 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0050) SingleSource/UnitTests/2005-07-17-INT-To-FP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.05% (0.3960 => 0.4160, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.24% (1.2481 => 1.2761, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.61% (1.2441 => 1.2641, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.00% (5.9760 => 6.0360, std.dev.: 0.0220) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.50% (1.1481 => 1.2801, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0392) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0589) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0563) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0042) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0170) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0143) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0398) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0474) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0082) MultiSource/Applications/obsequi/Obsequi: 3.48% (1.2640 => 1.3080, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0300) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0512) MultiSource/Applications/sqlite3/sqlite3: 2.88% (23.7574 => 24.4415, std.dev.: 0.0459) MultiSource/Benchmarks/Bullet/bullet: 2.83% (37.0925 => 38.1406, std.dev.: 0.0788) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0264) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.58% (48.1088 => 49.3490, std.dev.: 0.1398) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 2.17% (18.8170 => 19.2251, std.dev.: 0.0607) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0413) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0346) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0095) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (25.8896 => 26.9537, std.dev.: 0.0257) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 2.55% (21.1533 => 21.6934, std.dev.: 0.1443) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0170) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 1.62% (6.6564 => 6.7644, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -14.15% (7.7485 => 6.6524, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3361 => 2.3001, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 18:18:48 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 18:18:48 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140419011848.A53234FA8947@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14608 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206673 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17777 of 17778) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17778 of 17778) 1 warning(s) in tests. Testing Time: 331.92s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17628 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 18 18:26:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 20:26:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140419012633.9C2632A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24727?compare_to=24717&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24727, Order: 206637, Start Time: 2014-04-18 20:44:11, End Time: 2014-04-19 01:33:07 To: 24717, Order: 206613, Start Time: 2014-04-18 15:33:15, End Time: 2014-04-18 20:21:59 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 23 (136 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Bubblesort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0020) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 7.89% (0.1520 => 0.1640, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 3.25% (0.4920 => 0.5080, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.46% (2.1161 => 2.1681, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (6.1640 => 6.3120, std.dev.: 0.0431) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (0.5200 => 0.5320, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.19% (2.0121 => 2.0561, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 1.57% (5.6200 => 5.7080, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.52% (1.0521 => 1.0681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.33% (2.1041 => 2.1321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.30% (2.1561 => 2.1841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.20% (2.3401 => 2.3681, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 1.18% (39.6486 => 40.1166, std.dev.: 0.0650) MultiSource/Applications/d/make_dparser: 1.17% (4.1121 => 4.1601, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (2.0801 => 2.1041, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.64% (0.1760 => 0.2000, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.71% (0.3400 => 0.3560, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.79% (1.2881 => 1.3241, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0088) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 60.00% (0.0400 => 0.0640, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 35.71% (0.0560 => 0.0760, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 22.90% (1.7641 => 2.1681, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.88% (1.6961 => 2.0841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 22.44% (1.8001 => 2.2041, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 22.43% (1.6761 => 2.0521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.40% (1.7321 => 2.1201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 22.38% (1.6801 => 2.0561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.27% (1.6881 => 2.0641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.25% (1.6721 => 2.0441, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 22.22% (1.6921 => 2.0681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 22.06% (1.6681 => 2.0361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 22.04% (1.7241 => 2.1041, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.98% (1.6921 => 2.0641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.97% (1.7481 => 2.1321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.93% (1.6961 => 2.0681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.87% (1.7921 => 2.1841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.84% (1.7401 => 2.1201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.79% (1.7441 => 2.1241, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.78% (1.7081 => 2.0801, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.72% (1.7681 => 2.1521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.63% (1.7201 => 2.0921, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.39% (1.7201 => 2.0881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.34% (1.7241 => 2.0921, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.28% (1.8041 => 2.1881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.24% (1.8081 => 2.1921, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.19% (1.8881 => 2.2881, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.88% (1.8201 => 2.2001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.79% (1.8281 => 2.2081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.72% (1.9881 => 2.4001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.61% (1.9801 => 2.3881, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.26% (1.8361 => 2.2081, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.50% (1.9081 => 2.2801, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.94% (1.9641 => 2.3361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.18% (0.1320 => 0.1560, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.67% (0.1440 => 0.1680, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.03% (0.6120 => 0.7040, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (3.5002 => 3.7362, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (11.7880 => 12.5640, std.dev.: 0.0494) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.5000 => 0.5320, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (6.7200 => 7.1480, std.dev.: 0.0518) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: 5.75% (0.3480 => 0.3680, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 5.71% (1.8201 => 1.9241, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3600 => 0.3800, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.25% (9.9842 => 10.5082, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.10% (0.7840 => 0.8240, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.99% (1.5240 => 1.6000, std.dev.: 0.0252) MultiSource/Applications/d/make_dparser: 4.94% (3.9641 => 4.1601, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0189) MultiSource/Applications/treecc/treecc: 4.73% (2.6200 => 2.7440, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (2.0680 => 2.1640, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 4.46% (6.9124 => 7.2205, std.dev.: 0.0180) MultiSource/Applications/lua/lua: 4.42% (4.7920 => 5.0040, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (6.8321 => 7.1081, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 3.84% (10.3203 => 10.7164, std.dev.: 0.0481) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.6801 => 1.7441, std.dev.: 0.0166) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.79% (1.3720 => 1.4240, std.dev.: 0.0158) MultiSource/Applications/SPASS/SPASS: 3.48% (18.4924 => 19.1366, std.dev.: 0.0532) MultiSource/Applications/JM/lencod/lencod: 3.32% (22.6287 => 23.3807, std.dev.: 0.0536) MultiSource/Applications/lambda-0_1_3/lambda: 3.32% (0.8440 => 0.8720, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: 3.25% (0.4920 => 0.5080, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.19% (3.0122 => 3.1082, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 3.16% (19.7371 => 20.3611, std.dev.: 0.0469) MultiSource/Applications/hbd/hbd: 3.13% (1.7880 => 1.8440, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 3.03% (38.9366 => 40.1166, std.dev.: 0.0650) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.01% (51.1089 => 52.6489, std.dev.: 0.1160) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (5.5480 => 5.7080, std.dev.: 0.0297) MultiSource/Applications/ClamAV/clamscan: 2.45% (20.2445 => 20.7405, std.dev.: 0.0412) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (16.5963 => 16.9363, std.dev.: 0.0615) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 1.86% (25.1895 => 25.6576, std.dev.: 0.0344) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0325) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (4.2203 => 4.2803, std.dev.: 0.0216) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (29.4578 => 29.7739, std.dev.: 0.0931) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0199) MultiSource/Applications/siod/siod: 12.16% (2.8282 => 3.1722, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0229) MultiSource/Applications/minisat/minisat: 3.75% (6.8204 => 7.0764, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.49% (0.3440 => 0.3560, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 3.42% (4.0923 => 4.2323, std.dev.: 0.0145) MultiSource/Applications/lua/lua: 2.97% (21.6534 => 22.2974, std.dev.: 0.1061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/salsa20: 1.75% (7.5485 => 7.6805, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 1.48% (5.9604 => 6.0484, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.71% (6.2884 => 0.8360, std.dev.: 0.0183) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.19% (1.5881 => 1.1721, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0048) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0243) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.73% (7.5041 => 6.3240, std.dev.: 0.0375) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.62% (7.4801 => 6.3120, std.dev.: 0.0431) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -3.02% (13.5243 => 13.1163, std.dev.: 0.0560) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.31% (21.6534 => 17.9051, std.dev.: 0.0304) SingleSource/Benchmarks/Linpack/linpack-pc: -15.49% (7.8005 => 6.5924, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.96% (2.6642 => 2.4522, std.dev.: 0.0775) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: -2.48% (5.1603 => 5.0323, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: -1.49% (8.3085 => 8.1845, std.dev.: 0.0223) MultiSource/Applications/hexxagon/hexxagon: -1.13% (11.6527 => 11.5207, std.dev.: 0.0061) MultiSource/Applications/aha/aha: -1.10% (2.9122 => 2.8802, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 18:39:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 20:39:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419013932.3CE482A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24728?compare_to=24726&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24728, Order: 206641, Start Time: 2014-04-18 21:06:25, End Time: 2014-04-19 01:46:05 To: 24726, Order: 206637, Start Time: 2014-04-18 20:31:51, End Time: 2014-04-19 01:11:56 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (116 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (975 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Queens: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Regression/C++/EH/function_try_block: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/misr: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.50% (0.0960 => 0.1080, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.20% (0.1640 => 0.1840, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.2360 => 0.2560, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 28.57% (0.1120 => 0.1440, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.36% (0.2200 => 0.2560, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.24% (1.1761 => 1.3201, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0115) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.01% (1.2721 => 1.4121, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.73% (1.1561 => 1.2801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.48% (1.2601 => 1.3921, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0767) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0318) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0527) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0195) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0153) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (10.4082 => 10.8282, std.dev.: 0.0376) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0545) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0564) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0325) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0437) MultiSource/Applications/sqlite3/sqlite3: 2.86% (23.7574 => 24.4375, std.dev.: 0.0619) MultiSource/Benchmarks/Bullet/bullet: 2.74% (37.0925 => 38.1086, std.dev.: 0.0789) MultiSource/Applications/siod/siod: 2.64% (2.5721 => 2.6401, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.54% (48.1088 => 49.3330, std.dev.: 0.0712) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 2.38% (18.8170 => 19.2651, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0412) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0417) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 2.07% (5.7964 => 5.9164, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 1.50% (17.5484 => 17.8124, std.dev.: 0.0409) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0035) MultiSource/Benchmarks/llubenchmark/llu: 4.54% (5.1963 => 5.4323, std.dev.: 0.0836) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (25.8896 => 26.9337, std.dev.: 0.0265) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 2.44% (21.1533 => 21.6694, std.dev.: 0.0924) MultiSource/Applications/minisat/minisat: 1.98% (6.6564 => 6.7884, std.dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0087) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0544) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.18% (0.1760 => 0.1440, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0037) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 18:51:36 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 18:51:36 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140419015136.92BAA4FA8D32@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19047 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206678 Blamelist: bogner,dblaikie,dexonsmith Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Fri Apr 18 19:51:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 21:51:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419025103.B34762A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24729?compare_to=24728&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24729, Order: 206663, Start Time: 2014-04-18 22:16:21, End Time: 2014-04-19 02:57:35 To: 24728, Order: 206641, Start Time: 2014-04-18 21:06:25, End Time: 2014-04-19 01:46:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (102 on baseline) Performance Improvements: 10 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/divides: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-07-VarArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 25.00% (0.0800 => 0.1000, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.62% (0.1280 => 0.1480, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.54% (0.4520 => 0.4680, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/function_try_block: -33.33% (0.0360 => 0.0240, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.03% (1.3201 => 1.2801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.30% (1.3921 => 1.3601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.98% (1.4121 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.87% (1.2801 => 1.2561, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: -1.37% (10.8282 => 10.6802, std.dev.: 0.0415) MultiSource/Applications/kimwitu++/kc: -1.16% (19.2651 => 19.0410, std.dev.: 0.0609) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.11% (28.4018 => 28.0858, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.07% (15.3562 => 15.1922, std.dev.: 0.0634) MultiSource/Applications/JM/lencod/lencod: -1.06% (18.1565 => 17.9645, std.dev.: 0.0484) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0124) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0594) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0091) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0179) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0416) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.7360 => 1.7880, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (5.8000 => 5.9720, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (10.4082 => 10.6802, std.dev.: 0.0415) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0371) MultiSource/Applications/JM/lencod/lencod: 1.98% (17.6165 => 17.9645, std.dev.: 0.0484) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0541) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0297) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.81% (48.1088 => 48.9808, std.dev.: 0.0619) MultiSource/Benchmarks/Bullet/bullet: 1.81% (37.0925 => 37.7646, std.dev.: 0.0980) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (2.8322 => 2.8722, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 1.19% (18.8170 => 19.0410, std.dev.: 0.0609) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 13.05% (2.8802 => 3.2562, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (25.8896 => 26.9537, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 2.72% (21.1533 => 21.7294, std.dev.: 0.1464) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.0643 => 4.1283, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -26.67% (0.0600 => 0.0440, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.62% (1.2601 => 1.1641, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 20:56:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 22:56:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419035614.6F2C22A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24730?compare_to=24729&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24730, Order: 206667, Start Time: 2014-04-18 23:18:45, End Time: 2014-04-19 04:02:46 To: 24729, Order: 206663, Start Time: 2014-04-18 22:16:21, End Time: 2014-04-19 02:57:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (108 on baseline) Performance Improvements: 4 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_shift: 44.44% (0.0360 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.2840 => 0.3000, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.19% (1.2801 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.10% (1.3361 => 1.3641, std.dev.: 0.0084) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.87% (1.2801 => 1.3041, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.68% (0.9521 => 0.9681, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.53% (1.1641 => 1.2401, std.dev.: 0.0120) MultiSource/Applications/lua/lua: 2.12% (21.7294 => 22.1894, std.dev.: 0.0990) SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.93% (2.2841 => 2.3281, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -5.63% (4.6923 => 4.4283, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.72% (1.3961 => 1.3441, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -2.23% (4.1283 => 4.0363, std.dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.08% (0.1560 => 0.1920, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0161) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0105) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/methcall: 8.62% (0.2320 => 0.2520, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.6840 => 0.7400, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0274) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.41% (0.6240 => 0.6640, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0458) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0159) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0559) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0181) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0358) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0570) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0187) MultiSource/Applications/JM/lencod/lencod: 2.50% (17.6165 => 18.0565, std.dev.: 0.0478) MultiSource/Benchmarks/Bullet/bullet: 2.18% (37.0925 => 37.9005, std.dev.: 0.0563) MultiSource/Applications/oggenc/oggenc: 2.00% (5.7964 => 5.9124, std.dev.: 0.0158) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0051) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.92% (48.1088 => 49.0329, std.dev.: 0.0667) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0129) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: 1.30% (18.8170 => 19.0611, std.dev.: 0.0490) MultiSource/Applications/sqlite3/sqlite3: 1.28% (23.7574 => 24.0615, std.dev.: 0.0353) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0155) MultiSource/Applications/lua/lua: 4.90% (21.1533 => 22.1894, std.dev.: 0.0990) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (25.8896 => 26.7857, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0161) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.62% (6.6564 => 6.7644, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0208) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 21:31:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 23:31:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419043158.E494B2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24731?compare_to=24730&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24731, Order: 206671, Start Time: 2014-04-18 23:58:50, End Time: 2014-04-19 04:38:29 To: 24730, Order: 206667, Start Time: 2014-04-18 23:18:45, End Time: 2014-04-19 04:02:46 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 19 (110 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/testtrace: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 66.67% (0.0240 => 0.0400, std.dev.: 0.0032) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 27.27% (0.0880 => 0.1120, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.18% (0.0880 => 0.1040, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 13.16% (0.1520 => 0.1720, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.38% (0.1280 => 0.1400, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 6.94% (0.2880 => 0.3080, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (0.2160 => 0.2280, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.18% (4.9440 => 5.0520, std.dev.: 0.0364) MultiSource/Benchmarks/PAQ8p/paq8p: 1.38% (2.6082 => 2.6442, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.28% (1.2481 => 1.2641, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.53% (0.3040 => 0.3360, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (8.0765 => 8.1605, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0062) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 16.22% (0.1480 => 0.1720, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0105) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0592) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0386) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0286) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0323) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0350) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0241) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0364) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0447) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0471) MultiSource/Applications/JM/lencod/lencod: 2.59% (17.6165 => 18.0725, std.dev.: 0.0596) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.5480 => 1.5880, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0226) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.29% (48.1088 => 49.2090, std.dev.: 0.0749) MultiSource/Benchmarks/PAQ8p/paq8p: 2.16% (2.5882 => 2.6442, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8726, std.dev.: 0.0802) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.6321 => 1.6641, std.dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: 1.92% (1.2480 => 1.2720, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0473) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1451, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0122) MultiSource/Applications/SPASS/SPASS: 1.37% (17.5484 => 17.7884, std.dev.: 0.0455) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0201) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0204) MultiSource/Applications/lua/lua: 5.07% (21.1533 => 22.2254, std.dev.: 0.1410) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0501) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0110) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0325) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0107) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0493) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0073) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.13% (4.2403 => 4.1923, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 21:46:00 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 21:46:00 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140419044604.5A0244FAA48E@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/734 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 206583 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp1597oTexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp1597oTexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpelrBKcexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpelrBKcexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Fri Apr 18 21:59:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Apr 2014 23:59:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419045933.7A0D12A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24732?compare_to=24722&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24732, Order: 206673, Start Time: 2014-04-19 00:23:21, End Time: 2014-04-19 05:06:07 To: 24722, Order: 206631, Start Time: 2014-04-18 19:28:57, End Time: 2014-04-19 00:11:40 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 18 (146 on baseline) Performance Improvements: 6 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1088 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/ackermann: 60.00% (0.0200 => 0.0320, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.75% (0.3200 => 0.3480, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2120 => 0.2280, std.dev.: 0.0052) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.2960 => 1.3440, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.4520 => 0.4680, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.51% (4.5523 => 4.7123, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.15% (3.7202 => 3.8002, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 2.06% (2.9162 => 2.9762, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.9482 => 4.0283, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.99% (11.4767 => 11.7047, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.50% (4.0042 => 4.0643, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.30% (4.9323 => 4.9963, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: -3.06% (0.7840 => 0.7600, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.90% (1.2241 => 1.1641, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.32% (5.1723 => 5.0523, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -1.86% (4.0843 => 4.0083, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.71% (4.2003 => 4.1283, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0066) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0136) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0111) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0048) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/AtomicOps: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 47.06% (0.0680 => 0.1000, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0123) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/17-bintr/bintr: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0218) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.47% (1.8161 => 1.9881, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.44% (1.6521 => 1.8081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.33% (0.2400 => 0.2600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8881 => 0.9601, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0120) MultiSource/Applications/obsequi/Obsequi: 7.71% (1.8680 => 2.0120, std.dev.: 0.0306) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/matrix: 7.25% (0.2760 => 0.2960, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 7.16% (1.5080 => 1.6160, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.7480 => 0.8000, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.4680 => 6.8760, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (11.6440 => 12.3280, std.dev.: 0.0572) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.86% (1.0240 => 1.0840, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.41% (0.4440 => 0.4680, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.98% (9.4842 => 9.9562, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0325) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0237) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 3.95% (21.9606 => 22.8288, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (6.5080 => 6.7600, std.dev.: 0.0381) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0152) MultiSource/Applications/lua/lua: 3.68% (4.7880 => 4.9640, std.dev.: 0.0274) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0183) MultiSource/Applications/JM/ldecod/ldecod: 3.62% (10.0443 => 10.4083, std.dev.: 0.0407) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.60% (50.0290 => 51.8290, std.dev.: 0.0788) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.59% (1.5600 => 1.6160, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.45% (1.7400 => 1.8000, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0141) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0125) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.32% (1.3240 => 1.3680, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 3.13% (5.3600 => 5.5280, std.dev.: 0.0601) MultiSource/Applications/SPASS/SPASS: 3.08% (18.4404 => 19.0085, std.dev.: 0.0448) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0124) MultiSource/Applications/treecc/treecc: 2.94% (2.5840 => 2.6600, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0189) MultiSource/Benchmarks/Bullet/bullet: 2.58% (38.4046 => 39.3966, std.dev.: 0.1133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.57% (6.5440 => 6.7120, std.dev.: 0.0642) MultiSource/Applications/siod/siod: 2.50% (2.7162 => 2.7842, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 2.42% (19.6891 => 20.1651, std.dev.: 0.0337) MultiSource/Applications/ClamAV/clamscan: 2.33% (19.0444 => 19.4884, std.dev.: 0.0746) MultiSource/Applications/d/make_dparser: 2.12% (3.9681 => 4.0521, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (16.3483 => 16.6723, std.dev.: 0.0423) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0207) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.14% (2.1401 => 2.4642, std.dev.: 0.0449) MultiSource/Applications/siod/siod: 10.63% (2.8602 => 3.1642, std.dev.: 0.0321) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0347) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0270) MultiSource/Applications/hexxagon/hexxagon: 1.70% (11.5087 => 11.7047, std.dev.: 0.0120) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 1.50% (2.9322 => 2.9762, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 1.31% (21.7374 => 22.0214, std.dev.: 0.1058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.75% (2.9442 => 0.9200, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.76% (1.5641 => 1.0361, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.44% (91.8497 => 49.1991, std.dev.: 10.7195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.66% (26.0616 => 17.0291, std.dev.: 0.1503) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.21% (50.3031 => 33.0941, std.dev.: 0.0940) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.05% (42.1466 => 28.6378, std.dev.: 0.3846) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.1110) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0159) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.02% (5.1563 => 5.0523, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.45% (4.1243 => 4.0643, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -1.12% (26.6977 => 26.3976, std.dev.: 0.0402) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 22:25:55 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 22:25:55 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-Rlto Message-ID: <20140419052603.B0CF94FAA940@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-Rlto while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-Rlto/builds/1227 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve3 Build Reason: Triggerable(phase3-stage0) Build Source Stamp: 206659 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/llvm/autoconf/mkinstalldirs /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/./ > /dev/null /bin/date > /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/.//.dir llvm[2]: Compiling llvm-profdata.cpp for Release build if /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/host-compiler/bin/clang++ -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/llvm/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/llvm/tools/llvm-profdata -DNDEBUG -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -O3 -stdlib=libc++ -std=c++11 -fvisibility-inlines-hidden -fno-exceptions -fno-rtti -fno-common -Woverloaded-virtual -Wcast-qual -m64 -pedantic -Wno-long-long -Wall -W -Wno-unused-parameter -Wwrite-strings -flto -gline-tables-only -Wcovered-switch-default -Wno-uninitialized -Wno-missing-field-initializers -c -MMD -MP -MF "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d.tmp" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.o" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d" /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/llvm/tools/llvm-profdata/llvm-profdata.cpp -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.o ; \ then /bin/mv -f "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d.tmp" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d"; else /bin/rm "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d.tmp"; exit 1; fi llvm[2]: Linking Release executable llvm-profdata /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/host-compiler/bin/clang++ -O3 -stdlib=libc++ -Wl,-dead_strip -Wl,-rpath -Wl, at executable_path/../lib -L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/lib -L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/lib -Wl,-exported_symbol,_main -m64 -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/bin/llvm-profdata /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.o \ -lLLVMProfileData -lLLVMSupport -lz -lpthread -ledit -lcurses -lm ld: lto: could not merge in /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/lib/libLLVMProfileData.a(InstrProfWriter.o) because 'Linking globals named '_ZN4llvm16IndexedInstrProf11ComputeHashENS0_5HashTENS_9StringRefE': symbol multiply defined!', using libLTO version 'LLVM version 3.5.0svn' for architecture x86_64 clang: error: linker command failed with exit code 1 (use -v to see invocation) make[2]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/bin/llvm-profdata] Error 1 make[1]: *** [llvm-profdata/.makeall] Error 2 make[1]: *** Waiting for unfinished jobs.... llvm[2]: ======= Finished Linking Release Executable llvm-objdump make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 22:25:55 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 22:25:55 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-Rlto Message-ID: <20140419052603.B15864FAA941@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-Rlto while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-Rlto/builds/1227 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve3 Build Reason: Triggerable(phase3-stage0) Build Source Stamp: 206659 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/llvm/autoconf/mkinstalldirs /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/./ > /dev/null /bin/date > /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/.//.dir llvm[2]: Compiling llvm-profdata.cpp for Release build if /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/host-compiler/bin/clang++ -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/llvm/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/llvm/tools/llvm-profdata -DNDEBUG -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -O3 -stdlib=libc++ -std=c++11 -fvisibility-inlines-hidden -fno-exceptions -fno-rtti -fno-common -Woverloaded-virtual -Wcast-qual -m64 -pedantic -Wno-long-long -Wall -W -Wno-unused-parameter -Wwrite-strings -flto -gline-tables-only -Wcovered-switch-default -Wno-uninitialized -Wno-missing-field-initializers -c -MMD -MP -MF "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d.tmp" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.o" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d" /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/llvm/tools/llvm-profdata/llvm-profdata.cpp -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.o ; \ then /bin/mv -f "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d.tmp" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d"; else /bin/rm "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.d.tmp"; exit 1; fi llvm[2]: Linking Release executable llvm-profdata /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/host-compiler/bin/clang++ -O3 -stdlib=libc++ -Wl,-dead_strip -Wl,-rpath -Wl, at executable_path/../lib -L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/lib -L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/lib -Wl,-exported_symbol,_main -m64 -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/bin/llvm-profdata /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/tools/llvm-profdata/Release/llvm-profdata.o \ -lLLVMProfileData -lLLVMSupport -lz -lpthread -ledit -lcurses -lm ld: lto: could not merge in /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/lib/libLLVMProfileData.a(InstrProfWriter.o) because 'Linking globals named '_ZN4llvm16IndexedInstrProf11ComputeHashENS0_5HashTENS_9StringRefE': symbol multiply defined!', using libLTO version 'LLVM version 3.5.0svn' for architecture x86_64 clang: error: linker command failed with exit code 1 (use -v to see invocation) make[2]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-Rlto/clang-build/Release/bin/llvm-profdata] Error 1 make[1]: *** [llvm-profdata/.makeall] Error 2 make[1]: *** Waiting for unfinished jobs.... llvm[2]: ======= Finished Linking Release Executable llvm-objdump make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Fri Apr 18 22:30:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 00:30:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140419053052.E8B0C2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24733?compare_to=24723&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24733, Order: 206674, Start Time: 2014-04-19 00:54:41, End Time: 2014-04-19 05:37:26 To: 24723, Order: 206632, Start Time: 2014-04-18 20:00:02, End Time: 2014-04-19 00:43:04 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (156 on baseline) Performance Improvements: 4 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.64% (0.3240 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.4680 => 0.5000, std.dev.: 0.0111) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.27% (1.3201 => 1.4161, std.dev.: 0.0310) MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (5.0123 => 5.2003, std.dev.: 0.0350) SingleSource/Benchmarks/McGill/queens: 2.92% (2.1921 => 2.2561, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.65% (4.0803 => 4.1883, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.54% (5.0403 => 5.1683, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.24% (2.8522 => 2.9162, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.58% (3.8042 => 3.8642, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.47% (1.3601 => 1.3801, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.05% (2.2881 => 2.2641, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.67% (4.1963 => 4.0843, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -2.01% (3.1762 => 3.1122, std.dev.: 0.0247) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0090) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0037) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0123) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 200.00% (0.2520 => 0.7560, std.dev.: 0.0127) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0036) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 92.31% (0.1040 => 0.2000, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0051) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: 43.10% (1.3920 => 1.9920, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/salsa20: 40.00% (0.0600 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/dt: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.13% (1.2521 => 1.5041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 18.18% (8.5802 => 10.1403, std.dev.: 0.0432) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 17.91% (1.2281 => 1.4481, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 15.13% (19.5406 => 22.4967, std.dev.: 0.0517) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.02% (5.3360 => 6.0841, std.dev.: 0.0321) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0049) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.26% (1.7400 => 1.9360, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/ffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0186) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (11.3843 => 12.4043, std.dev.: 0.0189) MultiSource/Applications/oggenc/oggenc: 8.91% (6.2844 => 6.8444, std.dev.: 0.0196) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.52% (5.7280 => 6.2160, std.dev.: 0.0427) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.05% (5.6680 => 6.1240, std.dev.: 0.0578) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (11.4440 => 12.2960, std.dev.: 0.0878) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.10% (9.5802 => 10.1642, std.dev.: 0.0448) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0069) MultiSource/Applications/spiff/spiff: 4.96% (1.0480 => 1.1000, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.9800 => 1.0280, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.55% (1.2320 => 1.2880, std.dev.: 0.0206) MultiSource/Applications/lua/lua: 4.19% (4.7720 => 4.9720, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0112) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (6.8280 => 7.0800, std.dev.: 0.0546) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.21% (49.1529 => 50.7289, std.dev.: 0.0801) MultiSource/Benchmarks/MallocBench/gs/gs: 3.05% (5.3840 => 5.5480, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (2.0920 => 2.1520, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.52% (24.7575 => 25.3815, std.dev.: 0.0339) MultiSource/Applications/ClamAV/clamscan: 2.43% (19.2243 => 19.6923, std.dev.: 0.0650) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.7440 => 0.7600, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 1.52% (19.7491 => 20.0491, std.dev.: 0.0480) MultiSource/Benchmarks/Bullet/bullet: 1.37% (39.0726 => 39.6086, std.dev.: 0.0585) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0168) MultiSource/Applications/SPASS/SPASS: 1.04% (18.7966 => 18.9925, std.dev.: 0.0368) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.28% (0.1720 => 0.2000, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.3000 => 0.3320, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.93% (1.3121 => 1.4161, std.dev.: 0.0310) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0247) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0298) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0286) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 2.04% (5.0963 => 5.2003, std.dev.: 0.0350) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (25.4536 => 25.9056, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0193) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.82% (11.0207 => 2.0041, std.dev.: 0.0094) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6534 => 17.8851, std.dev.: 0.0353) SingleSource/Benchmarks/Linpack/linpack-pc: -16.08% (7.8605 => 6.5964, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.05% (4.5123 => 4.2843, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 22:40:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 00:40:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140419054014.611992A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24734?compare_to=24724&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24734, Order: 206676, Start Time: 2014-04-19 01:00:42, End Time: 2014-04-19 05:46:48 To: 24724, Order: 206632, Start Time: 2014-04-18 20:03:14, End Time: 2014-04-19 00:49:10 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (142 on baseline) Performance Improvements: 5 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2002-10-12-StructureArgs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/initp1: 50.00% (0.0400 => 0.0600, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0760 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.39% (0.3160 => 0.3520, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/EH/except: 10.71% (0.2240 => 0.2480, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.38% (0.1280 => 0.1400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.17% (0.3840 => 0.4000, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.10% (4.6843 => 4.8763, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.80% (3.7162 => 3.8202, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.13% (11.4807 => 11.7247, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.06% (2.7162 => 2.7722, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.65% (2.1881 => 2.2241, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.55% (2.0641 => 2.0321, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.59% (1.2201 => 1.1641, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -2.63% (4.1043 => 3.9962, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2443 => 4.2003, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.86% (17.6723 => 19.5923, std.dev.: 0.0644) MultiSource/Applications/sqlite3/sqlite3: 1418.12% (1.7001 => 25.8096, std.dev.: 0.0366) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.11% (50.1010 => 51.6570, std.dev.: 0.1226) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.0520 => 1.0800, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.29% (11.3920 => 12.3360, std.dev.: 0.0736) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0112) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9962, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0102) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0084) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/methcall: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0056) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.00% (0.0800 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.67% (0.1440 => 0.1680, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.95% (1.8561 => 2.1521, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.70% (1.8601 => 2.1521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.22% (1.8921 => 2.1801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.21% (1.9721 => 2.2721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.99% (2.0281 => 2.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 14.29% (0.0840 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.69% (1.7961 => 2.0241, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.41% (1.7721 => 1.9921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.29% (1.9481 => 2.1681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0108) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.21% (0.3040 => 0.3320, std.dev.: 0.0101) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0179) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.64% (0.3240 => 0.3520, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 7.48% (1.0160 => 1.0920, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0250) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.95% (0.3360 => 0.3560, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (6.4800 => 6.8360, std.dev.: 0.0623) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0062) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0144) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.39% (5.8281 => 6.0841, std.dev.: 0.0411) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 4.19% (10.2283 => 10.6564, std.dev.: 0.0461) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (9.6042 => 9.9962, std.dev.: 0.0402) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 3.67% (4.7920 => 4.9680, std.dev.: 0.0255) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (6.5320 => 6.7640, std.dev.: 0.0588) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (6.5360 => 6.7560, std.dev.: 0.0498) MultiSource/Applications/oggenc/oggenc: 3.29% (7.0524 => 7.2845, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 3.14% (1.7841 => 1.8401, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/gs/gs: 3.04% (5.3960 => 5.5600, std.dev.: 0.0561) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0199) MultiSource/Applications/treecc/treecc: 2.94% (2.5880 => 2.6640, std.dev.: 0.0226) MultiSource/Applications/JM/lencod/lencod: 2.81% (22.2206 => 22.8447, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (16.3003 => 16.7323, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0119) MultiSource/Benchmarks/Bullet/bullet: 2.54% (38.6366 => 39.6166, std.dev.: 0.0446) MultiSource/Applications/SPASS/SPASS: 2.46% (18.5284 => 18.9844, std.dev.: 0.0579) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2243 => 4.3203, std.dev.: 0.0111) MultiSource/Applications/kimwitu++/kc: 1.98% (19.8291 => 20.2211, std.dev.: 0.0651) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.66% (2.1201 => 2.4522, std.dev.: 0.0464) MultiSource/Applications/siod/siod: 10.47% (2.8642 => 3.1642, std.dev.: 0.0286) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.00% (0.7200 => 0.7560, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.10% (5.0243 => 5.1803, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 3.09% (6.5964 => 6.8004, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.91% (3.7122 => 3.8202, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 2.79% (1.2881 => 1.3241, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.98% (11.4967 => 11.7247, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.50% (4.8043 => 4.8763, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9684 => 6.0484, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/queens: 1.27% (2.1961 => 2.2241, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.28% (2.9562 => 0.9080, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.34% (94.8339 => 48.9951, std.dev.: 10.5035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.07% (49.9431 => 32.9261, std.dev.: 0.1984) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.15% (25.7136 => 17.1891, std.dev.: 0.0801) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.30% (37.0863 => 28.8178, std.dev.: 0.4749) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -11.64% (2.7482 => 2.4282, std.dev.: 0.0973) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0059) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.86% (5.1563 => 5.0603, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 22:53:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 00:53:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419055356.A01BE2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24735?compare_to=24725&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24735, Order: 206677, Start Time: 2014-04-19 01:13:55, End Time: 2014-04-19 06:00:27 To: 24725, Order: 206632, Start Time: 2014-04-18 20:15:30, End Time: 2014-04-19 01:02:16 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (0 on baseline) Performance Improvements: 4 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1098 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 66.67% (0.0240 => 0.0400, std.dev.: 0.0032) SingleSource/Regression/C/casts: 57.14% (0.0280 => 0.0440, std.dev.: 0.0030) SingleSource/UnitTests/vla: 33.33% (0.0360 => 0.0480, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0020) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists1: 4.35% (0.3680 => 0.3840, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.30% (0.1720 => 0.1880, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.78% (3.8122 => 3.9562, std.dev.: 0.0550) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.32% (1.9001 => 1.8561, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.56% (1.7961 => 1.7681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.47% (1.9001 => 1.8721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.41% (1.9801 => 1.9521, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0157) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 18 22:55:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 00:55:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419055536.2C88A2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24736?compare_to=24731&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24736, Order: 206678, Start Time: 2014-04-19 01:22:03, End Time: 2014-04-19 06:02:09 To: 24731, Order: 206671, Start Time: 2014-04-18 23:58:50, End Time: 2014-04-19 04:38:29 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (110 on baseline) Performance Improvements: 3 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-31-LongShifts: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.33% (0.9240 => 0.9640, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.51% (0.4560 => 0.4720, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: 6.24% (4.4203 => 4.6963, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (1.3441 => 1.3961, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.85% (0.3120 => 0.3240, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.65% (0.6040 => 0.6200, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.38% (4.0283 => 4.1243, std.dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.50% (1.2361 => 1.1681, std.dev.: 0.0076) MultiSource/Applications/lua/lua: -2.27% (22.2254 => 21.7214, std.dev.: 0.1077) SingleSource/Benchmarks/McGill/queens: -1.97% (2.2281 => 2.1841, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/lists: 15.79% (0.0760 => 0.0880, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.04% (1.1361 => 1.2161, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0615) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (6.0160 => 6.3600, std.dev.: 0.0438) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0143) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0273) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0369) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (8.1441 => 8.4521, std.dev.: 0.0707) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0197) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0410) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0344) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0369) MultiSource/Applications/sqlite3/sqlite3: 2.59% (23.7574 => 24.3735, std.dev.: 0.0413) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.21% (0.5440 => 0.5560, std.dev.: 0.0044) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0209, std.dev.: 0.0744) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0332) MultiSource/Benchmarks/Bullet/bullet: 1.85% (37.0925 => 37.7805, std.dev.: 0.0973) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.71% (4.9000 => 4.9840, std.dev.: 0.0314) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0850, std.dev.: 0.0714) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0147) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0402) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (25.8896 => 26.9417, std.dev.: 0.0254) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0093) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0089) MultiSource/Applications/lua/lua: 2.69% (21.1533 => 21.7214, std.dev.: 0.1077) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (5.0123 => 5.1003, std.dev.: 0.0145) MultiSource/Applications/minisat/minisat: 1.62% (6.6564 => 6.7644, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0213) SingleSource/Benchmarks/SmallPT/smallpt: 1.23% (14.0009 => 14.1729, std.dev.: 0.0186) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ClamAV/clamscan: -23.33% (0.1200 => 0.0920, std.dev.: 0.0096) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 23:05:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 23:05:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase3 - tree health Message-ID: <20140419060537.9DF0F4FAAE36@lab.llvm.org> The Buildbot has detected a new failure on builder phase3 - tree health while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase3%20-%20tree%20health/builds/2335 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206659 Blamelist: aaronballman,anemet,arsenm,atrick,benlangmuir,bogner,chandlerc,d0k,dblaikie,dexonsmith,eugenis,garious,gribozavr,mcrosier,rnk,samsonov,tfiala,timurrrr,tnorthover,yrnkrn BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Fri Apr 18 23:05:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 18 Apr 2014 23:05:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase3 - tree health Message-ID: <20140419060537.9CB144FAAE35@lab.llvm.org> The Buildbot has detected a new failure on builder phase3 - tree health while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase3%20-%20tree%20health/builds/2335 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206659 Blamelist: aaronballman,anemet,arsenm,atrick,benlangmuir,bogner,chandlerc,d0k,dblaikie,dexonsmith,eugenis,garious,gribozavr,mcrosier,rnk,samsonov,tfiala,timurrrr,tnorthover,yrnkrn BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: lib/Target/ARM64/ARM64ISelLowering.cpp test/CodeGen/AArch64/neon-copyPhysReg-tuple.ll test/CodeGen/AArch64/neon-extract.ll test/CodeGen/ARM64/aarch64-neon-copyPhysReg-tuple.ll On: smooshlab-project At: Fri 18 Apr 2014 06:00:58 Changed By: tnorthover Comments: AArch64/ARM64: improve spotting of EXT instructions from VECTOR_SHUFFLE. We couldn't cope if the first mask element was UNDEF before, which isn't ideal.Properties: phase_id: r206594-t20140418_070329-b19015 File: lib/msan/tests/CMakeLists.txt On: smooshlab-project At: Fri 18 Apr 2014 06:16:41 Changed By: eugenis Comments: [msan] Add missing quotes. Properties: phase_id: r206594-t20140418_070329-b19015 File: lib/Analysis/ThreadSafety.cpp On: smooshlab-project At: Fri 18 Apr 2014 06:20:41 Changed By: aaronballman Comments: Updating to use more range-based for loops, nullptr and auto. No functional changes.Properties: phase_id: r206594-t20140418_070329-b19015 Files: lib/Target/ARM64/ARM64ISelLowering.cpp lib/Target/ARM64/ARM64TargetTransformInfo.cpp test/CodeGen/ARM64/aarch64-neon-misc.ll On: smooshlab-project At: Fri 18 Apr 2014 06:26:41 Changed By: tnorthover Comments: AArch64/ARM64: add non-scalar lowering for more FCVT operations.Properties: phase_id: r206594-t20140418_070329-b19015 Files: test/CodeGen/AArch64/neon-crypto.ll test/CodeGen/AArch64/neon-diagnostics.ll test/CodeGen/AArch64/neon-facge-facgt.ll test/CodeGen/AArch64/neon-fma.ll test/CodeGen/AArch64/neon-fpround_f128.ll test/CodeGen/AArch64/neon-frsqrt-frecp.ll test/CodeGen/AArch64/neon-halving-add-sub.ll test/CodeGen/AArch64/neon-load-store-v1i32.ll test/CodeGen/AArch64/neon-max-min-pairwise.ll test/CodeGen/AArch64/neon-max-min.ll test/CodeGen/AArch64/neon-misc-scalar.ll test/CodeGen/AArch64/neon-misc.ll test/CodeGen/AArch64/neon-mla-mls.ll test/CodeGen/AArch64/neon-mov.ll test/CodeGen/AArch64/neon-mul-div.ll test/CodeGen/AArch64/neon-or-combine.ll test/CodeGen/AArch64/neon-perm.ll test/CodeGen/AArch64/neon-rounding-halving-add.ll test/CodeGen/AArch64/neon-rounding-shift.ll test/CodeGen/AArch64/neon-saturating-add-sub.ll test/CodeGen/AArch64/neon-saturating-rounding-shift.ll test/CodeGen/AArch64/neon-saturating-shift.ll test/CodeGen/ARM64/aarch64-neon-misc.ll test/CodeGen/ARM64/aarch64-neon-mul-div.ll On: smooshlab-project At: Fri 18 Apr 2014 06:26:42 Changed By: tnorthover Comments: AArch64/ARM64: port more AArch64 tests to ARM64.Properties: phase_id: r206594-t20140418_070329-b19015 File: lib/asan/tests/asan_test.cc On: smooshlab-project At: Fri 18 Apr 2014 06:36:58 Changed By: eugenis Comments: [asan] Reenable tests that should pass since PR19207 is fixed. Properties: phase_id: r206594-t20140418_070329-b19015 Files: lib/CodeGen/TargetInfo.cpp test/CodeGen/arm64-aapcs-arguments.c On: smooshlab-project At: Fri 18 Apr 2014 06:56:41 Changed By: tnorthover Comments: ARM64: make sure the caller is expected to extend in AAPCS. This is one of those DarwinPCS differences. It'd been caught in arguments, but not return values.Properties: phase_id: r206594-t20140418_070329-b19015 Files: include/clang/Basic/Module.h include/clang/Lex/ModuleMap.h lib/Basic/Module.cpp lib/Lex/ModuleMap.cpp On: smooshlab-project At: Fri 18 Apr 2014 07:46:41 Changed By: gribozavr Comments: Add more constness to module-related APIs Properties: phase_id: r206614-t20140418_084039-b19018 Files: lib/Target/ARM64/ARM64InstrInfo.td test/CodeGen/AArch64/neon-shl-ashr-lshr.ll test/CodeGen/ARM64/vshift.ll On: smooshlab-project At: Fri 18 Apr 2014 08:06:42 Changed By: tnorthover Comments: ARM64: add extra NEG pattern.Properties: phase_id: r206614-t20140418_084039-b19018 Files: lib/Target/ARM64/ARM64AsmPrinter.cpp test/CodeGen/ARM64/subsections.ll On: smooshlab-project At: Fri 18 Apr 2014 08:06:42 Changed By: tnorthover Comments: ARM64: don't emit .subsections_via_symbols on ELF. Part of PR19455.Properties: phase_id: r206614-t20140418_084039-b19018 Files: lib/Target/ARM64/ARM64TargetMachine.cpp test/CodeGen/ARM64/collect-loh.ll On: smooshlab-project At: Fri 18 Apr 2014 08:06:42 Changed By: tnorthover Comments: ARM64: disable generation of .loh directives outside MachO. Part of PR19455.Properties: phase_id: r206614-t20140418_084039-b19018 Files: include/llvm/ADT/ScopedHashTable.h include/llvm/ADT/StringMap.h include/llvm/Support/Allocator.h On: smooshlab-project At: Fri 18 Apr 2014 08:06:42 Changed By: d0k Comments: Allocator: Remove ReferenceAdder hack. This was a workaround for compilers that had issues with reference collapsing.Properties: phase_id: r206614-t20140418_084039-b19018 Files: test/CodeGen/AArch64/neon-shift-left-long.ll test/CodeGen/AArch64/neon-shift.ll test/CodeGen/AArch64/neon-simd-ldst-multi-elem.ll test/CodeGen/AArch64/neon-simd-ldst-one.ll test/CodeGen/AArch64/neon-simd-ldst.ll test/CodeGen/ARM64/aarch64-neon-simd-ldst-one.ll On: smooshlab-project At: Fri 18 Apr 2014 08:06:42 Changed By: tnorthover Comments: AArch64/ARM64: add more NEON tests. Mostly no testing this time, since they were just wrangling target-specific intrinsics.Properties: phase_id: r206614-t20140418_084039-b19018 File: test/CodeGenCXX/microsoft-abi-vtables-multiple-nonvirtual-inheritance-no-thunks.cpp On: smooshlab-project At: Fri 18 Apr 2014 08:20:41 Changed By: timurrrr Comments: Split out the no-thunk multiple inheritance tests Also, intentionally duplicate base class definitions per test, so it's easier to copy tests while debugging failuresProperties: phase_id: r206614-t20140418_084039-b19018 Files: include/llvm/ADT/ArrayRef.h include/llvm/ADT/StringRef.h include/llvm/CodeGen/MachineValueType.h On: smooshlab-project At: Fri 18 Apr 2014 09:46:41 Changed By: d0k Comments: Make the copy member of StringRef/ArrayRef generic wrt allocators. Doesn't make sense to restrict this to BumpPtrAllocator. While there replace an explicit loop with std::equal. Some standard libraries know how to compile this down to a ::memcmp call if possible.Properties: phase_id: r206635-t20140418_125842-b19030 Files: include/llvm/MC/MCModule.h include/llvm/Support/LineIterator.h On: smooshlab-project At: Fri 18 Apr 2014 09:56:41 Changed By: d0k Comments: Add some missing includes for various standard library implementations.Properties: phase_id: r206635-t20140418_125842-b19030 File: include/llvm/Support/LineIterator.h On: smooshlab-project At: Fri 18 Apr 2014 10:06:41 Changed By: d0k Comments: LineIterator: Add DataTypes.h for int64_t on MSVC.Properties: phase_id: r206635-t20140418_125842-b19030 File: source/Plugins/Process/POSIX/POSIXThread.cpp On: smooshlab-project At: Fri 18 Apr 2014 10:10:41 Changed By: tfiala Comments: Address hung tests in Linux. Follow-up patch coming to address test failures exposed by this change. Properties: phase_id: r206635-t20140418_125842-b19030 File: test/functionalities/data-formatter/ptr_ref_typedef/TestPtrRef2Typedef.py On: smooshlab-project At: Fri 18 Apr 2014 10:16:58 Changed By: tfiala Comments: Fix TestPtrRef2Typedef with new const adornment on expected ref type. Properties: phase_id: r206635-t20140418_125842-b19030 File: test/functionalities/attach_resume/TestAttachResume.py On: smooshlab-project At: Fri 18 Apr 2014 10:16:59 Changed By: tfiala Comments: Marked TestAttachResume.process_attach_continue_interrupt_detach() as XFAIL on Linux per pr19478. Properties: phase_id: r206635-t20140418_125842-b19030 Files: test/CodeGen/SPARC/2011-01-19-DelaySlot.ll test/CodeGen/X86/atom-bypass-slow-division-64.ll On: smooshlab-project At: Fri 18 Apr 2014 10:30:41 Changed By: dexonsmith Comments: Add some target triples for better determinism These tests were failing on some buildbots after r206548 (reverted in r206556), but passing locally. They were missing target triples, so maybe that's the problem?Properties: phase_id: r206635-t20140418_125842-b19030 Files: include/llvm/Analysis/BlockFrequencyInfoImpl.h lib/Analysis/BlockFrequencyInfo.cpp lib/Analysis/BlockFrequencyInfoImpl.cpp lib/Analysis/CMakeLists.txt lib/CodeGen/MachineBlockFrequencyInfo.cpp test/Analysis/BlockFrequencyInfo/bad_input.ll test/Analysis/BlockFrequencyInfo/basic.ll test/Analysis/BlockFrequencyInfo/double_exit.ll test/Analysis/BlockFrequencyInfo/irreducible.ll test/Analysis/BlockFrequencyInfo/loop_with_branch.ll test/Analysis/BlockFrequencyInfo/nested_loop_with_branches.ll test/CodeGen/XCore/llvm-intrinsics.ll On: smooshlab-project At: Fri 18 Apr 2014 10:30:42 Changed By: dexonsmith Comments: Reapply "blockfreq: Rewrite BlockFrequencyInfoImpl" This reverts commit r206556, effectively reapplying commit r206548 and its fixups in r206549 and r206550. In an intervening commit I've added target triples to the tests that were failing remotely [1] (but passing locally). I'm hoping the mystery is solved? I'll revert this again if the tests are still failing remotely. [1]: http://bb.pgr.jp/builders/ninja-x64-msvc-RA-centos6/builds/1816Properties: phase_id: r206635-t20140418_125842-b19030 Files: lib/DebugInfo/DWARFDebugAranges.cpp lib/DebugInfo/DWARFDebugInfoEntry.cpp lib/DebugInfo/DWARFDebugInfoEntry.h lib/DebugInfo/DWARFDebugRangeList.cpp lib/DebugInfo/DWARFDebugRangeList.h lib/DebugInfo/DWARFUnit.cpp lib/DebugInfo/DWARFUnit.h On: smooshlab-project At: Fri 18 Apr 2014 10:36:41 Changed By: samsonov Comments: [DWARF parser] Refactor fetching DIE address ranges. Add a helper method to get address ranges specified in a DIE (either by DW_AT_low_pc/DW_AT_high_pc, or by DW_AT_ranges). Use it to untangle and simplify the code. No functionality change. Properties: phase_id: r206635-t20140418_125842-b19030 File: lib/CodeGen/ScheduleDAGInstrs.cpp On: smooshlab-project At: Fri 18 Apr 2014 10:46:41 Changed By: atrick Comments: Better comments to explain buffered/unbuffered processor resources.Properties: phase_id: r206635-t20140418_125842-b19030 File: lib/Analysis/BlockFrequencyInfoImpl.cpp On: smooshlab-project At: Fri 18 Apr 2014 10:46:41 Changed By: dexonsmith Comments: Fixing MSVC after r206622?Properties: phase_id: r206635-t20140418_125842-b19030 File: utils/llvm-build/llvmbuild/main.py On: smooshlab-project At: Fri 18 Apr 2014 10:50:41 Changed By: garious Comments: Fixed llvm-build when no targets are enabledProperties: phase_id: r206635-t20140418_125842-b19030 Files: include/llvm/Analysis/BlockFrequencyInfoImpl.h lib/Analysis/BlockFrequencyInfo.cpp lib/Analysis/BlockFrequencyInfoImpl.cpp lib/Analysis/CMakeLists.txt lib/CodeGen/MachineBlockFrequencyInfo.cpp test/Analysis/BlockFrequencyInfo/bad_input.ll test/Analysis/BlockFrequencyInfo/basic.ll test/Analysis/BlockFrequencyInfo/double_exit.ll test/Analysis/BlockFrequencyInfo/irreducible.ll test/Analysis/BlockFrequencyInfo/loop_with_branch.ll test/Analysis/BlockFrequencyInfo/nested_loop_with_branches.ll test/CodeGen/XCore/llvm-intrinsics.ll On: smooshlab-project At: Fri 18 Apr 2014 11:06:41 Changed By: dexonsmith Comments: Revert "blockfreq: Rewrite BlockFrequencyInfoImpl" (#2) This reverts commit r206622 and the MSVC fixup in r206626. Apparently the remotely failing tests are still failing, despite my attempt to fix the nondeterminism in r206621.Properties: phase_id: r206635-t20140418_125842-b19030 File: include/llvm/ADT/StringExtras.h On: smooshlab-project At: Fri 18 Apr 2014 11:20:41 Changed By: arsenm Comments: Fix uint -> size_t conversion warning. This warning is disabled for the LLVM build, but external users of the header can still run into this. Patch by Ke BaiProperties: phase_id: r206635-t20140418_125842-b19030 File: include/llvm/Bitcode/LLVMBitCodes.h On: smooshlab-project At: Fri 18 Apr 2014 11:30:41 Changed By: rnk Comments: Update comment in LLVMBitCodes.h to reflect the actual bitcode recordProperties: phase_id: r206635-t20140418_125842-b19030 Files: include/llvm/MC/MCAssembler.h lib/MC/ELFObjectWriter.cpp lib/MC/MCMachOStreamer.cpp lib/MC/MachObjectWriter.cpp lib/MC/WinCOFFObjectWriter.cpp On: smooshlab-project At: Fri 18 Apr 2014 11:36:41 Changed By: dblaikie Comments: Add range access to MCAssembler's symbol collection.Properties: phase_id: r206635-t20140418_125842-b19030 File: lib/DebugInfo/DWARFDebugInfoEntry.cpp On: smooshlab-project At: Fri 18 Apr 2014 12:10:41 Changed By: d0k Comments: DebugInfo: Remove some initializer lists to make MSVC happy again.Properties: phase_id: r206635-t20140418_125842-b19030 Files: lib/Target/X86/X86ISelLowering.cpp test/CodeGen/X86/vec_shuffle-41.ll On: smooshlab-project At: Fri 18 Apr 2014 12:56:41 Changed By: anemet Comments: [X86] Improve buildFromShuffleMostly for AVX For a 256-bit BUILD_VECTOR consisting mostly of shuffles of 256-bit vectors, both the BUILD_VECTOR and its operands may need to be legalized in multiple steps. Consider: (v8f32 (BUILD_VECTOR (extract_vector_elt (v8f32 %vreg0,) Constant<1>), (extract_vector_elt %vreg0, Constant<2>), (extract_vector_elt %vreg0, Constant<3>), (extract_vector_elt %vreg0, Constant<4>), (extract_vector_elt %vreg0, Constant<5>), (extract_vector_elt %vreg0, Constant<6>), (extract_vector_elt %vreg0, Constant<7>), %vreg1)) a. We can't build a 256-bit vector efficiently so, we need to split it into two 128-bit vecs and combine them with VINSERTX128. b. Operands like (extract_vector_elt (v8f32 %vreg0), Constant<7>) needs to be split into a VEXTRACTX128 and a further extract_vector_elt from the resulting 128-bit vector. c. The extract_vector_elt from b. is lowered into a shuffle to the first element and a movss. Depending on the order in which we legalize the BUILD_VECTOR and its operands[1], buildFromShuffleMostly may be faced with: (v4f32 (BUILD_VECTOR (extract_vector_elt (vector_shuffle<1,u,u,u> (extract_subvector %vreg0, Constant<4>), undef), Constant<0>), (extract_vector_elt (vector_shuffle<2,u,u,u> (extract_subvector %vreg0, Constant<4>), undef), Constant<0>), (extract_vector_elt (vector_shuffle<3,u,u,u> (extract_subvector %vreg0, Constant<4>), undef), Constant<0>), %vreg1)) In order to figure out the underlying vector and their identity we need to see through the shuffles. [1] Note that the order in which operations and their operands are legalized is only guaranteed in the first iteration of LegalizeDAG. Fixes Properties: phase_id: r206635-t20140418_125842-b19030 Files: include/llvm/ADT/ImmutableSet.h lib/Analysis/BasicAliasAnalysis.cpp lib/Analysis/CostModel.cpp On: smooshlab-project At: Fri 18 Apr 2014 12:56:41 Changed By: d0k Comments: Remove a couple of redundant copies of SmallVector::operator==. No functionality change.Properties: phase_id: r206635-t20140418_125842-b19030 Files: include/clang/Basic/OnDiskHashTable.h include/clang/Serialization/ASTReader.h include/clang/Serialization/Module.h lib/Frontend/CacheTokens.cpp lib/Lex/PTHLexer.cpp lib/Serialization/ASTReaderInternals.h lib/Serialization/ASTWriter.cpp lib/Serialization/GlobalModuleIndex.cpp On: smooshlab-project At: Fri 18 Apr 2014 13:06:41 Changed By: bogner Comments: Remove OnDiskHashTable.h, since it's been moved to llvmProperties: phase_id: r206652-t20140418_143504-b19037 Files: lib/Frontend/CacheTokens.cpp lib/Lex/PTHLexer.cpp lib/Serialization/ASTReaderInternals.h lib/Serialization/ASTWriter.cpp lib/Serialization/GlobalModuleIndex.cpp On: smooshlab-project At: Fri 18 Apr 2014 13:36:41 Changed By: bogner Comments: Teach users of OnDiskHashTable to define hash_value and offset types This paves the way to making OnDiskHashTable work with hashes that are not 32 bits wide and to making OnDiskHashTable work very large hash tables. The LLVM change to use these types is upcoming.Properties: phase_id: r206652-t20140418_143504-b19037 File: lib/DebugInfo/DWARFUnit.cpp On: smooshlab-project At: Fri 18 Apr 2014 13:40:41 Changed By: samsonov Comments: [DWARF parser] Respect address ranges specified in compile unit DIE. When address ranges for compile unit are specified in compile unit DIE itself, there is no need to collect ranges from children subprogram DIEs. This change speeds up llvm-symbolizer on Clang-produced binaries with full debug info. For instance, symbolizing a first address in a 1Gb binary is now 2x faster (1s vs. 2s). Properties: phase_id: r206652-t20140418_143504-b19037 File: include/llvm/Support/OnDiskHashTable.h On: smooshlab-project At: Fri 18 Apr 2014 13:50:41 Changed By: bogner Comments: OnDiskHashTable: Expect the Info type to declare the hash size This changes the on-disk hash to get the size of a hash value from the Info type, so that clients can be more flexible with the types of hash they use.Properties: phase_id: r206652-t20140418_143504-b19037 File: include/llvm/Support/OnDiskHashTable.h On: smooshlab-project At: Fri 18 Apr 2014 13:50:41 Changed By: bogner Comments: OnDiskHashTable: Expect the Info type to declare the offset type This changes the on-disk hash to get the type to use for offsets from the Info type, so that clients can be more flexible with the size of table they support.Properties: phase_id: r206652-t20140418_143504-b19037 File: lib/Frontend/ASTUnit.cpp On: smooshlab-project At: Fri 18 Apr 2014 13:50:41 Changed By: benlangmuir Comments: Don't read CompilerInstance fields that don't exist in ASTUnit When transferring data from a CompilerInstance in an error path we need to consider cases where the various fields are uninitialized.Properties: phase_id: r206652-t20140418_143504-b19037 File: lib/Analysis/LazyCallGraph.cpp On: smooshlab-project At: Fri 18 Apr 2014 13:56:59 Changed By: chandlerc Comments: [LCG] Fix the bugs that Ben pointed out in code review (and the MSan bot caught). Sad that we don't have warnings for these things, but bleh, no idea how to fix that.Properties: phase_id: r206652-t20140418_143504-b19037 File: test/CodeGen/X86/tls.ll On: smooshlab-project At: Fri 18 Apr 2014 14:20:41 Changed By: yrnkrn Comments: Expanded test for x86-pc-windows-gnu and x86_64-pc-windows-gnu environments. Properties: phase_id: r206652-t20140418_143504-b19037 File: docs/Passes.rst On: smooshlab-project At: Fri 18 Apr 2014 14:30:41 Changed By: rnk Comments: Remove -simplify-libcalls pass form Passes documentation This pass was removed in r184459. Also added note that the InstCombine pass does library call simplification. Patch slightly modified from one by Daniel Liew !Properties: phase_id: r206652-t20140418_143504-b19037 Files: lib/Target/ARM64/ARM64.td lib/Target/ARM64/ARM64SchedA53.td lib/Target/ARM64/ARM64SchedCyclone.td test/CodeGen/ARM64/misched-basic-A53.ll On: smooshlab-project At: Fri 18 Apr 2014 14:30:41 Changed By: mcrosier Comments: [ARM64] Ports the Cortex-A53 Machine Model description from AArch64. Summary: This port includes the rudimentary latencies that were provided for the Cortex-A53 Machine Model in the AArch64 backend. It also changes the SchedAlias for COPY in the Cyclone model to an explicit WriteRes mapping to avoid conflicts in other subtargets. Differential Revision: http://reviews.llvm.org/D3427 Patch by Dave Estes !Properties: phase_id: r206652-t20140418_143504-b19037 Files: lib/MC/ELFObjectWriter.cpp test/MC/ELF/compression.s On: smooshlab-project At: Fri 18 Apr 2014 14:36:41 Changed By: dblaikie Comments: Update the fragments of symbols in compressed sections. While unnamed relocations are already cached in side tables in ELFObjectWriter::RecordRelocation, symbols still need their fragments updated to refer to the newly compressed fragment (even if that fragment isn't big enough to fit the offset). Even though we only create temporary symbols in debug info sections this comes up in 32 bit builds where even temporary symbols in mergeable sections (such as debug_str) have to be emitted as named symbols. I tried a few other ways to do this but they all didn't work for various reasons: 1) Canonicalize the MCSymbolData in RecordRelocation, nulling out the Fragment (so it didn't have to be updated by CompressDebugSection). This doesn't work because some code relies on symbols having fragments to indicate that they're defined, I think. 2) Canonicalize the MCSymbolData in RecordRelocation to be "first fragment + absolute offset" so it would be cheaper to just test and update the fragment in CompressDebugSections. This doesn't work because the offset computed in RecordRelocation isn't that of the symbol's fragment, it's the passed in fragment (I haven't figured out what that fragment is - perhaps it's the location where the relocation is to be written). And if the fragment offset has to be computed only for this use we might as well just do it when we need to, in CompressDebugSection. I also added an assert to help catch this a bit more clearly, even though it is UB. The test case improvements would either assert fail and/or valgrind vail without the fix, even if they wouldn't necessarily fail the FileCheck output.Properties: phase_id: r206659-t20140418_151017-b19040 Files: include/llvm/DebugInfo/DIContext.h lib/DebugInfo/DWARFContext.cpp tools/llvm-dwarfdump/llvm-dwarfdump.cpp tools/llvm-objdump/MachODump.cpp tools/llvm-rtdyld/llvm-rtdyld.cpp tools/llvm-symbolizer/LLVMSymbolize.cpp On: smooshlab-project At: Fri 18 Apr 2014 14:46:41 Changed By: samsonov Comments: [DWARF parser] Turn DILineInfo into a struct. Immutable DILineInfo doesn't bring any benefits and complicates code. Also, use std::string instead of SmallString<16> for file and function names - their length can vary significantly. No functionality change. Properties: phase_id: r206659-t20140418_151017-b19040 Files: CMakeLists.txt cmake/config-ix.cmake cmake/modules/AddSphinxTarget.cmake cmake/modules/FindSphinx.cmake docs/CMakeLists.txt On: smooshlab-project At: Fri 18 Apr 2014 14:56:41 Changed By: rnk Comments: Added Sphinx documentation generation to CMake build system. The option LLVM_ENABLE_SPHINX option enables the "docs-llvm-html", "docs-llvm-man" targets but does not build them by default. The following CMake options have been added that control what targets are made available SPHINX_OUTPUT_HTML SPHINX_OUTPUT_MAN If LLVM_BUILD_DOCS is enabled then the enabled docs-llvm-* targets will be built by default and if ``make install`` is run then docs-llvm-html and docs-llvm-man will be installed (tested on Linux only). The add_sphinx_target function is in its own file so it can be included by other projects that use Sphinx for their documentation. Patch by Daniel Liew !Properties: phase_id: r206659-t20140418_151017-b19040 Files: include/llvm/ProfileData/InstrProf.h include/llvm/ProfileData/InstrProfReader.h include/llvm/ProfileData/InstrProfWriter.h lib/ProfileData/InstrProf.cpp lib/ProfileData/InstrProfIndexed.h lib/ProfileData/InstrProfReader.cpp lib/ProfileData/InstrProfWriter.cpp test/tools/llvm-profdata/errors.test test/tools/llvm-profdata/simple.test tools/llvm-profdata/llvm-profdata.cpp On: smooshlab-project At: Fri 18 Apr 2014 15:00:41 Changed By: bogner Comments: ProfileData: Add support for the indexed instrprof format This adds support for an indexed instrumentation based profiling format, which is just a small header and an on disk hash table. This format will be used by clang's -fprofile-instr-use= for PGO.Properties: phase_id: r206659-t20140418_151017-b19040 File: lib/CodeGen/CodeGenPGO.cpp On: smooshlab-project At: Fri 18 Apr 2014 15:00:41 Changed By: bogner Comments: [Cleanup] Remove a trailing whitespaceProperties: phase_id: r206659-t20140418_151017-b19040 Files: lib/CodeGen/CMakeLists.txt lib/CodeGen/CodeGenModule.cpp lib/CodeGen/CodeGenModule.h lib/CodeGen/CodeGenPGO.cpp lib/CodeGen/CodeGenPGO.h tools/driver/CMakeLists.txt tools/driver/Makefile On: smooshlab-project At: Fri 18 Apr 2014 15:00:41 Changed By: bogner Comments: CodeGen: Use LLVM's InstrProfReader in -fprofile-instr-use= Update clang to use the InstrProfReader from LLVM to read instrumentation based profile data. This also switches us from the naive text format to the binary format, since that's what's implemented in the reader.Properties: phase_id: r206659-t20140418_151017-b19040 Files: lib/MC/ELFObjectWriter.cpp test/MC/ELF/compression.s On: smooshlab-project At: Fri 18 Apr 2014 15:00:41 Changed By: dblaikie Comments: Compress debug sections only when beneficial. Both ZLIB and the debug info compressed section header ("ZLIB" + the size of the uncompressed data) take some constant overhead so in some cases the compressed data is actually larger than the uncompressed data. In these cases, just don't compress or rename the section at all.Properties: phase_id: r206659-t20140418_151017-b19040 LOGS: From llvm-testresults at cs.uiuc.edu Fri Apr 18 23:25:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 01:25:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140419062511.00DCC2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24737?compare_to=24727&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24737, Order: 206678, Start Time: 2014-04-19 01:43:19, End Time: 2014-04-19 06:31:45 To: 24727, Order: 206637, Start Time: 2014-04-18 20:44:11, End Time: 2014-04-19 01:33:07 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (141 on baseline) Performance Improvements: 24 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1076 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/globalrefs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/ms_struct_pack_layout: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 21.43% (0.0560 => 0.0680, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.81% (0.1080 => 0.1240, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 13.33% (0.1200 => 0.1360, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 5.00% (0.5600 => 0.5880, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.52% (0.1840 => 0.1960, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.17% (0.4640 => 0.4880, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.71% (2.0681 => 2.0121, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.54% (2.0441 => 1.9921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.33% (2.0561 => 2.0081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.06% (2.1321 => 2.0881, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (2.1521 => 2.1081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.03% (2.1681 => 2.1241, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.92% (2.0881 => 2.0481, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.91% (2.0921 => 2.0521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.90% (2.1041 => 2.0641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.89% (2.1201 => 2.0801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.86% (2.3681 => 2.3241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.82% (2.2001 => 2.1601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.81% (2.2041 => 2.1641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.75% (2.0521 => 2.0161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.69% (2.1241 => 2.0881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.55% (2.0641 => 2.0321, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.55% (2.0641 => 2.0321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.50% (2.4001 => 2.3641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.45% (2.2081 => 2.1761, std.dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.45% (10.5082 => 10.3562, std.dev.: 0.0505) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.35% (2.0681 => 2.0401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.28% (2.1841 => 2.1561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.09% (2.2081 => 2.1841, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.03% (3.1082 => 3.0762, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0035) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.39% (0.1640 => 0.2040, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.72% (1.7441 => 2.0881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.52% (1.6801 => 2.0081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.30% (1.7201 => 2.0521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.26% (1.7241 => 2.0561, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.14% (1.6721 => 1.9921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.07% (1.7201 => 2.0481, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.63% (1.6961 => 2.0121, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.96% (1.9601 => 2.3121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/ffbench: 17.24% (0.1160 => 0.1360, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 16.99% (0.6120 => 0.7160, std.dev.: 0.0235) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.67% (0.1200 => 0.1400, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.81% (0.1080 => 0.1240, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0091) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 9.68% (0.1240 => 0.1360, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/08-main/main: 6.90% (0.3480 => 0.3720, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2360 => 0.2520, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (3.5002 => 3.7362, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.31% (11.7880 => 12.5320, std.dev.: 0.0552) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0051) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.64% (1.3480 => 1.4240, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.61% (0.7840 => 0.8280, std.dev.: 0.0146) MultiSource/Applications/hexxagon/hexxagon: 5.59% (1.1440 => 1.2080, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.42% (6.7200 => 7.0840, std.dev.: 0.0573) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0069) MultiSource/Applications/d/make_dparser: 4.64% (3.9641 => 4.1481, std.dev.: 0.0233) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.19% (1.2400 => 1.2920, std.dev.: 0.0194) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0308) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0181) MultiSource/Applications/oggenc/oggenc: 3.88% (6.9124 => 7.1804, std.dev.: 0.0255) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (9.9842 => 10.3562, std.dev.: 0.0505) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.67% (1.4160 => 1.4680, std.dev.: 0.0187) MultiSource/Applications/treecc/treecc: 3.66% (2.6200 => 2.7160, std.dev.: 0.0158) MultiSource/Applications/SPASS/SPASS: 3.53% (18.4924 => 19.1445, std.dev.: 0.0375) MultiSource/Applications/JM/ldecod/ldecod: 3.49% (10.3203 => 10.6804, std.dev.: 0.0484) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.22% (6.8321 => 7.0521, std.dev.: 0.0419) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0086) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.73% (51.1089 => 52.5049, std.dev.: 0.1164) MultiSource/Applications/kimwitu++/kc: 2.70% (19.7371 => 20.2691, std.dev.: 0.0666) MultiSource/Applications/JM/lencod/lencod: 2.62% (22.6287 => 23.2208, std.dev.: 0.0569) MultiSource/Benchmarks/Bullet/bullet: 2.36% (38.9366 => 39.8566, std.dev.: 0.0685) MultiSource/Applications/ClamAV/clamscan: 2.21% (20.2445 => 20.6925, std.dev.: 0.0551) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (3.0122 => 3.0762, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (16.5963 => 16.9203, std.dev.: 0.0575) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0322) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 1.45% (25.1895 => 25.5536, std.dev.: 0.0427) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.83% (1.2681 => 1.4561, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 13.85% (0.2600 => 0.2960, std.dev.: 0.0132) MultiSource/Applications/siod/siod: 12.45% (2.8282 => 3.1802, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.87% (1.6521 => 1.7161, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0126) MultiSource/Applications/minisat/minisat: 3.23% (6.8204 => 7.0404, std.dev.: 0.0620) MultiSource/Applications/sqlite3/sqlite3: 3.23% (4.0923 => 4.2243, std.dev.: 0.0189) MultiSource/Applications/lua/lua: 2.75% (21.6534 => 22.2494, std.dev.: 0.0845) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: -81.59% (10.9087 => 2.0081, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/nestedloop: -60.19% (2.9642 => 1.1801, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.95% (1.5881 => 1.1601, std.dev.: 0.0118) MultiSource/Applications/sgefa/sgefa: -22.63% (0.7600 => 0.5880, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: -21.91% (2.6481 => 2.0680, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -17.07% (0.1640 => 0.1360, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.74% (7.4801 => 6.2280, std.dev.: 0.0651) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.31% (7.5041 => 6.2800, std.dev.: 0.0585) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -3.46% (13.5243 => 13.0563, std.dev.: 0.0383) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.44% (21.6534 => 17.8771, std.dev.: 0.0324) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (0.9281 => 0.8561, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (5.1603 => 5.0003, std.dev.: 0.0344) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: -1.64% (8.3085 => 8.1725, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -1.17% (11.6527 => 11.5167, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 01:49:02 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 01:49:02 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140419084906.1D1014FAC056@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/735 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 206587 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmprYFlzSexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmprYFlzSexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpdnEZDSexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpdnEZDSexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Sat Apr 19 02:24:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 04:24:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419092423.75BFA2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24738?compare_to=24736&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24738, Order: 206682, Start Time: 2014-04-19 04:51:02, End Time: 2014-04-19 09:30:50 To: 24736, Order: 206678, Start Time: 2014-04-19 01:22:03, End Time: 2014-04-19 06:02:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (106 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 8.93% (0.2240 => 0.2440, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.63% (1.2161 => 1.2481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.76% (1.3601 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.55% (1.2921 => 1.3121, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (6.3600 => 6.4480, std.dev.: 0.0286) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 21.74% (0.0920 => 0.1120, std.dev.: 0.0056) MultiSource/Applications/obsequi/Obsequi: 1.54% (2.0801 => 2.1121, std.dev.: 0.0113) SingleSource/Benchmarks/McGill/chomp: 1.45% (1.1041 => 1.1201, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0038) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Treesort: 44.44% (0.0360 => 0.0520, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0141) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0627) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (6.0160 => 6.4480, std.dev.: 0.0286) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.3760 => 1.4480, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0239) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0533) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.9200 => 5.1280, std.dev.: 0.0438) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0409) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0342) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.36% (1.5480 => 1.6000, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0312) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0298) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0555) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0402) MultiSource/Applications/sqlite3/sqlite3: 2.59% (23.7574 => 24.3735, std.dev.: 0.0371) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.39% (48.1088 => 49.2610, std.dev.: 0.0739) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 2.07% (37.0925 => 37.8606, std.dev.: 0.0751) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 1.70% (18.8170 => 19.1370, std.dev.: 0.0502) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0141) MultiSource/Applications/treecc/treecc: 1.63% (2.4480 => 2.4880, std.dev.: 0.0131) MultiSource/Applications/SPASS/SPASS: 1.57% (17.5484 => 17.8244, std.dev.: 0.0372) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0564) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0045) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 13.05% (2.8802 => 3.2562, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (25.8896 => 26.9257, std.dev.: 0.0381) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0049) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 2.63% (21.1533 => 21.7094, std.dev.: 0.1460) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0176) MultiSource/Applications/obsequi/Obsequi: 2.13% (2.0681 => 2.1121, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.84% (5.0123 => 5.1043, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.0643 => 4.1323, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0032) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0534) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.88% (0.3400 => 0.3200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 02:55:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 04:55:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419095518.D19DC2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24739?compare_to=24732&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24739, Order: 206682, Start Time: 2014-04-19 05:19:00, End Time: 2014-04-19 10:01:54 To: 24732, Order: 206673, Start Time: 2014-04-19 00:23:21, End Time: 2014-04-19 05:06:07 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (154 on baseline) Performance Improvements: 9 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1087 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.75% (0.2440 => 0.2800, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.8400 => 0.8640, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.89% (1.4801 => 1.5081, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (6.7120 => 6.8280, std.dev.: 0.0293) SingleSource/Benchmarks/Misc-C++/bigfib: 1.58% (0.7600 => 0.7720, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.55% (1.8081 => 1.8361, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 26.09% (0.0920 => 0.1160, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.85% (0.3120 => 0.3240, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.89% (1.1081 => 1.1401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.38% (5.0523 => 5.1723, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 2.00% (4.0083 => 4.0883, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1283 => 4.2043, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.3081 => 1.3321, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.44% (4.7203 => 4.7883, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.40% (4.7123 => 4.5523, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.55% (1.7281 => 1.6841, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (2.9762 => 2.9162, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0224) SingleSource/Benchmarks/McGill/queens: -1.97% (2.2281 => 2.1841, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -1.85% (11.7047 => 11.4887, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.38% (4.0643 => 4.0083, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: -1.28% (9.3406 => 9.2206, std.dev.: 0.0251) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0118) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0074) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0049) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0640 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 12.73% (0.6600 => 0.7440, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.14% (1.6521 => 1.8361, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: 9.21% (1.8680 => 2.0400, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.91% (1.4161 => 1.5281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.7680 => 0.8240, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0139) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.81% (1.1160 => 1.1920, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0489) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.91% (11.6440 => 12.3320, std.dev.: 0.0871) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (9.4842 => 9.9922, std.dev.: 0.0630) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (5.8121 => 6.0961, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 4.48% (5.3600 => 5.6000, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.0443 => 10.4923, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.5480 => 1.6160, std.dev.: 0.0260) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.4640 => 1.5280, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (6.5440 => 6.8280, std.dev.: 0.0293) MultiSource/Applications/treecc/treecc: 4.33% (2.5840 => 2.6960, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 4.28% (21.9606 => 22.9008, std.dev.: 0.0426) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (6.5080 => 6.7800, std.dev.: 0.0540) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 4.07% (6.9844 => 7.2685, std.dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0144) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.56% (50.0290 => 51.8090, std.dev.: 0.1221) MultiSource/Applications/hexxagon/hexxagon: 3.55% (1.1280 => 1.1680, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0203) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 3.05% (38.4046 => 39.5766, std.dev.: 0.0807) MultiSource/Applications/SPASS/SPASS: 2.99% (18.4404 => 18.9925, std.dev.: 0.0537) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: 2.92% (19.0444 => 19.6003, std.dev.: 0.0763) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0195) MultiSource/Applications/kimwitu++/kc: 2.44% (19.6891 => 20.1691, std.dev.: 0.0276) MultiSource/Applications/lambda-0_1_3/lambda: 2.37% (0.8440 => 0.8640, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (16.3483 => 16.7243, std.dev.: 0.0667) MultiSource/Applications/sqlite3/sqlite3: 1.31% (25.6856 => 26.0216, std.dev.: 0.0315) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7922 => 2.8282, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (13.0563 => 13.2163, std.dev.: 0.0346) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0236) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0336) SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.28% (2.1401 => 2.4242, std.dev.: 0.0456) MultiSource/Applications/siod/siod: 11.05% (2.8602 => 3.1762, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 2.61% (3.9842 => 4.0883, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (3.9922 => 4.0963, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (4.1003 => 4.2043, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 2.28% (6.6684 => 6.8204, std.dev.: 0.0477) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.88% (21.7374 => 22.1454, std.dev.: 0.1462) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.3161 => 1.3321, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 1.18% (8.1245 => 8.2205, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.16% (2.9442 => 0.9080, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.20% (91.8497 => 49.4191, std.dev.: 10.8493) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.43% (50.3031 => 32.9821, std.dev.: 0.1818) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.41% (26.0616 => 17.0931, std.dev.: 0.1397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.51% (42.1466 => 28.4458, std.dev.: 0.5771) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1117) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: -10.59% (0.3400 => 0.3040, std.dev.: 0.0127) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0069) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.81% (4.1243 => 4.0083, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0224) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.79% (2.4602 => 2.4162, std.dev.: 0.0108) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3561 => 2.3161, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0141) MultiSource/Benchmarks/mafft/pairlocalalign: -1.23% (26.6977 => 26.3696, std.dev.: 0.0439) MultiSource/Benchmarks/sim/sim: -1.00% (4.7883 => 4.7403, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 03:26:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 05:26:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140419102657.8E3042A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24740?compare_to=24733&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24740, Order: 206682, Start Time: 2014-04-19 05:50:17, End Time: 2014-04-19 10:33:32 To: 24733, Order: 206674, Start Time: 2014-04-19 00:54:41, End Time: 2014-04-19 05:37:26 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 20 (158 on baseline) Performance Improvements: 6 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1086 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 14.29% (0.0840 => 0.0960, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.00% (0.7600 => 0.8360, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.21% (1.4481 => 1.4801, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 2.08% (1.7281 => 1.7641, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.79% (1.7840 => 1.8160, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 1.51% (5.5480 => 5.6320, std.dev.: 0.0312) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7682 => 2.8082, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (6.0841 => 6.1481, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.72% (0.9521 => 1.0161, std.dev.: 0.0181) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.85% (0.3120 => 0.3240, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.64% (4.0843 => 4.1923, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 2.06% (3.1122 => 3.1762, std.dev.: 0.0163) MultiSource/Applications/sqlite3/sqlite3: 1.25% (4.1483 => 4.2003, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2560 => 0.2400, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -3.46% (5.2003 => 5.0203, std.dev.: 0.0205) SingleSource/Benchmarks/McGill/queens: -2.66% (2.2561 => 2.1961, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.58% (4.1883 => 4.0803, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.40% (5.1683 => 5.0443, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0137) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0080) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: 327.63% (0.2320 => 0.9921, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 190.48% (0.2520 => 0.7320, std.dev.: 0.0187) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0056) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0055) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0088) SingleSource/Regression/C/test_indvars: 100.00% (0.0320 => 0.0640, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: 62.50% (0.0320 => 0.0520, std.dev.: 0.0031) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0056) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0062) MultiSource/Applications/obsequi/Obsequi: 43.97% (1.3920 => 2.0040, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/salsa20: 40.00% (0.0600 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 31.58% (0.0760 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0093) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0140) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.47% (1.1761 => 1.4521, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.50% (0.1600 => 0.1960, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.77% (1.1361 => 1.3721, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.52% (1.2281 => 1.4801, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.08% (1.1321 => 1.3481, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.00% (1.2841 => 1.5281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 18.42% (8.5802 => 10.1603, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.51% (1.1881 => 1.3961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: 15.64% (19.5406 => 22.5967, std.dev.: 0.0629) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.22% (5.3360 => 6.1481, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0160) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.7400 => 1.9560, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0080) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.11% (0.4320 => 0.4800, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 9.04% (6.2844 => 6.8524, std.dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: 8.99% (11.3843 => 12.4083, std.dev.: 0.0478) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.73% (5.7280 => 6.2280, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (11.4440 => 12.3800, std.dev.: 0.0574) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (5.6680 => 6.1000, std.dev.: 0.0478) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.47% (9.5802 => 10.2002, std.dev.: 0.0653) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.42% (0.8721 => 0.9281, std.dev.: 0.0050) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (1.1240 => 1.1920, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 4.95% (4.7720 => 5.0080, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.85% (1.7320 => 1.8160, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.82% (0.3320 => 0.3480, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 4.61% (5.3840 => 5.6320, std.dev.: 0.0312) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.51% (6.8280 => 7.1360, std.dev.: 0.0379) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0206) MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (1.6961 => 1.7641, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0136) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.58% (49.1529 => 50.9129, std.dev.: 0.0880) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0170) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.26% (2.2081 => 2.2801, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.7600 => 1.8160, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.4320 => 1.4760, std.dev.: 0.0128) MultiSource/Applications/ClamAV/clamscan: 3.02% (19.2243 => 19.8044, std.dev.: 0.0639) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (2.7282 => 2.8082, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 2.65% (24.7575 => 25.4135, std.dev.: 0.0306) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.39% (1.3400 => 1.3720, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 2.15% (19.7491 => 20.1731, std.dev.: 0.0434) MultiSource/Benchmarks/Bullet/bullet: 1.67% (39.0726 => 39.7246, std.dev.: 0.0807) MultiSource/Applications/treecc/treecc: 1.51% (2.6480 => 2.6880, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.42% (1.2401 => 1.4561, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0175) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0217) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 3.55% (4.0563 => 4.2003, std.dev.: 0.0187) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0377) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 2.68% (7.3085 => 7.5045, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0162) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (25.4536 => 25.7736, std.dev.: 0.0278) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -18.94% (8.9566 => 7.2605, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.74% (21.6534 => 17.8131, std.dev.: 0.0727) SingleSource/Benchmarks/Linpack/linpack-pc: -16.39% (7.8605 => 6.5724, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -9.10% (3.4722 => 3.1562, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0945) SingleSource/Benchmarks/BenchmarkGame/n-body: -6.07% (1.7121 => 1.6081, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 03:38:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 05:38:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140419103858.698792A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24741?compare_to=24734&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24741, Order: 206682, Start Time: 2014-04-19 05:59:30, End Time: 2014-04-19 10:45:33 To: 24734, Order: 206676, Start Time: 2014-04-19 01:00:42, End Time: 2014-04-19 05:46:48 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 19 (134 on baseline) Performance Improvements: 6 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1087 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/IntMM: 71.43% (0.0280 => 0.0480, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.87% (0.3560 => 0.3840, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 6.90% (0.3480 => 0.3720, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: 3.84% (1.5640 => 1.6240, std.dev.: 0.0183) MultiSource/Benchmarks/sim/sim: 3.16% (0.3800 => 0.3920, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.7560 => 0.7760, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.8401 => 1.8761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.13% (2.1161 => 2.1401, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.05% (6.8360 => 6.9080, std.dev.: 0.0260) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.85% (0.3120 => 0.3240, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 3.01% (3.9962 => 4.1163, std.dev.: 0.0185) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/NPB-serial/is/is: -14.81% (0.1080 => 0.0920, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.02% (4.8763 => 4.6803, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.72% (3.8202 => 3.7162, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.31% (2.7722 => 2.7082, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -1.98% (11.7247 => 11.4927, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/queens: -1.80% (2.2241 => 2.1841, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.86% (17.6723 => 19.7684, std.dev.: 0.0609) MultiSource/Applications/sqlite3/sqlite3: 1427.06% (1.7001 => 25.9616, std.dev.: 0.0215) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.66% (50.1010 => 51.9370, std.dev.: 0.0799) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.80% (1.0520 => 1.0920, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (11.3920 => 12.3600, std.dev.: 0.0846) SingleSource/Benchmarks/Misc/oourafft: -73.19% (11.3407 => 3.0402, std.dev.: 0.0108) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.0960, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1163, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7124, std.dev.: 0.0145) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0062) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/random: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 17.07% (1.8281 => 2.1401, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.95% (1.8561 => 2.1521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.91% (1.8601 => 2.1561, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.82% (1.8201 => 2.1081, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.19% (2.0281 => 2.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.34% (1.9241 => 2.2001, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 14.29% (0.1400 => 0.1600, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.98% (0.3720 => 0.4240, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.64% (2.1121 => 2.4001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.06% (2.1441 => 2.4242, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.94% (0.3400 => 0.3840, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.69% (1.7961 => 2.0241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.41% (1.7721 => 1.9921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.15% (1.8441 => 2.0681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.83% (1.8601 => 2.0801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.60% (2.0681 => 2.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.50% (2.0521 => 2.2881, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2280 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0061) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.60% (6.4800 => 6.9080, std.dev.: 0.0260) MultiSource/Applications/Burg/burg: 6.28% (1.5280 => 1.6240, std.dev.: 0.0183) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0201) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.49% (1.7480 => 1.8440, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/moments: 5.45% (0.4400 => 0.4640, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.12% (1.5640 => 1.6440, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.01% (5.8281 => 6.1201, std.dev.: 0.0271) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 4.26% (0.3760 => 0.3920, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.96% (9.6042 => 9.9842, std.dev.: 0.0559) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (10.2283 => 10.6284, std.dev.: 0.0450) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (6.5320 => 6.7840, std.dev.: 0.0494) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.76% (2.3401 => 2.4282, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0190) MultiSource/Applications/lua/lua: 3.51% (4.7920 => 4.9600, std.dev.: 0.0344) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (5.3960 => 5.5800, std.dev.: 0.0528) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (6.5360 => 6.7440, std.dev.: 0.0372) MultiSource/Applications/treecc/treecc: 3.09% (2.5880 => 2.6680, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (16.3003 => 16.7923, std.dev.: 0.0402) MultiSource/Applications/JM/lencod/lencod: 2.93% (22.2206 => 22.8727, std.dev.: 0.0283) MultiSource/Applications/oggenc/oggenc: 2.78% (7.0524 => 7.2485, std.dev.: 0.0194) MultiSource/Benchmarks/Bullet/bullet: 2.70% (38.6366 => 39.6806, std.dev.: 0.0498) MultiSource/Applications/SPASS/SPASS: 2.68% (18.5284 => 19.0246, std.dev.: 0.0450) MultiSource/Applications/d/make_dparser: 2.52% (3.9761 => 4.0761, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: 2.06% (19.8291 => 20.2371, std.dev.: 0.0395) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (13.0363 => 13.1723, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0409) MultiSource/Applications/siod/siod: 11.03% (2.8642 => 3.1802, std.dev.: 0.0193) MultiSource/Benchmarks/llubenchmark/llu: 4.58% (5.0603 => 5.2923, std.dev.: 0.0645) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.15% (6.5964 => 6.8044, std.dev.: 0.0301) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: 2.79% (1.2881 => 1.3241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.30% (4.0003 => 4.0523, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.73% (10.4007 => 2.0041, std.dev.: 0.0341) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.99% (94.8339 => 49.3191, std.dev.: 10.1999) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.89% (49.9431 => 33.0181, std.dev.: 0.1481) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.48% (25.7136 => 17.1051, std.dev.: 0.1541) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.37% (37.0863 => 28.4178, std.dev.: 0.3768) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1104) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.66% (7.8165 => 6.7484, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.32% (2.7482 => 2.4922, std.dev.: 0.0770) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.31% (2.7722 => 2.7082, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (4.1123 => 4.0483, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.47% (2.4522 => 2.4162, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 03:43:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 05:43:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419104348.A84802A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24742?compare_to=24738&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24742, Order: 206683, Start Time: 2014-04-19 06:05:51, End Time: 2014-04-19 10:50:22 To: 24738, Order: 206682, Start Time: 2014-04-19 04:51:02, End Time: 2014-04-19 09:30:50 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (104 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/mason/mason: 30.77% (0.0520 => 0.0680, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 20.00% (0.1000 => 0.1200, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.05% (0.0840 => 0.1000, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.50% (0.1280 => 0.1440, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.33% (0.1920 => 0.2080, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 5.00% (0.3200 => 0.3360, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.00% (4.6723 => 4.8123, std.dev.: 0.0249) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/lowercase: -62.50% (0.0320 => 0.0120, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (6.0160 => 6.4600, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0942) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 5.04% (4.5200 => 4.7480, std.dev.: 0.0279) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0518) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0213) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0195) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (5.8400 => 6.0480, std.dev.: 0.0272) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0601) MultiSource/Applications/JM/lencod/lencod: 3.32% (17.6165 => 18.2005, std.dev.: 0.0511) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 2.91% (23.7574 => 24.4495, std.dev.: 0.0464) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0315) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.53% (48.1088 => 49.3250, std.dev.: 0.0756) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9126, std.dev.: 0.0650) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (2.5882 => 2.6402, std.dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1451, std.dev.: 0.0541) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0131) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0151) MultiSource/Applications/ClamAV/clamscan: 1.01% (17.4082 => 17.5842, std.dev.: 0.0579) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (25.8896 => 26.9297, std.dev.: 0.0242) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (1.3481 => 1.4001, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.37% (1.6601 => 1.7161, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0102) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 2.42% (21.1533 => 21.6654, std.dev.: 0.0888) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.43% (4.7443 => 4.8123, std.dev.: 0.0249) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.0643 => 4.1203, std.dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0106) MultiSource/Benchmarks/Fhourstones/fhourstones: -9.09% (0.1760 => 0.1600, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.98% (1.2601 => 1.1721, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 03:50:39 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 03:50:39 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-RA Message-ID: <20140419105058.4BFE94FACDA4@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-RA/builds/6770 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206683 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17772 of 17773) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17773 of 17773) 1 warning(s) in tests. Testing Time: 431.85s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17623 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 03:50:39 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 03:50:39 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-RA Message-ID: <20140419105058.4B20A4FACDA3@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-RA/builds/6770 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206683 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17772 of 17773) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17773 of 17773) 1 warning(s) in tests. Testing Time: 431.85s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17623 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Sat Apr 19 03:53:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 05:53:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419105334.38CC92A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24743?compare_to=24735&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24743, Order: 206683, Start Time: 2014-04-19 06:13:08, End Time: 2014-04-19 11:00:08 To: 24735, Order: 206677, Start Time: 2014-04-19 01:13:55, End Time: 2014-04-19 06:00:27 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1091 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-26-Shorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) MultiSource/Benchmarks/BitBench/five11/five11: 18.75% (0.0640 => 0.0760, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 13.46% (0.2080 => 0.2360, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.43% (0.1400 => 0.1560, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.81% (0.1480 => 0.1640, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ReedSolomon: 6.67% (0.2400 => 0.2560, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 4.12% (0.3880 => 0.4040, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (1.2720 => 1.3200, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/moments: 3.60% (0.4440 => 0.4600, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.85% (1.7321 => 1.7641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.51% (1.8561 => 1.8841, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.44% (12.4600 => 12.6400, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.39% (1.7321 => 1.7561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.36% (1.7681 => 1.7921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.34% (1.7881 => 1.8121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.14% (2.1121 => 2.1361, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/nestedloop: 1.11% (1.4401 => 1.4561, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.44% (1.1081 => 1.1241, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0128) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 04:26:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 06:26:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140419112645.E8C3C2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24744?compare_to=24737&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24744, Order: 206683, Start Time: 2014-04-19 06:44:21, End Time: 2014-04-19 11:33:21 To: 24737, Order: 206678, Start Time: 2014-04-19 01:43:19, End Time: 2014-04-19 06:31:45 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 31 (133 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1081 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-LocalTypeTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-22-VarSizeArray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 40.00% (0.0400 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.76% (0.1360 => 0.1520, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 11.76% (0.1360 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.43% (0.1400 => 0.1560, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.45% (1.5400 => 1.6240, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.54% (2.0481 => 2.1001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.19% (2.0121 => 2.0561, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.04% (0.5880 => 0.6000, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.92% (2.0841 => 2.1241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.75% (2.0561 => 2.0921, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (1.7481 => 1.7761, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.59% (2.0081 => 2.0401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.57% (2.0321 => 2.0641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.52% (2.1081 => 2.1401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.49% (2.1481 => 2.1801, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.43% (10.3562 => 10.5042, std.dev.: 0.0528) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.41% (7.0840 => 7.1840, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.39% (2.0161 => 2.0441, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.38% (1.1601 => 1.1761, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.35% (2.0681 => 2.0961, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.29% (2.1761 => 2.2041, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 1.28% (5.6400 => 5.7120, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.15% (2.0801 => 2.1041, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0563 => 13.1883, std.dev.: 0.0305) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 21.74% (0.0920 => 0.1120, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bisort/bisort: 2.16% (0.7400 => 0.7560, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0051) SingleSource/UnitTests/member-function-pointers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/strcat: 100.00% (0.0200 => 0.0400, std.dev.: 0.0027) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.58% (1.6961 => 2.0961, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.63% (1.7321 => 2.1241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.27% (1.6881 => 2.0641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 22.09% (1.7201 => 2.1001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 22.06% (1.6681 => 2.0361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.96% (1.6761 => 2.0441, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.43% (1.6801 => 2.0401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.34% (1.7241 => 2.0921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.29% (1.6721 => 2.0281, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.28% (1.6921 => 2.0521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.23% (1.6961 => 2.0561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.16% (1.7201 => 2.0841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.04% (1.7681 => 2.1401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.84% (1.8041 => 2.1801, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.76% (1.7921 => 2.1641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.61% (1.9801 => 2.3881, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.59% (1.7481 => 2.1081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.57% (1.8281 => 2.2041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.52% (1.9881 => 2.3961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.13% (1.8881 => 2.2681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.94% (1.9641 => 2.3361, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.38% (1.9801 => 2.3441, std.dev.: 0.0091) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 9.43% (0.2120 => 0.2320, std.dev.: 0.0076) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 8.24% (1.0200 => 1.1040, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.5560 => 0.6000, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2080 => 0.2240, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.90% (6.7200 => 7.1840, std.dev.: 0.0386) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (3.5002 => 3.7362, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.56% (1.5240 => 1.6240, std.dev.: 0.0144) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (11.7880 => 12.5240, std.dev.: 0.0683) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0199) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0097) MultiSource/Applications/hexxagon/hexxagon: 5.59% (1.1440 => 1.2080, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (1.7280 => 1.8240, std.dev.: 0.0213) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (9.9842 => 10.5042, std.dev.: 0.0528) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0149) MultiSource/Applications/lua/lua: 4.84% (4.7920 => 5.0240, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.84% (0.2480 => 0.2600, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 4.73% (1.1000 => 1.1520, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.52% (1.2400 => 1.2960, std.dev.: 0.0201) MultiSource/Applications/oggenc/oggenc: 4.52% (6.9124 => 7.2245, std.dev.: 0.0144) MultiSource/Applications/d/make_dparser: 4.44% (3.9641 => 4.1401, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.22% (6.8321 => 7.1201, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0187) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.3203 => 10.7284, std.dev.: 0.0381) MultiSource/Applications/SPASS/SPASS: 3.85% (18.4924 => 19.2046, std.dev.: 0.0311) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 3.57% (22.6287 => 23.4367, std.dev.: 0.0351) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.01% (51.1089 => 52.6449, std.dev.: 0.1011) MultiSource/Benchmarks/MallocBench/gs/gs: 2.96% (5.5480 => 5.7120, std.dev.: 0.0252) MultiSource/Applications/kimwitu++/kc: 2.80% (19.7371 => 20.2891, std.dev.: 0.0396) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0108) MultiSource/Benchmarks/Bullet/bullet: 2.48% (38.9366 => 39.9006, std.dev.: 0.0643) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (1.0001 => 1.0241, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (16.5963 => 16.9883, std.dev.: 0.0610) MultiSource/Applications/ClamAV/clamscan: 2.33% (20.2445 => 20.7165, std.dev.: 0.0596) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: 2.00% (25.1895 => 25.6936, std.dev.: 0.0372) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0244 => 6.1044, std.dev.: 0.0256) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.26% (29.4578 => 29.8299, std.dev.: 0.0388) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 24.52% (7.3405 => 9.1406, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 12.30% (2.8282 => 3.1762, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0352) MultiSource/Applications/sqlite3/sqlite3: 3.32% (4.0923 => 4.2283, std.dev.: 0.0177) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0110) MultiSource/Applications/lua/lua: 2.70% (21.6534 => 22.2374, std.dev.: 0.1280) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 1.61% (0.7440 => 0.7560, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (1.0881 => 1.1001, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0121) SingleSource/UnitTests/Vector/constpool: -81.63% (10.9087 => 2.0041, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/nestedloop: -60.86% (2.9642 => 1.1601, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.69% (7.4801 => 6.2320, std.dev.: 0.0522) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.57% (7.5041 => 6.3360, std.dev.: 0.0402) SingleSource/Regression/C/sumarray2d: -10.61% (0.7160 => 0.6400, std.dev.: 0.0115) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -2.48% (13.5243 => 13.1883, std.dev.: 0.0305) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6534 => 17.8851, std.dev.: 0.0423) SingleSource/Benchmarks/Linpack/linpack-pc: -15.49% (7.8005 => 6.5924, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0048) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0227) MultiSource/Applications/JM/lencod/lencod: -1.64% (8.3085 => 8.1725, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -1.17% (11.6527 => 11.5167, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 04:44:50 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 04:44:50 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140419114510.6077E4FAD37D@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6776 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206683 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Debug+Asserts/UtilsTests/SpecialCaseListTest.ModuleIsIn (17772 of 17773) PASS: LLVM-Unit :: Support/Debug+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17773 of 17773) 1 warning(s) in tests. Testing Time: 658.43s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17623 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 04:44:50 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 04:44:50 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140419114510.610C14FAD37E@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6776 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206683 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Debug+Asserts/UtilsTests/SpecialCaseListTest.ModuleIsIn (17772 of 17773) PASS: LLVM-Unit :: Support/Debug+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17773 of 17773) 1 warning(s) in tests. Testing Time: 658.43s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17623 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 04:45:10 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 04:45:10 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase2 - living Message-ID: <20140419114522.2FE4C4FAD386@lab.llvm.org> The Buildbot has detected a new failure on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7527 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206683 Blamelist: delesley,rsmith,spyffe,yrnkrn BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: source/API/SBData.cpp source/API/SBFileSpec.cpp source/Plugins/Process/Utility/RegisterContextDarwin_x86_64.cpp On: smooshlab-project At: Fri 18 Apr 2014 20:20:41 Changed By: spyffe Comments: Included in a few headers that were using preprocessor constants for printf() format specifications. Properties: phase_id: r206679-t20140418_202242-b19049 Files: include/clang/AST/ASTUnresolvedSet.h include/clang/AST/ASTVector.h include/clang/Basic/DiagnosticSerializationKinds.td include/clang/Serialization/ASTReader.h include/clang/Serialization/ASTWriter.h lib/CodeGen/CGRecordLayout.h lib/CodeGen/CGRecordLayoutBuilder.cpp lib/Sema/SemaDeclCXX.cpp lib/Serialization/ASTCommon.h lib/Serialization/ASTReader.cpp lib/Serialization/ASTReaderDecl.cpp lib/Serialization/ASTWriter.cpp lib/Serialization/ASTWriterDecl.cpp test/Modules/Inputs/cxx-irgen-left.h test/Modules/Inputs/cxx-irgen-top.h test/Modules/Inputs/templates-left.h test/Modules/Inputs/templates-right.h test/Modules/Inputs/templates-top.h test/Modules/cxx-irgen.cpp test/Modules/templates.mm On: smooshlab-project At: Fri 18 Apr 2014 21:00:41 Changed By: rsmith Comments: When a module completes the definition of a class template specialization imported from another module, emit an update record, rather than using the broken decl rewriting mechanism. If multiple modules do this, merge the definitions together, much as we would if they were separate declarations. Properties: phase_id: r206680-t20140418_210242-b19050 Files: include/clang/Analysis/Analyses/ThreadSafetyCommon.h include/clang/Analysis/Analyses/ThreadSafetyTIL.h include/clang/Analysis/Analyses/ThreadSafetyTraverse.h lib/Analysis/ThreadSafetyCommon.cpp On: smooshlab-project At: Fri 18 Apr 2014 21:06:41 Changed By: delesley Comments: Thread Safety Analysis: Convert to minimal SSA.Properties: phase_id: r206681-t20140418_212118-b19051 File: include/clang/AST/ASTVector.h On: smooshlab-project At: Fri 18 Apr 2014 21:36:42 Changed By: rsmith Comments: Speculative fix for buildbot failure. Apparently Clang 3.1 got move semantics wrong. Properties: phase_id: r206682-t20140418_213842-b19052 Files: lib/MC/MCAsmStreamer.cpp test/MC/AsmParser/directive_seh.s On: smooshlab-project At: Fri 18 Apr 2014 22:50:41 Changed By: yrnkrn Comments: Patch by Ray Donnelly to print register names instead of numbers. http://reviews.llvm.org/D3422 Properties: phase_id: r206683-t20140418_225300-b19053 LOGS: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 04:45:10 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 04:45:10 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase2 - living Message-ID: <20140419114522.2FD3D4FAD385@lab.llvm.org> The Buildbot has detected a new failure on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7527 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206683 Blamelist: delesley,rsmith,spyffe,yrnkrn BUILD FAILED: failed sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sat Apr 19 07:41:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 09:41:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419144137.E54D12A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24745?compare_to=24739&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24745, Order: 206683, Start Time: 2014-04-19 10:05:04, End Time: 2014-04-19 14:48:13 To: 24739, Order: 206682, Start Time: 2014-04-19 05:19:00, End Time: 2014-04-19 10:01:54 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 15 (145 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-22-LocalTypeTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.07% (0.1640 => 0.1920, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 12.12% (0.1320 => 0.1480, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 11.54% (0.1040 => 0.1160, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.44% (0.7200 => 0.7520, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 2.48% (0.4840 => 0.4960, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.24% (1.6041 => 1.6401, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 1.38% (4.9400 => 5.0080, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.89% (0.3040 => 0.3280, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.01% (1.1961 => 1.2441, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.46% (5.3763 => 5.5083, std.dev.: 0.0343) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.29% (11.3687 => 3.0362, std.dev.: 0.0139) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0078) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0060) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0051) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/methcall: 57.14% (0.0280 => 0.0440, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0640 => 0.0800, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.53% (1.0240 => 1.2240, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.07% (0.1640 => 0.1920, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.38% (0.1040 => 0.1200, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.6600 => 0.7480, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.90% (0.6200 => 0.7000, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.08% (1.4241 => 1.5961, std.dev.: 0.0093) MultiSource/Benchmarks/NPB-serial/is/is: 11.54% (0.1040 => 0.1160, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.26% (1.4561 => 1.6201, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.23% (1.4601 => 1.6241, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.14% (1.6521 => 1.8361, std.dev.: 0.0115) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.1800 => 0.2000, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.20% (1.6081 => 1.7721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.17% (1.6121 => 1.7761, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.17% (0.2360 => 0.2600, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.08% (1.5481 => 1.7041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0111) MultiSource/Applications/obsequi/Obsequi: 9.21% (1.8680 => 2.0400, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.77% (0.4560 => 0.4960, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0243) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.30% (1.7841 => 1.9321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.91% (1.4161 => 1.5281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.89% (1.5201 => 1.6401, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.69% (1.4561 => 1.5681, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.43% (0.7000 => 0.7520, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 7.16% (1.5080 => 1.6160, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2240 => 0.2400, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 6.75% (1.0080 => 1.0760, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.53% (11.6440 => 12.4040, std.dev.: 0.0629) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.4680 => 6.8720, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0120) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.4640 => 1.5520, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0205) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (9.4842 => 10.0242, std.dev.: 0.0462) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.68% (2.0440 => 2.1600, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.7400 => 1.8360, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0263) MultiSource/Applications/SIBsim4/SIBsim4: 5.36% (1.7921 => 1.8881, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (6.5080 => 6.8400, std.dev.: 0.0403) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (5.8121 => 6.1041, std.dev.: 0.0455) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.82% (1.6601 => 1.7401, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (10.0443 => 10.5283, std.dev.: 0.0290) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.77% (6.5440 => 6.8560, std.dev.: 0.0460) MultiSource/Applications/JM/lencod/lencod: 4.61% (21.9606 => 22.9728, std.dev.: 0.0580) MultiSource/Applications/lua/lua: 4.59% (4.7880 => 5.0080, std.dev.: 0.0184) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (5.3600 => 5.5920, std.dev.: 0.0566) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0123) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.27% (1.3120 => 1.3680, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 4.01% (6.9844 => 7.2645, std.dev.: 0.0183) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.93% (50.0290 => 51.9970, std.dev.: 0.1008) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0156) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0131) MultiSource/Applications/ClamAV/clamscan: 3.49% (19.0444 => 19.7084, std.dev.: 0.0591) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0286) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.32% (1.3240 => 1.3680, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/lists1: 3.30% (0.3640 => 0.3760, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 3.29% (38.4046 => 39.6686, std.dev.: 0.0551) MultiSource/Applications/SPASS/SPASS: 3.25% (18.4404 => 19.0406, std.dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0175) MultiSource/Applications/siod/siod: 3.24% (2.7162 => 2.8042, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (16.3483 => 16.8323, std.dev.: 0.0447) MultiSource/Applications/kimwitu++/kc: 2.50% (19.6891 => 20.1811, std.dev.: 0.0550) MultiSource/Applications/d/make_dparser: 1.92% (3.9681 => 4.0441, std.dev.: 0.0285) MultiSource/Benchmarks/PAQ8p/paq8p: 1.43% (2.7922 => 2.8322, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (13.0563 => 13.2283, std.dev.: 0.0360) MultiSource/Applications/sqlite3/sqlite3: 1.29% (25.6856 => 26.0176, std.dev.: 0.0494) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.28% (2.1401 => 2.4242, std.dev.: 0.0374) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.89% (0.3600 => 0.3920, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.63% (4.1003 => 4.2083, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.41% (3.9842 => 4.0803, std.dev.: 0.0155) MultiSource/Applications/minisat/minisat: 2.28% (6.6684 => 6.8204, std.dev.: 0.0455) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.10% (10.6247 => 2.0081, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.70% (2.9442 => 0.8920, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.30% (91.8497 => 49.3231, std.dev.: 10.6756) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.46% (50.3031 => 32.9701, std.dev.: 0.1893) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.40% (26.0616 => 17.0971, std.dev.: 0.1354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -33.00% (42.1466 => 28.2378, std.dev.: 0.3632) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1116) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.91% (4.1243 => 4.0042, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0012) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -1.21% (26.6977 => 26.3736, std.dev.: 0.0283) MultiSource/Benchmarks/sim/sim: -1.17% (4.7883 => 4.7323, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.01% (1.9761 => 1.9561, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 07:58:47 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 07:58:47 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase3 - tree health Message-ID: <20140419145853.7A3064FAE80C@lab.llvm.org> The Buildbot has detected a build exception on builder phase3 - tree health while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase3%20-%20tree%20health/builds/2336 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206678 Blamelist: benlangmuir,bogner,dblaikie,dexonsmith,enderby,nicholas,rnk,samsonov BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 07:58:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 07:58:52 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase2 - living Message-ID: <20140419145853.78EA34FAE80B@lab.llvm.org> The Buildbot has detected a build exception on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7528 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206684 Blamelist: yrnkrn BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sat Apr 19 08:12:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 10:12:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140419151222.DABC22A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24746?compare_to=24740&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24746, Order: 206683, Start Time: 2014-04-19 10:36:46, End Time: 2014-04-19 15:18:57 To: 24740, Order: 206682, Start Time: 2014-04-19 05:50:17, End Time: 2014-04-19 10:33:32 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 14 (162 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-01-float_varg: 400.00% (0.0040 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/stmtexpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-26-Shorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 34.48% (0.1160 => 0.1560, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/bmm/bmm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/distray/distray: 12.90% (0.1240 => 0.1400, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 8.14% (0.3440 => 0.3720, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.44% (1.0800 => 1.1280, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.74% (1.6121 => 1.6401, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (6.1000 => 6.1920, std.dev.: 0.0313) MultiSource/Applications/siod/siod: 1.01% (2.7802 => 2.8082, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.40% (1.4561 => 1.3921, std.dev.: 0.0235) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2337.50% (0.0320 => 0.7800, std.dev.: 0.0123) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0081) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 327.63% (0.2320 => 0.9921, std.dev.: 0.0080) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 193.65% (0.2520 => 0.7400, std.dev.: 0.0133) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0160 => 0.0320, std.dev.: 0.0027) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 96.15% (0.1040 => 0.2040, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0051) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0067) SingleSource/UnitTests/2003-05-26-Shorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0039) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0051) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) MultiSource/Applications/obsequi/Obsequi: 45.40% (1.3920 => 2.0240, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/flops-2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.13% (1.2401 => 1.5641, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0156) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.30% (1.1841 => 1.4481, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.18% (1.1521 => 1.3961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.80% (1.2321 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 19.30% (8.5802 => 10.2363, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.50% (1.3841 => 1.6401, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/distray/distray: 16.67% (0.1200 => 0.1400, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 15.76% (19.5406 => 22.6207, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.99% (5.3360 => 6.1361, std.dev.: 0.0321) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.56% (1.7400 => 1.9760, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 11.61% (0.4480 => 0.5000, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 9.56% (11.3843 => 12.4723, std.dev.: 0.0292) MultiSource/Applications/oggenc/oggenc: 9.48% (6.2844 => 6.8804, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.24% (5.6680 => 6.1920, std.dev.: 0.0313) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.87% (5.7280 => 6.2360, std.dev.: 0.0433) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.25% (11.4440 => 12.3880, std.dev.: 0.0664) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2440 => 0.2640, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.10% (9.5802 => 10.2602, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (1.4760 => 1.5600, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/football/football: 5.62% (1.0680 => 1.1280, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0051) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.14% (1.3240 => 1.3920, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.80% (6.8280 => 7.1560, std.dev.: 0.0349) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists1: 4.40% (0.3640 => 0.3800, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.6961 => 1.7601, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.76% (49.1529 => 51.0009, std.dev.: 0.1041) MultiSource/Applications/lua/lua: 3.52% (4.7720 => 4.9400, std.dev.: 0.0527) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 3.49% (5.3840 => 5.5720, std.dev.: 0.0381) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0203) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 2.89% (24.7575 => 25.4735, std.dev.: 0.0429) MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (2.7282 => 2.8042, std.dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: 2.77% (19.2243 => 19.7564, std.dev.: 0.0753) MultiSource/Applications/kimwitu++/kc: 2.25% (19.7491 => 20.1931, std.dev.: 0.0482) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 1.66% (18.7966 => 19.1086, std.dev.: 0.0486) MultiSource/Benchmarks/Bullet/bullet: 1.62% (39.0726 => 39.7046, std.dev.: 0.0655) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.21% (29.3298 => 29.6859, std.dev.: 0.0383) MultiSource/Applications/lemon/lemon: 1.06% (1.5041 => 1.5201, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (1.2401 => 1.3921, std.dev.: 0.0235) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0262) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0277) MultiSource/Applications/sqlite3/sqlite3: 3.25% (4.0563 => 4.1883, std.dev.: 0.0185) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (1.2961 => 1.3161, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.26% (25.4536 => 25.7736, std.dev.: 0.0300) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.78% (11.0207 => 2.0081, std.dev.: 0.0087) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -19.20% (8.9566 => 7.2365, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.33% (21.6534 => 17.9011, std.dev.: 0.0340) SingleSource/Benchmarks/Linpack/linpack-pc: -16.34% (7.8605 => 6.5764, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0588) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.19% (2.9162 => 2.8522, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 08:27:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 10:27:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140419152733.B79972A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24747?compare_to=24741&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24747, Order: 206683, Start Time: 2014-04-19 10:48:47, End Time: 2014-04-19 15:34:08 To: 24741, Order: 206682, Start Time: 2014-04-19 05:59:30, End Time: 2014-04-19 10:45:33 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 17 (143 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-7: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) MultiSource/Benchmarks/NPB-serial/is/is: 17.39% (0.0920 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.33% (0.1920 => 0.2080, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 6.78% (0.2360 => 0.2520, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.12% (0.1960 => 0.2080, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 4.92% (0.2440 => 0.2560, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.30% (2.1561 => 2.1841, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (9.9842 => 10.1002, std.dev.: 0.0388) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.13% (2.1201 => 2.1441, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.18% (6.2524 => 6.3884, std.dev.: 0.0506) SingleSource/Benchmarks/Shootout/hash: 1.23% (4.2283 => 4.2803, std.dev.: 0.0140) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 12.25% (17.6723 => 19.8364, std.dev.: 0.0782) MultiSource/Applications/sqlite3/sqlite3: 1430.59% (1.7001 => 26.0216, std.dev.: 0.0590) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.73% (50.1010 => 51.9690, std.dev.: 0.1134) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.99% (11.3920 => 12.4160, std.dev.: 0.0434) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0090) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1083, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0193) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 315.76% (0.4320 => 1.7961, std.dev.: 0.0090) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 71.43% (0.0280 => 0.0480, std.dev.: 0.0027) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.41% (1.8281 => 2.1281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.15% (1.8081 => 2.1001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.70% (1.8601 => 2.1521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.45% (1.9161 => 2.2121, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.14% (1.8761 => 2.1601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.76% (1.9241 => 2.2081, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.59% (2.0281 => 2.3241, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.43% (1.9121 => 2.1881, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.4160 => 0.4760, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.29% (0.2240 => 0.2560, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.45% (2.1121 => 2.3961, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.84% (1.9001 => 2.1441, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.75% (1.9761 => 2.2281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 12.34% (1.8801 => 2.1121, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.19% (1.7721 => 1.9881, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.13% (1.8801 => 2.1081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 12.11% (1.9481 => 2.1841, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.99% (2.0681 => 2.3161, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.98% (2.1041 => 2.3561, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (1.8361 => 2.0521, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.40% (1.8601 => 2.0721, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.03% (1.0880 => 1.2080, std.dev.: 0.0227) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.69% (0.6360 => 0.7040, std.dev.: 0.0206) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0241) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: 8.74% (1.8760 => 2.0400, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8881 => 0.9601, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.8440 => 1.9600, std.dev.: 0.0214) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.4800 => 6.8720, std.dev.: 0.0509) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (2.9721 => 3.1322, std.dev.: 0.0241) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.6960 => 1.7840, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (9.6042 => 10.1002, std.dev.: 0.0388) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (5.8281 => 6.1241, std.dev.: 0.0275) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.65% (6.5320 => 6.8360, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0222) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.2283 => 10.6964, std.dev.: 0.0409) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (6.5360 => 6.8080, std.dev.: 0.0290) MultiSource/Applications/treecc/treecc: 4.02% (2.5880 => 2.6920, std.dev.: 0.0175) MultiSource/Applications/lua/lua: 3.92% (4.7920 => 4.9800, std.dev.: 0.0271) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 3.46% (7.0524 => 7.2965, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0080) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.38% (1.3000 => 1.3440, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (16.3003 => 16.8443, std.dev.: 0.0324) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (5.3960 => 5.5720, std.dev.: 0.0593) MultiSource/Applications/JM/lencod/lencod: 3.01% (22.2206 => 22.8887, std.dev.: 0.0532) MultiSource/Applications/SPASS/SPASS: 2.96% (18.5284 => 19.0766, std.dev.: 0.0551) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0127) MultiSource/Applications/d/make_dparser: 2.52% (3.9761 => 4.0761, std.dev.: 0.0186) MultiSource/Benchmarks/Bullet/bullet: 2.44% (38.6366 => 39.5806, std.dev.: 0.0950) MultiSource/Applications/siod/siod: 2.33% (2.7522 => 2.8162, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2243 => 4.3203, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: 2.02% (19.8291 => 20.2291, std.dev.: 0.0490) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (13.0363 => 13.2203, std.dev.: 0.0214) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0380) MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 10.89% (2.8642 => 3.1762, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/salsa20: 3.74% (7.3725 => 7.6485, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.42% (5.0243 => 5.1963, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.97% (6.5964 => 6.7924, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9684 => 6.0644, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.33% (0.6880 => 0.6720, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.02% (94.8339 => 49.2991, std.dev.: 6.1856) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.88% (49.9431 => 33.0221, std.dev.: 0.1717) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.48% (25.7136 => 17.1051, std.dev.: 0.1337) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.87% (37.0863 => 28.6058, std.dev.: 0.2956) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.66% (7.8165 => 6.7484, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -7.05% (0.6240 => 0.5800, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.94% (1.2681 => 1.1801, std.dev.: 0.0279) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.41% (4.8043 => 4.6883, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.73% (2.7722 => 2.7242, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 08:52:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 08:52:52 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140419155312.4A0EE4FAEDED@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6777 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206684 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Debug+Asserts/UtilsTests/SpecialCaseListTest.Substring (17772 of 17773) PASS: LLVM-Unit :: Support/Debug+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17773 of 17773) 1 warning(s) in tests. Testing Time: 667.86s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17623 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Sat Apr 19 11:37:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 13:37:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419183737.7BED02A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24748?compare_to=24742&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24748, Order: 206684, Start Time: 2014-04-19 14:05:31, End Time: 2014-04-19 18:44:12 To: 24742, Order: 206683, Start Time: 2014-04-19 06:05:51, End Time: 2014-04-19 10:50:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (102 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 30.77% (0.0520 => 0.0680, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 25.00% (0.0640 => 0.0800, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.73% (0.0880 => 0.1080, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.54% (0.1040 => 0.1160, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.46% (0.2960 => 0.3240, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.9360 => 0.9720, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Treesort: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.1680 => 0.1960, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -16.00% (0.1000 => 0.0840, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/oggenc/oggenc: -8.33% (0.1440 => 0.1320, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/dt: 62.50% (0.0320 => 0.0520, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.77% (1.3681 => 1.4881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (10.6960 => 11.5200, std.dev.: 0.0775) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0436) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9200 => 0.9720, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.97% (5.8000 => 6.0880, std.dev.: 0.0394) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0208) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0296) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0626) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 3.38% (17.6165 => 18.2125, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0416) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 2.73% (23.7574 => 24.4055, std.dev.: 0.0475) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0295) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.44% (48.1088 => 49.2810, std.dev.: 0.0992) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 2.06% (18.8170 => 19.2051, std.dev.: 0.0325) MultiSource/Applications/treecc/treecc: 1.96% (2.4480 => 2.4960, std.dev.: 0.0172) MultiSource/Benchmarks/Bullet/bullet: 1.94% (37.0925 => 37.8125, std.dev.: 0.0952) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0122) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0543) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 8.89% (0.1800 => 0.1960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (25.8896 => 26.9497, std.dev.: 0.0214) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 2.97% (21.1533 => 21.7814, std.dev.: 0.1131) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.0643 => 4.1283, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -14.04% (7.7485 => 6.6604, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.35% (1.2601 => 1.1801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -1.94% (2.6762 => 2.6242, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/five11/five11: -1.54% (2.3361 => 2.3001, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 11:44:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 13:44:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419184448.8905F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24749?compare_to=24743&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24749, Order: 206684, Start Time: 2014-04-19 14:05:18, End Time: 2014-04-19 18:51:25 To: 24743, Order: 206683, Start Time: 2014-04-19 06:13:08, End Time: 2014-04-19 11:00:08 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/heapsort: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3800 => 0.3960, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.97% (1.1080 => 1.1520, std.dev.: 0.0161) MultiSource/Applications/hbd/hbd: 3.61% (1.7720 => 1.8360, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.19% (0.7520 => 0.7760, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.37% (0.6760 => 0.6920, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.56% (1.7920 => 1.8200, std.dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 11:52:23 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 11:52:23 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase2 - living Message-ID: <20140419185235.13D594FB01F2@lab.llvm.org> The Buildbot has detected a restored build on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7529 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206685 Blamelist: chapuni Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sat Apr 19 11:47:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 13:47:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140419184731.447A92A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24750?compare_to=24744&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24750, Order: 206684, Start Time: 2014-04-19 14:05:17, End Time: 2014-04-19 18:54:09 To: 24744, Order: 206683, Start Time: 2014-04-19 06:44:21, End Time: 2014-04-19 11:33:21 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (131 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 13.64% (0.0880 => 0.1000, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.18% (0.3920 => 0.4280, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (1.7281 => 1.7481, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.49% (0.9801 => 1.0241, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4721 => 1.4881, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -7.23% (0.3320 => 0.3080, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.10% (2.0961 => 2.0521, std.dev.: 0.0170) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0094) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/dt: 35.71% (0.0560 => 0.0760, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.39% (0.1640 => 0.2040, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.70% (1.6961 => 2.0641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.54% (1.7081 => 2.0761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.33% (1.8001 => 2.1841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 21.28% (1.8041 => 2.1881, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.16% (1.7201 => 2.0841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.10% (1.7441 => 2.1121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.04% (1.6921 => 2.0481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.98% (1.7921 => 2.1681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.95% (1.6801 => 2.0321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.65% (1.7241 => 2.0801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.44% (1.8201 => 2.1921, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.69% (1.8281 => 2.1881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.94% (1.9641 => 2.3361, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.38% (1.9801 => 2.3441, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0144) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.38% (0.1040 => 0.1200, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.02% (6.7200 => 7.1920, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.67% (0.7200 => 0.7680, std.dev.: 0.0139) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (0.8601 => 0.9161, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.40% (3.5002 => 3.7242, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.35% (11.7880 => 12.5360, std.dev.: 0.0625) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.07% (1.6481 => 1.7481, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0161) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.22% (2.0680 => 2.1760, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (1.2400 => 1.3040, std.dev.: 0.0199) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.1440 => 1.2000, std.dev.: 0.0138) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (9.9842 => 10.4722, std.dev.: 0.0507) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0074) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0245) MultiSource/Applications/lua/lua: 4.01% (4.7920 => 4.9840, std.dev.: 0.0490) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0172) MultiSource/Applications/oggenc/oggenc: 3.88% (6.9124 => 7.1804, std.dev.: 0.0221) MultiSource/Applications/Burg/burg: 3.85% (1.5600 => 1.6200, std.dev.: 0.0220) MultiSource/Applications/JM/ldecod/ldecod: 3.76% (10.3203 => 10.7084, std.dev.: 0.0303) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (6.8321 => 7.0841, std.dev.: 0.0370) MultiSource/Applications/SPASS/SPASS: 3.68% (18.4924 => 19.1727, std.dev.: 0.0605) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 3.04% (22.6287 => 23.3168, std.dev.: 0.0444) MultiSource/Applications/kimwitu++/kc: 2.94% (19.7371 => 20.3171, std.dev.: 0.0393) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.89% (51.1089 => 52.5849, std.dev.: 0.1541) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.5480 => 5.6880, std.dev.: 0.0400) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (3.0122 => 3.0882, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 2.43% (20.2445 => 20.7365, std.dev.: 0.0416) MultiSource/Benchmarks/Bullet/bullet: 2.18% (38.9366 => 39.7847, std.dev.: 0.1084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.5963 => 16.9523, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (4.2203 => 4.3083, std.dev.: 0.0109) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (2.7722 => 2.8282, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0112) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0193) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 1.81% (25.1895 => 25.6456, std.dev.: 0.0341) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (6.0244 => 6.1084, std.dev.: 0.0231) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 19.39% (0.9281 => 1.1081, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0583) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 12.30% (2.8282 => 3.1762, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 8.91% (1.2121 => 1.3201, std.dev.: 0.0360) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0321) MultiSource/Applications/sqlite3/sqlite3: 3.52% (4.0923 => 4.2363, std.dev.: 0.0219) MultiSource/Applications/lua/lua: 2.84% (21.6534 => 22.2694, std.dev.: 0.1020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9604 => 6.0644, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0161) SingleSource/Regression/C/PR10189: -85.71% (0.0280 => 0.0040, std.dev.: 0.0074) SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/nestedloop: -60.32% (2.9642 => 1.1761, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.43% (3.1762 => 1.3521, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/recursive: -44.44% (0.0360 => 0.0200, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.44% (1.5881 => 1.1841, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: -22.06% (2.6481 => 2.0640, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.20% (7.4801 => 6.2680, std.dev.: 0.0523) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.46% (7.5041 => 6.3440, std.dev.: 0.0433) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0078) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: -2.90% (13.5243 => 13.1323, std.dev.: 0.0467) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.85% (21.6534 => 17.7891, std.dev.: 0.0646) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0068) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.02% (29.4578 => 28.8618, std.dev.: 0.1809) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0224) MultiSource/Applications/JM/lencod/lencod: -1.59% (8.3085 => 8.1765, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -1.17% (11.6527 => 11.5167, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 12:31:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 14:31:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419193111.532B52A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24751?compare_to=24745&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24751, Order: 206684, Start Time: 2014-04-19 14:54:49, End Time: 2014-04-19 19:37:47 To: 24745, Order: 206683, Start Time: 2014-04-19 10:05:04, End Time: 2014-04-19 14:48:13 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 15 (158 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (925 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-07-17-INT-To-FP: 200.00% (0.0080 => 0.0240, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/nestedloop: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.46% (0.2680 => 0.2880, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 3.88% (0.8240 => 0.8560, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 2.65% (0.4520 => 0.4640, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.38% (1.7401 => 1.7641, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 2.17% (0.7360 => 0.7520, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.42% (0.8441 => 0.8561, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.29% (11.3687 => 3.0362, std.dev.: 0.0114) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0103) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0116) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0072) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0049) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 20.45% (0.1760 => 0.2120, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.62% (1.0240 => 1.1840, std.dev.: 0.0224) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.38% (0.1040 => 0.1200, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.3640 => 0.4160, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 12.50% (0.2240 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.36% (1.4241 => 1.6001, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 11.90% (0.3360 => 0.3760, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.26% (1.4561 => 1.6201, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.34% (0.3480 => 0.3840, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.43% (1.6121 => 1.7641, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (1.0240 => 1.1160, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0163) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0111) MultiSource/Applications/spiff/spiff: 8.33% (1.0080 => 1.0920, std.dev.: 0.0246) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.91% (1.4161 => 1.5281, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: 7.71% (1.8680 => 2.0120, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.46% (0.2680 => 0.2880, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (0.2240 => 0.2400, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (6.4680 => 6.9040, std.dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.70% (11.6440 => 12.4240, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.41% (1.4361 => 1.5281, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/neural/neural: 6.12% (0.1960 => 0.2080, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.07% (9.4842 => 10.0602, std.dev.: 0.0478) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.7400 => 1.8400, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (5.8121 => 6.1361, std.dev.: 0.0286) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0297) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.52% (0.7240 => 0.7640, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 5.45% (0.4400 => 0.4640, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.38% (1.5600 => 1.6440, std.dev.: 0.0156) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0313) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0187) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.16% (0.6200 => 0.6520, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.06% (1.6601 => 1.7441, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 4.86% (10.0443 => 10.5323, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.64% (2.3281 => 2.4362, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.58% (6.5440 => 6.8440, std.dev.: 0.0318) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 4.39% (21.9606 => 22.9247, std.dev.: 0.0371) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (5.3600 => 5.5920, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.95% (2.1240 => 2.2080, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (6.5080 => 6.7640, std.dev.: 0.0426) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.89% (50.0290 => 51.9770, std.dev.: 0.0802) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0205) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 3.70% (19.0444 => 19.7484, std.dev.: 0.0409) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0179) MultiSource/Applications/SPASS/SPASS: 3.34% (18.4404 => 19.0565, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 3.19% (38.4046 => 39.6286, std.dev.: 0.0774) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0414) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 2.76% (19.6891 => 20.2331, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (16.3483 => 16.7963, std.dev.: 0.0424) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.23% (25.6856 => 26.0016, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.18% (1.0201 => 1.0321, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0563 => 13.1963, std.dev.: 0.0463) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0205) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.28% (2.1401 => 2.4242, std.dev.: 0.0532) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0092) MultiSource/Applications/minisat/minisat: 3.00% (6.6684 => 6.8684, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.63% (4.1003 => 4.2083, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.51% (3.9842 => 4.0843, std.dev.: 0.0153) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.02% (2.7442 => 2.7722, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.10% (10.6247 => 2.0081, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.43% (2.9442 => 0.9000, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.08% (91.8497 => 49.5271, std.dev.: 9.7700) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.38% (26.0616 => 17.1011, std.dev.: 0.1874) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.99% (50.3031 => 33.2061, std.dev.: 0.1500) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.00% (42.1466 => 28.6578, std.dev.: 0.5697) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1173) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0060) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.72% (4.1243 => 4.0122, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.89% (4.0283 => 3.9522, std.dev.: 0.0201) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.41% (2.8442 => 2.8042, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0197) MultiSource/Benchmarks/mafft/pairlocalalign: -1.17% (26.6977 => 26.3856, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.01% (1.9761 => 1.9561, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: -1.00% (4.7883 => 4.7403, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 13:01:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 15:01:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140419200153.271E62A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24752?compare_to=24746&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24752, Order: 206684, Start Time: 2014-04-19 15:25:34, End Time: 2014-04-19 20:08:27 To: 24746, Order: 206683, Start Time: 2014-04-19 10:36:46, End Time: 2014-04-19 15:18:57 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 12 (171 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (919 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.08% (0.1040 => 0.1280, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.05% (0.0840 => 0.1000, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.94% (0.2520 => 0.2720, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.03% (1.7760 => 1.8120, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.47% (1.3561 => 1.3761, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.31% (1.3921 => 1.4521, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0114) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0106) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0072) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 192.06% (0.2520 => 0.7360, std.dev.: 0.0160) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0062) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0113) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0056) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0049) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0050) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0027) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 60.00% (0.0800 => 0.1280, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 47.37% (0.0760 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0035) MultiSource/Applications/obsequi/Obsequi: 44.83% (1.3920 => 2.0160, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0086) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.68% (1.2481 => 1.5561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.55% (1.1321 => 1.3761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.12% (1.1361 => 1.3761, std.dev.: 0.0072) SingleSource/Benchmarks/McGill/chomp: 20.83% (0.1920 => 0.2320, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.13% (1.2521 => 1.5041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 19.11% (8.5802 => 10.2203, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.21% (1.2521 => 1.4801, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.78% (0.1800 => 0.2120, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0123) MultiSource/Applications/sgefa/sgefa: 16.96% (0.4480 => 0.5240, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 15.37% (19.5406 => 22.5447, std.dev.: 0.0458) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.84% (5.3360 => 6.1281, std.dev.: 0.0201) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/almabench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.16% (0.1520 => 0.1720, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.10% (1.7400 => 1.9680, std.dev.: 0.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0047) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 9.87% (11.3843 => 12.5083, std.dev.: 0.0240) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 9.43% (0.2120 => 0.2320, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 9.29% (6.2844 => 6.8684, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.82% (5.6680 => 6.1680, std.dev.: 0.0376) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.64% (0.6480 => 0.7040, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.38% (5.7280 => 6.2080, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2440 => 0.2640, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (11.4440 => 12.3160, std.dev.: 0.0696) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0150) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (9.5802 => 10.2322, std.dev.: 0.0531) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0198) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.40% (1.6240 => 1.7280, std.dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.4760 => 1.5520, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/random: 5.08% (0.2360 => 0.2480, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0159) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0150) MultiSource/Applications/lua/lua: 4.78% (4.7720 => 5.0000, std.dev.: 0.0333) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.39% (6.8280 => 7.1280, std.dev.: 0.0337) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (5.3840 => 5.6120, std.dev.: 0.0424) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.90% (49.1529 => 51.0689, std.dev.: 0.0884) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (1.7600 => 1.8280, std.dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0120) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0202) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.6961 => 1.7521, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.26% (2.2081 => 2.2801, std.dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: 3.08% (2.7282 => 2.8122, std.dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: 2.93% (19.2243 => 19.7883, std.dev.: 0.0651) MultiSource/Applications/sqlite3/sqlite3: 2.75% (24.7575 => 25.4375, std.dev.: 0.0478) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: 2.49% (19.7491 => 20.2411, std.dev.: 0.0391) MultiSource/Applications/treecc/treecc: 2.42% (2.6480 => 2.7120, std.dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: 1.74% (18.7966 => 19.1245, std.dev.: 0.0435) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: 1.55% (39.0726 => 39.6766, std.dev.: 0.0812) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0124 => 6.1044, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (3.0402 => 3.0762, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (3.9842 => 4.2923, std.dev.: 0.0204) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0248) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 4.14% (4.0563 => 4.2243, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.12% (1.6521 => 1.7201, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0349) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 2.35% (1.3601 => 1.3921, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: 1.83% (1.3081 => 1.3321, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (4.2403 => 4.3083, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.58% (4.0443 => 4.1083, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.36% (3.2362 => 3.2802, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.21% (25.4536 => 25.7616, std.dev.: 0.0342) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0174) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.85% (21.6534 => 17.7891, std.dev.: 0.0713) SingleSource/Benchmarks/Linpack/linpack-pc: -16.39% (7.8605 => 6.5724, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.31% (3.4442 => 3.0202, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -8.64% (3.4722 => 3.1722, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0819) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0348) MultiSource/Applications/obsequi/Obsequi: -2.26% (2.1241 => 2.0761, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (5.0963 => 5.0163, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 13:19:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 15:19:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140419201955.CAE1F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24753?compare_to=24747&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24753, Order: 206684, Start Time: 2014-04-19 15:40:42, End Time: 2014-04-19 20:26:29 To: 24747, Order: 206683, Start Time: 2014-04-19 10:48:47, End Time: 2014-04-19 15:34:08 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 7 (136 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/printargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/PR10189: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/15-trie/trie: 38.46% (0.0520 => 0.0720, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 16.67% (0.0960 => 0.1120, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.86% (1.6801 => 1.7281, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.84% (17.6723 => 19.7644, std.dev.: 0.0712) MultiSource/Applications/sqlite3/sqlite3: 1424.48% (1.7001 => 25.9176, std.dev.: 0.0489) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.43% (50.1010 => 51.8170, std.dev.: 0.1181) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.0520 => 1.0800, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.94% (11.3920 => 12.2960, std.dev.: 0.0728) SingleSource/Benchmarks/Misc/oourafft: -73.37% (11.3407 => 3.0202, std.dev.: 0.0119) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1243, std.dev.: 0.0194) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0093) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0084) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0048) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.86% (0.1120 => 0.1320, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.82% (1.8201 => 2.1081, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.79% (0.3040 => 0.3520, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.36% (2.1361 => 2.4642, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.99% (2.0281 => 2.3321, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.97% (1.9241 => 2.2121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.80% (1.8921 => 2.1721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.43% (1.9121 => 2.1881, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.45% (2.1121 => 2.3961, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0137) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.90% (0.3720 => 0.4200, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.41% (1.7721 => 1.9921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.00% (0.1000 => 0.1120, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.93% (1.8441 => 2.0641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.09% (1.9481 => 2.1641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.64% (2.0681 => 2.2881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0042) MultiSource/Applications/obsequi/Obsequi: 8.74% (1.8760 => 2.0400, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 7.56% (0.4760 => 0.5120, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.34% (0.7080 => 0.7600, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.7400 => 0.7920, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0159) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0237) MultiSource/Benchmarks/nbench/nbench: 5.42% (1.7721 => 1.8681, std.dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0187) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.08% (6.5320 => 6.8640, std.dev.: 0.0364) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 4.71% (1.5280 => 1.6000, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (9.6042 => 10.0322, std.dev.: 0.0466) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (1.0840 => 1.1320, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (10.2283 => 10.6644, std.dev.: 0.0472) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (5.8281 => 6.0681, std.dev.: 0.0380) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0155) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (5.3960 => 5.5960, std.dev.: 0.0446) MultiSource/Applications/hbd/hbd: 3.70% (1.7280 => 1.7920, std.dev.: 0.0243) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 3.55% (2.5880 => 2.6800, std.dev.: 0.0217) MultiSource/Applications/lua/lua: 3.42% (4.7920 => 4.9560, std.dev.: 0.0363) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (6.5360 => 6.7560, std.dev.: 0.0416) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (16.3003 => 16.8443, std.dev.: 0.0500) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0094) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.08% (1.3000 => 1.3400, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.86% (22.2206 => 22.8567, std.dev.: 0.0427) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0247) MultiSource/Applications/SPASS/SPASS: 2.72% (18.5284 => 19.0325, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0094) MultiSource/Applications/d/make_dparser: 2.62% (3.9761 => 4.0801, std.dev.: 0.0194) MultiSource/Benchmarks/Bullet/bullet: 2.38% (38.6366 => 39.5566, std.dev.: 0.0689) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 2.00% (19.8291 => 20.2251, std.dev.: 0.0347) MultiSource/Benchmarks/PAQ8p/paq8p: 1.72% (2.7842 => 2.8322, std.dev.: 0.0113) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (13.0363 => 13.1803, std.dev.: 0.0237) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.23% (2.1201 => 2.4642, std.dev.: 0.0270) MultiSource/Applications/siod/siod: 11.17% (2.8642 => 3.1842, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: 3.70% (6.5964 => 6.8404, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9684 => 6.0484, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 1.13% (8.1285 => 8.2205, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (3.9442 => 3.9882, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.93% (94.8339 => 49.3791, std.dev.: 9.9832) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.85% (49.9431 => 33.0381, std.dev.: 0.1107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.40% (25.7136 => 17.1251, std.dev.: 0.1130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.57% (37.0863 => 28.3458, std.dev.: 0.3743) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.1048) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.61% (7.8165 => 6.7524, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0395) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (2.7482 => 2.5282, std.dev.: 0.0750) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0216) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (4.1123 => 4.0483, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 14:53:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 16:53:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419215354.DD27B2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24754?compare_to=24748&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24754, Order: 206685, Start Time: 2014-04-19 17:18:48, End Time: 2014-04-19 22:00:29 To: 24748, Order: 206684, Start Time: 2014-04-19 14:05:31, End Time: 2014-04-19 18:44:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (102 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/NP/np: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.08% (0.0520 => 0.0640, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 7.25% (0.2760 => 0.2960, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.45% (0.2200 => 0.2320, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 4.60% (0.3480 => 0.3640, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.35% (1.3641 => 1.3961, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 2.35% (0.6800 => 0.6960, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.37% (0.1960 => 0.2320, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0083) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (10.6960 => 11.5200, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0343) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0125) MultiSource/Applications/spiff/spiff: 5.67% (0.9880 => 1.0440, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0408) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.48% (5.8000 => 6.0600, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0179) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0307) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0219) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0208) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0382) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0393) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0407) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0464) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0105) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.48% (48.1088 => 49.3009, std.dev.: 0.0765) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0374) MultiSource/Applications/sqlite3/sqlite3: 2.42% (23.7574 => 24.3335, std.dev.: 0.0714) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (2.5882 => 2.6402, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.86% (37.0925 => 37.7806, std.dev.: 0.0729) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1330, std.dev.: 0.0554) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0151) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0460) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (25.8896 => 26.9657, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (1.3481 => 1.3921, std.dev.: 0.0098) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 2.65% (21.1533 => 21.7134, std.dev.: 0.0526) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0198) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.08% (4.0643 => 4.1083, std.dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/mason/mason: -26.32% (0.0760 => 0.0560, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0073) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 15:58:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 15:58:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140419225833.1453A4FB220B@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19059 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206704 Blamelist: dexonsmith BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 15:58:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 15:58:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140419225832.CA6A54FB2204@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14621 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206704 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17778 of 17779) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17779 of 17779) 1 warning(s) in tests. Testing Time: 332.97s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17629 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 15:58:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 15:58:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140419225833.1448C4FB220A@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19059 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206704 Blamelist: dexonsmith BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: include/llvm/Analysis/BlockFrequencyInfoImpl.h lib/Analysis/BlockFrequencyInfo.cpp lib/Analysis/BlockFrequencyInfoImpl.cpp lib/Analysis/CMakeLists.txt lib/CodeGen/MachineBlockFrequencyInfo.cpp test/Analysis/BlockFrequencyInfo/bad_input.ll test/Analysis/BlockFrequencyInfo/basic.ll test/Analysis/BlockFrequencyInfo/double_exit.ll test/Analysis/BlockFrequencyInfo/irreducible.ll test/Analysis/BlockFrequencyInfo/loop_with_branch.ll test/Analysis/BlockFrequencyInfo/nested_loop_with_branches.ll test/CodeGen/XCore/llvm-intrinsics.ll On: http://10.1.1.2/svn/llvm-project For: llvm At: Sat 19 Apr 2014 15:46:41 Changed By: dexonsmith Comments: Reapply "blockfreq: Rewrite BlockFrequencyInfoImpl" This reverts commit r206677, reapplying my BlockFrequencyInfo rewrite. I've done a careful audit, added some asserts, and fixed a couple of bugs (unfortunately, they were in unlikely code paths). There's a small chance that this will appease the failing bots [1][2]. (If so, great!) If not, I have a follow-up commit ready that will temporarily add -debug-only=block-freq to the two failing tests, allowing me to compare the code path between what the failing bots and what my machines (and the rest of the bots) are doing. Once I've triggered those builds, I'll revert both commits so the bots go green again. [1]: http://bb.pgr.jp/builders/ninja-x64-msvc-RA-centos6/builds/1816 [2]: http://llvm-amd64.freebsd.your.org/b/builders/clang-i386-freebsd/builds/18445 Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 15:58:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 15:58:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140419225832.C9DBB4FB2203@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14621 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206704 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17778 of 17779) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17779 of 17779) 1 warning(s) in tests. Testing Time: 332.97s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17629 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sat Apr 19 16:31:08 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 19 Apr 2014 16:31:08 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140419233109.0EDDC4FB2665@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19060 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206705 Blamelist: dexonsmith Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sat Apr 19 16:34:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 18:34:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140419233429.01E392A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24755?compare_to=24749&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24755, Order: 206685, Start Time: 2014-04-19 18:54:25, End Time: 2014-04-19 23:41:04 To: 24749, Order: 206684, Start Time: 2014-04-19 14:05:18, End Time: 2014-04-19 18:51:25 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1095 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C/PR10189: 200.00% (0.0080 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C++/BuiltinTypeInfo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/vla: 50.00% (0.0320 => 0.0480, std.dev.: 0.0049) SingleSource/Regression/C++/EH/ctor_dtor_count: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.76% (0.1640 => 0.1800, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 5.05% (0.3960 => 0.4160, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 14.06% (0.2560 => 0.2920, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.00% (0.2400 => 0.2520, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -4.05% (0.6920 => 0.6640, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -21.43% (0.7280 => 0.5720, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 16:38:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 18:38:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140419233854.464172A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24756?compare_to=24750&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24756, Order: 206685, Start Time: 2014-04-19 18:57:12, End Time: 2014-04-19 23:45:31 To: 24750, Order: 206684, Start Time: 2014-04-19 14:05:17, End Time: 2014-04-19 18:54:09 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (138 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR10189: 500.00% (0.0040 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/2005-07-17-INT-To-FP: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) SingleSource/UnitTests/FloatPrecision: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.00% (0.1200 => 0.1320, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.16% (0.1960 => 0.2120, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3080 => 0.3280, std.dev.: 0.0040) SingleSource/Regression/C/sumarray2d: 2.48% (0.6440 => 0.6600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 2.12% (0.7560 => 0.7720, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.53% (1.0441 => 1.0601, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 25.93% (0.1080 => 0.1360, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0075) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0074) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.72% (1.6761 => 2.0401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.58% (1.6681 => 2.0281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.28% (1.6921 => 2.0521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.11% (1.8001 => 2.1801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.95% (1.6801 => 2.0321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.59% (1.7681 => 2.1321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.12% (1.9881 => 2.3881, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.00% (1.8201 => 2.1841, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.81% (1.6961 => 2.0321, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.29% (1.9081 => 2.2761, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.07% (1.8881 => 2.2481, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.03% (0.6120 => 0.7040, std.dev.: 0.0183) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.42% (0.1920 => 0.2120, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0052) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0052) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0069) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.87% (0.3560 => 0.3840, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.63% (3.5002 => 3.7322, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.45% (0.2480 => 0.2640, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.7200 => 7.1440, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (11.7880 => 12.4920, std.dev.: 0.0618) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (1.4160 => 1.5000, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.77% (1.5240 => 1.6120, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9920 => 1.0480, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.7800 => 0.8240, std.dev.: 0.0157) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.22% (2.0680 => 2.1760, std.dev.: 0.0205) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.13% (9.9842 => 10.4962, std.dev.: 0.0379) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (1.6481 => 1.7321, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 5.01% (4.7920 => 5.0320, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (1.0001 => 1.0441, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0054) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0210) MultiSource/Applications/d/make_dparser: 4.04% (3.9641 => 4.1241, std.dev.: 0.0198) MultiSource/Applications/treecc/treecc: 3.97% (2.6200 => 2.7240, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 3.88% (6.9124 => 7.1804, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (6.8321 => 7.0881, std.dev.: 0.0283) MultiSource/Applications/SPASS/SPASS: 3.55% (18.4924 => 19.1486, std.dev.: 0.0479) MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 3.02% (22.6287 => 23.3128, std.dev.: 0.0506) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.7320 => 1.7840, std.dev.: 0.0187) MultiSource/Applications/kimwitu++/kc: 3.00% (19.7371 => 20.3291, std.dev.: 0.0343) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (10.3203 => 10.6283, std.dev.: 0.0433) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.94% (51.1089 => 52.6129, std.dev.: 0.1327) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (2.0440 => 2.1040, std.dev.: 0.0210) MultiSource/Applications/ClamAV/clamscan: 2.43% (20.2445 => 20.7365, std.dev.: 0.0520) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0143) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 2.14% (38.9366 => 39.7686, std.dev.: 0.0642) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.99% (6.0244 => 6.1444, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (16.5963 => 16.9203, std.dev.: 0.0726) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.72% (25.1895 => 25.6216, std.dev.: 0.0366) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0461) MultiSource/Applications/siod/siod: 12.30% (2.8282 => 3.1762, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.02% (3.4842 => 3.6242, std.dev.: 0.0319) MultiSource/Applications/sqlite3/sqlite3: 3.42% (4.0923 => 4.2323, std.dev.: 0.0160) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0369) MultiSource/Applications/lua/lua: 2.64% (21.6534 => 22.2254, std.dev.: 0.0542) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.04% (5.0963 => 5.2003, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (0.6840 => 0.6960, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.74% (5.9604 => 6.0644, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0176) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4041 => 1.4201, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0167) SingleSource/UnitTests/Vector/constpool: -81.59% (10.9087 => 2.0081, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.45% (1.5881 => 1.1681, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: -22.21% (2.6481 => 2.0600, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.31% (7.4801 => 6.2600, std.dev.: 0.0485) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.73% (7.5041 => 6.3240, std.dev.: 0.0482) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -2.84% (13.5243 => 13.1403, std.dev.: 0.0373) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.68% (21.6534 => 17.8251, std.dev.: 0.0547) SingleSource/Benchmarks/Linpack/linpack-pc: -15.49% (7.8005 => 6.5924, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (0.9281 => 0.8561, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (5.1603 => 5.0283, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0288) MultiSource/Applications/JM/lencod/lencod: -1.49% (8.3085 => 8.1845, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -1.13% (11.6527 => 11.5207, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -1.10% (2.9122 => 2.8802, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 16:54:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 18:54:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140419235454.E625B2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24757?compare_to=24754&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24757, Order: 206688, Start Time: 2014-04-19 19:21:45, End Time: 2014-04-20 00:01:27 To: 24754, Order: 206685, Start Time: 2014-04-19 17:18:48, End Time: 2014-04-19 22:00:29 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (102 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/methcall: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 19.23% (0.1040 => 0.1240, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 8.82% (0.4080 => 0.4440, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary: 4.23% (0.2840 => 0.2960, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/strcat: 15.15% (0.1320 => 0.1520, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.26% (1.2201 => 1.2721, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -1.72% (0.6960 => 0.6840, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0111) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.4120 => 0.4440, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (10.6960 => 11.4960, std.dev.: 0.0765) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0136) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (8.1441 => 8.5641, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0478) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (5.8400 => 6.0520, std.dev.: 0.0349) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.49% (1.3760 => 1.4240, std.dev.: 0.0185) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0456) MultiSource/Applications/JM/lencod/lencod: 3.16% (17.6165 => 18.1725, std.dev.: 0.0353) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0531) MultiSource/Applications/sqlite3/sqlite3: 2.63% (23.7574 => 24.3815, std.dev.: 0.0503) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0091) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.43% (48.1088 => 49.2770, std.dev.: 0.0870) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0161) MultiSource/Benchmarks/Bullet/bullet: 2.00% (37.0925 => 37.8326, std.dev.: 0.0649) MultiSource/Applications/kimwitu++/kc: 1.87% (18.8170 => 19.1690, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0560) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/strcat: 18.75% (0.1280 => 0.1520, std.dev.: 0.0070) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (25.8896 => 26.9257, std.dev.: 0.0353) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 2.69% (21.1533 => 21.7214, std.dev.: 0.1415) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.77% (4.0643 => 4.1363, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0215) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -14.15% (7.7485 => 6.6524, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (2.3881 => 2.2521, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/misr: -4.55% (0.2640 => 0.2520, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0043) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 17:17:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 19:17:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140420001733.23BB42A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24758?compare_to=24751&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24758, Order: 206688, Start Time: 2014-04-19 19:40:54, End Time: 2014-04-20 00:24:10 To: 24751, Order: 206684, Start Time: 2014-04-19 14:54:49, End Time: 2014-04-19 19:37:47 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 10 (153 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 50.00% (0.0400 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.82% (0.3520 => 0.3760, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/strcat: 5.00% (0.2400 => 0.2520, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.4120 => 0.4280, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.4560 => 0.4720, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.36% (11.3687 => 3.0282, std.dev.: 0.0126) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0123) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0082) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0043) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.18% (0.0680 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0164) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1880 => 0.2160, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 13.33% (0.1200 => 0.1360, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 13.10% (0.3360 => 0.3800, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.2360 => 0.2640, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.80% (1.4241 => 1.5921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.97% (0.6200 => 0.6880, std.dev.: 0.0241) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.24% (1.5241 => 1.6801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.46% (1.7761 => 1.9441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: 8.99% (1.8680 => 2.0360, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.73% (1.4201 => 1.5441, std.dev.: 0.0092) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.7841 => 1.9361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0147) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.3480 => 0.3760, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.63% (1.5201 => 1.6361, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0097) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.28% (11.6440 => 12.4920, std.dev.: 0.0459) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.4400 => 0.4720, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (6.4680 => 6.9000, std.dev.: 0.0336) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.44% (1.7400 => 1.8520, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (5.8121 => 6.1481, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0200) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.19% (9.4842 => 9.9762, std.dev.: 0.0602) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.16% (0.6200 => 0.6520, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0277) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0135) MultiSource/Applications/treecc/treecc: 4.64% (2.5840 => 2.7040, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (5.3600 => 5.6080, std.dev.: 0.0402) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (10.0443 => 10.5083, std.dev.: 0.0269) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.58% (6.5440 => 6.8440, std.dev.: 0.0524) MultiSource/Applications/lua/lua: 4.51% (4.7880 => 5.0040, std.dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 4.46% (21.9606 => 22.9408, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (6.5080 => 6.7800, std.dev.: 0.0627) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.09% (50.0290 => 52.0770, std.dev.: 0.0557) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0112) MultiSource/Applications/SPASS/SPASS: 3.67% (18.4404 => 19.1166, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (3.0282 => 3.1282, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 3.16% (38.4046 => 39.6166, std.dev.: 0.0494) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0179) MultiSource/Applications/ClamAV/clamscan: 3.07% (19.0444 => 19.6284, std.dev.: 0.0651) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.02% (1.3240 => 1.3640, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (16.3483 => 16.7923, std.dev.: 0.0458) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0265) MultiSource/Applications/kimwitu++/kc: 2.62% (19.6891 => 20.2051, std.dev.: 0.0348) MultiSource/Benchmarks/PAQ8p/paq8p: 1.58% (2.7922 => 2.8362, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 1.31% (25.6856 => 26.0216, std.dev.: 0.0327) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (6.1044 => 6.1804, std.dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.77% (2.1401 => 2.4562, std.dev.: 0.0322) MultiSource/Applications/siod/siod: 11.19% (2.8602 => 3.1802, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.78% (0.3600 => 0.3880, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.25% (0.1920 => 0.2040, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.89% (0.7200 => 0.7480, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0335) MultiSource/Applications/minisat/minisat: 2.76% (6.6684 => 6.8524, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.63% (4.1003 => 4.2083, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.61% (3.9842 => 4.0883, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (3.9922 => 4.0963, std.dev.: 0.0148) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.0881 => 1.1161, std.dev.: 0.0098) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.89% (2.9442 => 0.9160, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: -31.25% (0.0640 => 0.0440, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.25% (91.8497 => 49.3711, std.dev.: 10.2917) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.43% (26.0616 => 17.0891, std.dev.: 0.1403) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.39% (50.3031 => 33.0021, std.dev.: 0.1061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.11% (42.1466 => 28.6138, std.dev.: 0.8098) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1107) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.16% (7.7845 => 6.7604, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -3.78% (2.7522 => 2.6482, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.83% (4.8083 => 4.6723, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.62% (4.1243 => 4.0163, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0178) MultiSource/Benchmarks/mafft/pairlocalalign: -1.17% (26.6977 => 26.3856, std.dev.: 0.0286) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 17:47:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 19:47:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140420004741.D41C12A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24759?compare_to=24752&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24759, Order: 206688, Start Time: 2014-04-19 20:11:34, End Time: 2014-04-20 00:54:18 To: 24752, Order: 206684, Start Time: 2014-04-19 15:25:34, End Time: 2014-04-19 20:08:27 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (163 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-13-SDivTwo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 10.00% (0.2000 => 0.2200, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: 5.17% (0.2320 => 0.2440, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 8.02% (3.7442 => 4.0443, std.dev.: 0.0705) MultiSource/Applications/obsequi/Obsequi: 2.12% (2.0761 => 2.1201, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/mandel-2: 1.22% (0.9841 => 0.9961, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0054) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0061) SingleSource/Regression/C/ConstructorDestructorAttributes: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 327.63% (0.2320 => 0.9921, std.dev.: 0.0087) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0120) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0091) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0024) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0070) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0053) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 44.25% (1.3920 => 2.0080, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 26.67% (0.0600 => 0.0760, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.13% (1.1761 => 1.4481, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.55% (1.1321 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.73% (1.1761 => 1.4081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.94% (1.2881 => 1.5321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0133) MultiSource/Applications/JM/ldecod/ldecod: 18.51% (8.5802 => 10.1683, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.40% (1.1521 => 1.3641, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 15.50% (19.5406 => 22.5687, std.dev.: 0.0555) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0118) MultiSource/Benchmarks/nbench/nbench: 15.09% (1.3521 => 1.5561, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (5.3360 => 6.0961, std.dev.: 0.0433) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.66% (0.3160 => 0.3560, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0120) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 9.42% (11.3843 => 12.4563, std.dev.: 0.0247) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 9.15% (0.6120 => 0.6680, std.dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 8.97% (6.2844 => 6.8484, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (11.4440 => 12.4040, std.dev.: 0.0603) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.05% (5.6680 => 6.1240, std.dev.: 0.0528) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.41% (0.6480 => 0.6960, std.dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.39% (9.5802 => 10.2882, std.dev.: 0.0318) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.2200 => 0.2360, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.19% (5.7280 => 6.1400, std.dev.: 0.0605) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.07% (0.7360 => 0.7880, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0059) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.44% (1.3240 => 1.3960, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0275) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0202) MultiSource/Applications/lua/lua: 4.61% (4.7720 => 4.9920, std.dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.22% (6.8280 => 7.1160, std.dev.: 0.0442) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.1480 => 1.1960, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 4.16% (5.3840 => 5.6080, std.dev.: 0.0320) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0151) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.68% (49.1529 => 50.9609, std.dev.: 0.1103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (2.7282 => 2.8082, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: 2.85% (19.2243 => 19.7724, std.dev.: 0.0694) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 2.71% (24.7575 => 25.4295, std.dev.: 0.0484) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 2.33% (19.7491 => 20.2091, std.dev.: 0.0449) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.23% (1.4320 => 1.4640, std.dev.: 0.0116) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: 1.58% (39.0726 => 39.6886, std.dev.: 0.0443) MultiSource/Applications/SPASS/SPASS: 1.34% (18.7966 => 19.0485, std.dev.: 0.0657) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0124 => 6.0844, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0138) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0186) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 3.81% (6.8204 => 7.0804, std.dev.: 0.0334) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 3.25% (4.0563 => 4.1883, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: 1.63% (0.9801 => 0.9961, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (25.4536 => 25.7656, std.dev.: 0.0376) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (4.0443 => 4.0923, std.dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.11% (3.2362 => 3.2722, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -19.12% (8.9566 => 7.2445, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.38% (21.6534 => 17.8891, std.dev.: 0.0420) SingleSource/Benchmarks/Linpack/linpack-pc: -16.34% (7.8605 => 6.5764, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0739) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 18:08:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 20:08:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140420010856.2D2FF2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24760?compare_to=24753&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24760, Order: 206688, Start Time: 2014-04-19 20:29:35, End Time: 2014-04-20 01:15:32 To: 24753, Order: 206684, Start Time: 2014-04-19 15:40:42, End Time: 2014-04-19 20:26:29 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 8 (137 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C/PR640: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.33% (0.2400 => 0.2600, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.55% (0.2120 => 0.2280, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.93% (1.1601 => 1.2521, std.dev.: 0.0193) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.91% (17.6723 => 19.7763, std.dev.: 0.0541) MultiSource/Applications/sqlite3/sqlite3: 1428.00% (1.7001 => 25.9776, std.dev.: 0.0467) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.90% (50.1010 => 52.0530, std.dev.: 0.0383) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.53% (11.3920 => 12.3640, std.dev.: 0.0613) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0134) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1243, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0104) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0072) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0050) SingleSource/UnitTests/Vector/simple: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/Regression/C/PR640: 80.00% (0.0200 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.47% (1.8361 => 2.1201, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.01% (1.9721 => 2.2681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.97% (1.9241 => 2.2121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.05% (1.8081 => 2.0441, std.dev.: 0.0078) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.50% (2.1441 => 2.4122, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.60% (2.0681 => 2.3081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.60% (2.1041 => 2.3481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0051) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.40% (1.8601 => 2.0721, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.88% (1.9481 => 2.1601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.33% (0.1440 => 0.1560, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0064) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.11% (0.7400 => 0.8000, std.dev.: 0.0203) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.72% (1.0880 => 1.1720, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (6.4800 => 6.8880, std.dev.: 0.0392) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.7480 => 1.8520, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0152) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.84% (0.6160 => 0.6520, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0163) MultiSource/Applications/spiff/spiff: 5.51% (1.0160 => 1.0720, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0201) MultiSource/Benchmarks/nbench/nbench: 5.42% (1.7721 => 1.8681, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (5.8281 => 6.1081, std.dev.: 0.0397) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.53% (6.5320 => 6.8280, std.dev.: 0.0333) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (9.6042 => 10.0282, std.dev.: 0.0366) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.2283 => 10.6764, std.dev.: 0.0292) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 2.89% (7.0524 => 7.2565, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/gs/gs: 2.89% (5.3960 => 5.5520, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (6.5360 => 6.7240, std.dev.: 0.0594) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 2.74% (22.2206 => 22.8287, std.dev.: 0.0438) MultiSource/Applications/SPASS/SPASS: 2.55% (18.5284 => 19.0006, std.dev.: 0.0633) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (16.3003 => 16.6923, std.dev.: 0.0582) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0179) MultiSource/Benchmarks/Bullet/bullet: 2.03% (38.6366 => 39.4206, std.dev.: 0.1130) MultiSource/Applications/kimwitu++/kc: 2.00% (19.8291 => 20.2251, std.dev.: 0.0454) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.42% (2.1201 => 2.4682, std.dev.: 0.0357) MultiSource/Applications/siod/siod: 11.03% (2.8642 => 3.1802, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.35% (0.3680 => 0.3840, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 3.40% (6.5964 => 6.8204, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9684 => 6.0644, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.03% (8.1285 => 8.2125, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0220) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.61% (2.9562 => 0.9280, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.85% (94.8339 => 49.4591, std.dev.: 10.1046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.89% (49.9431 => 33.0181, std.dev.: 0.1821) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.48% (25.7136 => 17.1051, std.dev.: 0.0709) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.1020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.42% (37.0863 => 28.7698, std.dev.: 0.5658) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.66% (7.8165 => 6.7484, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -12.23% (2.7482 => 2.4122, std.dev.: 0.1278) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.31% (2.7722 => 2.7082, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (4.1123 => 4.0483, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 19:42:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 21:42:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140420024234.B6FDB2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24761?compare_to=24757&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24761, Order: 206703, Start Time: 2014-04-19 22:09:06, End Time: 2014-04-20 02:49:09 To: 24757, Order: 206688, Start Time: 2014-04-19 19:21:45, End Time: 2014-04-20 00:01:27 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (111 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/tls: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C/PR640: 100.00% (0.0160 => 0.0320, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 40.00% (0.0400 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0800 => 0.0920, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.29% (0.2240 => 0.2560, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.47% (0.3800 => 0.4160, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/neural/neural: 6.38% (0.1880 => 0.2000, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (6.0200 => 6.1120, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.09% (1.4721 => 1.4881, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.41% (3.4042 => 3.5882, std.dev.: 0.0528) SingleSource/Benchmarks/Shootout-C++/hash: 3.94% (0.5080 => 0.5280, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/printargs: -80.00% (0.0200 => 0.0040, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0022) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.28% (0.2280 => 0.2560, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0691) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.38% (5.8000 => 6.1120, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0178) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0352) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0263) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (10.4082 => 10.8162, std.dev.: 0.0372) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0550) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0537) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0344) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (7.8562 => 8.0922, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0245) MultiSource/Applications/sqlite3/sqlite3: 2.64% (23.7574 => 24.3855, std.dev.: 0.0387) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.24% (48.1088 => 49.1850, std.dev.: 0.0843) MultiSource/Applications/kimwitu++/kc: 2.00% (18.8170 => 19.1931, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: 1.92% (37.0925 => 37.8045, std.dev.: 0.0729) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0464) MultiSource/Applications/ClamAV/clamscan: 1.24% (17.4082 => 17.6242, std.dev.: 0.0507) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 6.15% (3.3802 => 3.5882, std.dev.: 0.0528) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (25.8896 => 26.9577, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0112) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 2.57% (21.1533 => 21.6974, std.dev.: 0.0608) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.24% (0.8641 => 0.8361, std.dev.: 0.0076) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 20:31:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 22:31:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140420033115.DFEA82A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24762?compare_to=24761&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24762, Order: 206705, Start Time: 2014-04-19 22:56:01, End Time: 2014-04-20 03:37:50 To: 24761, Order: 206703, Start Time: 2014-04-19 22:09:06, End Time: 2014-04-20 02:49:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 24 (111 on baseline) Performance Improvements: 4 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1084 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-02-04-DivRem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 50.00% (0.0320 => 0.0480, std.dev.: 0.0061) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 15.79% (0.1520 => 0.1760, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.33% (0.1440 => 0.1560, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 5.17% (0.2320 => 0.2440, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4920 => 0.5080, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.5240 => 0.5360, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.94% (1.2401 => 1.2641, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.57% (1.2721 => 1.2921, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.50% (1.3321 => 1.3521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.27% (1.2561 => 1.2721, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 1.16% (5.8564 => 5.9244, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 16.28% (0.1720 => 0.2000, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.46% (1.1721 => 1.2361, std.dev.: 0.0207) MultiSource/Applications/obsequi/Obsequi: 3.13% (2.0441 => 2.1081, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.39% (0.8361 => 0.8561, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 2.29% (21.6974 => 22.1934, std.dev.: 0.1357) MultiSource/Benchmarks/sim/sim: 2.23% (4.6643 => 4.7683, std.dev.: 0.0199) SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -5.80% (4.6923 => 4.4203, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.72% (1.3961 => 1.3441, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.1123 => 4.0323, std.dev.: 0.0193) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.81% (0.1240 => 0.1560, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: 18.92% (0.1480 => 0.1760, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.92% (1.2081 => 1.3521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.15% (1.1841 => 1.3161, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.58% (6.0160 => 6.4720, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0540) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (8.1441 => 8.5761, std.dev.: 0.0397) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (5.8000 => 6.0960, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (4.9200 => 5.1560, std.dev.: 0.0388) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0354) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (10.4082 => 10.8362, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (5.8400 => 6.0600, std.dev.: 0.0292) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0094) MultiSource/Applications/JM/lencod/lencod: 3.38% (17.6165 => 18.2125, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4920 => 0.5080, std.dev.: 0.0041) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.74% (48.1088 => 49.4289, std.dev.: 0.0802) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.5480 => 1.5880, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0105) MultiSource/Applications/oggenc/oggenc: 2.21% (5.7964 => 5.9244, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0529) MultiSource/Benchmarks/Bullet/bullet: 1.93% (37.0925 => 37.8085, std.dev.: 0.0873) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0103) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0186) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0394) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0569) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (15.2282 => 15.4162, std.dev.: 0.0355) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.11% (0.1800 => 0.2000, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 4.92% (21.1533 => 22.1934, std.dev.: 0.1357) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: 3.17% (25.8896 => 26.7097, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0024) MultiSource/Applications/obsequi/Obsequi: 1.93% (2.0681 => 2.1081, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.79% (4.6843 => 4.7683, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0154) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -19.72% (0.2840 => 0.2280, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.35% (2.0681 => 2.0401, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 20:38:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 22:38:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140420033826.ACBE22A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24763?compare_to=24761&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24763, Order: 206704, Start Time: 2014-04-19 23:04:41, End Time: 2014-04-20 03:45:01 To: 24761, Order: 206703, Start Time: 2014-04-19 22:09:06, End Time: 2014-04-20 02:49:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 20 (114 on baseline) Performance Improvements: 5 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1087 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/printargs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/pointer_method2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.74% (0.0920 => 0.1120, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.67% (0.3000 => 0.3320, std.dev.: 0.0103) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1360 => 0.1480, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.45% (0.3480 => 0.3600, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.37% (0.3560 => 0.3680, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.7160 => 0.7360, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.25% (1.2441 => 1.2721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.15% (1.3881 => 1.4041, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.8361 => 0.8601, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 2.19% (21.6974 => 22.1734, std.dev.: 0.1288) SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (2.3201 => 2.3441, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -7.69% (3.5882 => 3.3122, std.dev.: 0.0748) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.80% (4.6923 => 4.4203, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.01% (1.3961 => 1.3401, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: -2.43% (4.1123 => 4.0122, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/hash2: -1.10% (2.9202 => 2.8882, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.00% (0.1600 => 0.1840, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.97% (1.1361 => 1.2721, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.00% (1.2361 => 1.3721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.69% (1.2801 => 1.4041, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0139) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.75% (0.3200 => 0.3480, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0472) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0569) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0037) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.72% (1.1880 => 1.2560, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.67% (0.9880 => 1.0440, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (5.8000 => 6.0960, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0065) SingleSource/Benchmarks/Linpack/linpack-pc: 5.06% (0.3160 => 0.3320, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0567) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (4.9000 => 5.0880, std.dev.: 0.0270) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0439) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0335) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0428) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 3.11% (17.6165 => 18.1645, std.dev.: 0.0378) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0385) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.75% (48.1088 => 49.4329, std.dev.: 0.1018) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0396) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9125, std.dev.: 0.0420) MultiSource/Applications/kimwitu++/kc: 2.13% (18.8170 => 19.2171, std.dev.: 0.0398) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7964 => 5.9084, std.dev.: 0.0204) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0346) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0509) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0183) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 4.82% (21.1533 => 22.1734, std.dev.: 0.1288) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (25.8896 => 26.7857, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones/fhourstones: -11.36% (0.1760 => 0.1560, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 20:42:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 22:42:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140420034228.AEB122A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24764?compare_to=24762&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24764, Order: 206707, Start Time: 2014-04-19 23:05:19, End Time: 2014-04-20 03:49:01 To: 24762, Order: 206705, Start Time: 2014-04-19 22:56:01, End Time: 2014-04-20 03:37:50 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (108 on baseline) Performance Improvements: 7 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.82% (1.3161 => 1.3401, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: 6.15% (4.4203 => 4.6923, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 5.81% (1.2401 => 1.3121, std.dev.: 0.0267) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (1.3441 => 1.3961, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.85% (0.3120 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.26% (0.7360 => 0.7600, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.60% (4.4563 => 4.5723, std.dev.: 0.0379) MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.0323 => 4.1083, std.dev.: 0.0191) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2006-12-11-LoadConstants: -12.82% (0.1560 => 0.1360, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.74% (1.2361 => 1.1281, std.dev.: 0.0182) MultiSource/Applications/lua/lua: -2.11% (22.1934 => 21.7254, std.dev.: 0.0945) SingleSource/Benchmarks/McGill/queens: -1.97% (2.2281 => 2.1841, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: -1.36% (2.3481 => 2.3161, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: -1.01% (6.7204 => 6.6524, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (4.0003 => 3.9602, std.dev.: 0.0148) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0659) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0065) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.39% (1.1880 => 1.2520, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (1.3760 => 1.4440, std.dev.: 0.0195) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0445) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0334) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (5.8000 => 6.0520, std.dev.: 0.0357) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (1.5200 => 1.5760, std.dev.: 0.0190) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0197) MultiSource/Applications/JM/lencod/lencod: 3.25% (17.6165 => 18.1885, std.dev.: 0.0453) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0482) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0289) MultiSource/Applications/sqlite3/sqlite3: 2.58% (23.7574 => 24.3695, std.dev.: 0.0566) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2330, std.dev.: 0.0690) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.24% (1.9640 => 2.0080, std.dev.: 0.0164) MultiSource/Applications/hbd/hbd: 2.14% (1.6800 => 1.7160, std.dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0474) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: 2.09% (37.0925 => 37.8685, std.dev.: 0.0333) MultiSource/Applications/kimwitu++/kc: 2.00% (18.8170 => 19.1930, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0091) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0153) MultiSource/Applications/ClamAV/clamscan: 1.24% (17.4082 => 17.6242, std.dev.: 0.0269) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0526) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (25.8896 => 26.9297, std.dev.: 0.0308) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0111) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 2.70% (21.1533 => 21.7254, std.dev.: 0.0945) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0086) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0204) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0071) SingleSource/Benchmarks/SmallPT/smallpt: 1.20% (14.0009 => 14.1689, std.dev.: 0.0292) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -44.44% (0.0360 => 0.0200, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -14.15% (7.7485 => 6.6524, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.48% (1.2601 => 1.1281, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 21:24:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 23:24:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140420042413.3F7892A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24765?compare_to=24755&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24765, Order: 206707, Start Time: 2014-04-19 23:44:15, End Time: 2014-04-20 04:30:49 To: 24755, Order: 206685, Start Time: 2014-04-19 18:54:25, End Time: 2014-04-19 23:41:04 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1094 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-18-LoopBug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.75% (0.0640 => 0.0760, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 10.64% (0.1880 => 0.2080, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.33% (0.2400 => 0.2600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.79% (0.3080 => 0.3320, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.76% (0.2520 => 0.2640, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.90% (2.1000 => 2.1400, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.73% (1.8481 => 1.8801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.37% (1.7481 => 1.7721, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 1.06% (5.6440 => 5.7040, std.dev.: 0.0208) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 44.44% (0.0360 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.30% (4.7003 => 4.8083, std.dev.: 0.0355) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: -41.67% (0.0480 => 0.0280, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: -7.50% (0.3200 => 0.2960, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0100) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 21:31:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 23:31:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140420043100.D35632A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24766?compare_to=24756&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24766, Order: 206707, Start Time: 2014-04-19 23:48:43, End Time: 2014-04-20 04:37:37 To: 24756, Order: 206685, Start Time: 2014-04-19 18:57:12, End Time: 2014-04-19 23:45:31 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (148 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/2003-05-14-array-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 36.84% (0.0760 => 0.1040, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0049) MultiSource/Benchmarks/llubenchmark/llu: 33.33% (0.0480 => 0.0640, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.57% (0.0840 => 0.1080, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 26.67% (0.0600 => 0.0760, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.18% (0.0880 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.88% (0.2040 => 0.2160, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 3.54% (0.4520 => 0.4680, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.39% (0.0920 => 0.1080, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 300.00% (0.0120 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.82% (1.6681 => 2.0321, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.53% (1.6721 => 2.0321, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.15% (1.7401 => 2.1081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.88% (1.7241 => 2.0841, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.82% (1.7481 => 2.1121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.59% (1.7681 => 2.1321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.94% (1.9641 => 2.3361, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.69% (0.7800 => 0.8400, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.66% (0.9920 => 1.0680, std.dev.: 0.0147) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4360 => 0.4680, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.85% (11.7880 => 12.5960, std.dev.: 0.0647) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.63% (3.5002 => 3.7322, std.dev.: 0.0259) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (6.7200 => 7.1640, std.dev.: 0.0542) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 5.59% (4.7920 => 5.0600, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (1.7280 => 1.8240, std.dev.: 0.0208) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.4160 => 1.4920, std.dev.: 0.0230) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.17% (0.2320 => 0.2440, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (1.2400 => 1.3000, std.dev.: 0.0233) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.76% (0.7560 => 0.7920, std.dev.: 0.0092) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.75% (1.3480 => 1.4120, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0252) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.45% (9.9842 => 10.4282, std.dev.: 0.0555) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0086) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0201) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (2.0440 => 2.1240, std.dev.: 0.0174) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.3203 => 10.7003, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0141) MultiSource/Applications/SPASS/SPASS: 3.61% (18.4924 => 19.1606, std.dev.: 0.0417) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (6.8321 => 7.0761, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.23% (0.3720 => 0.3840, std.dev.: 0.0043) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.21% (1.3720 => 1.4160, std.dev.: 0.0135) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0300) MultiSource/Applications/kimwitu++/kc: 3.20% (19.7371 => 20.3691, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.7320 => 1.7840, std.dev.: 0.0180) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.95% (51.1089 => 52.6169, std.dev.: 0.1174) MultiSource/Applications/lemon/lemon: 2.68% (1.4921 => 1.5321, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.67% (22.6287 => 23.2327, std.dev.: 0.0605) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 2.15% (20.2445 => 20.6805, std.dev.: 0.0822) MultiSource/Benchmarks/Bullet/bullet: 2.15% (38.9366 => 39.7726, std.dev.: 0.0562) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (2.7722 => 2.8282, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (16.5963 => 16.8923, std.dev.: 0.0590) MultiSource/Applications/sqlite3/sqlite3: 1.41% (25.1895 => 25.5456, std.dev.: 0.0595) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0244 => 6.1044, std.dev.: 0.0228) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.03% (29.4578 => 29.7619, std.dev.: 0.0398) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.16% (2.8282 => 3.1722, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.90% (3.4842 => 3.6202, std.dev.: 0.0223) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 3.62% (4.0923 => 4.2403, std.dev.: 0.0112) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0480) MultiSource/Applications/lua/lua: 2.79% (21.6534 => 22.2574, std.dev.: 0.0834) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.44% (3.4402 => 3.5242, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0177) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (4.1323 => 4.2083, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.49% (4.0203 => 4.0803, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.28% (0.9401 => 0.9521) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.13% (4.6083 => 4.6603, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0136) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/nestedloop: -60.86% (2.9642 => 1.1601, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.18% (3.1762 => 1.3601, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.44% (1.5881 => 1.1841, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0118) MultiSource/Applications/obsequi/Obsequi: -21.00% (2.6481 => 2.0920, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.47% (7.4801 => 6.2480, std.dev.: 0.0472) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.62% (7.5041 => 6.3320, std.dev.: 0.0264) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0097) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -2.48% (13.5243 => 13.1883, std.dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.22% (21.6534 => 17.9251, std.dev.: 0.0143) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.66% (3.4442 => 3.0082, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -2.79% (5.1603 => 5.0163, std.dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0223) MultiSource/Applications/JM/lencod/lencod: -1.59% (8.3085 => 8.1765, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -1.13% (11.6527 => 11.5207, std.dev.: 0.0331) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 21:37:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Apr 2014 23:37:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140420043757.F152F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24767?compare_to=24764&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24767, Order: 206708, Start Time: 2014-04-20 00:04:43, End Time: 2014-04-20 04:44:31 To: 24764, Order: 206707, Start Time: 2014-04-19 23:05:19, End Time: 2014-04-20 03:49:01 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (108 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.29% (0.0840 => 0.0960, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.55% (0.2120 => 0.2280, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 6.98% (0.1720 => 0.1840, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.9040 => 0.9560, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.66% (0.4240 => 0.4480, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 3.09% (0.7760 => 0.8000, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0600 => 0.0800, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bisort/bisort: 2.17% (0.7360 => 0.7520, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0154) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0730) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0454) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 5.67% (0.9880 => 1.0440, std.dev.: 0.0175) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0442) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0531) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0265) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (4.9000 => 5.0640, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0471) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0367) MultiSource/Applications/sqlite3/sqlite3: 2.59% (23.7574 => 24.3735, std.dev.: 0.0313) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.59% (48.1088 => 49.3530, std.dev.: 0.0500) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 2.00% (18.8170 => 19.1931, std.dev.: 0.0300) MultiSource/Benchmarks/Bullet/bullet: 1.97% (37.0925 => 37.8245, std.dev.: 0.0676) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0133) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: 1.22% (17.4082 => 17.6202, std.dev.: 0.0561) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0641) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Treesort: 17.65% (0.0680 => 0.0800, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 13.19% (2.8802 => 3.2602, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (25.8896 => 26.9257, std.dev.: 0.0496) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.98% (4.5603 => 4.6963, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 2.97% (21.1533 => 21.7814, std.dev.: 0.0766) MultiSource/Applications/lemon/lemon: 2.83% (0.9881 => 1.0161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0149) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 1.68% (6.6564 => 6.7684, std.dev.: 0.0340) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.0643 => 4.1283, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.64% (10.8967 => 2.0001, std.dev.: 0.0141) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.50% (0.1600 => 0.1400, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.57% (1.2601 => 1.1521, std.dev.: 0.0191) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/misr: -4.55% (0.2640 => 0.2520, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0054) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 22:04:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 00:04:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140420050408.14B702A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24768?compare_to=24758&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24768, Order: 206710, Start Time: 2014-04-20 00:27:34, End Time: 2014-04-20 05:10:40 To: 24758, Order: 206688, Start Time: 2014-04-19 19:40:54, End Time: 2014-04-20 00:24:10 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 12 (159 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (926 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Bubblesort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/exptree: 16.00% (0.1000 => 0.1160, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 5.26% (0.3040 => 0.3200, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 4.00% (0.3000 => 0.3120, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: 3.70% (0.3240 => 0.3360, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/power/power: -21.15% (0.2080 => 0.1640, std.dev.: 0.0168) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.19% (11.3687 => 3.0482, std.dev.: 0.0115) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0131) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0093) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Bubblesort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.92% (0.2920 => 0.3560, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.6600 => 0.7480, std.dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.09% (1.4561 => 1.6321, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.08% (1.4241 => 1.5961, std.dev.: 0.0113) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.97% (0.6200 => 0.6880, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (1.5521 => 1.7041, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 9.59% (0.5840 => 0.6400, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.93% (1.6121 => 1.7561, std.dev.: 0.0084) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.53% (1.5481 => 1.6801, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.33% (0.2400 => 0.2600, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ary3: 8.11% (0.2960 => 0.3200, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.09% (1.4841 => 1.6041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.83% (1.7361 => 1.8721, std.dev.: 0.0130) MultiSource/Applications/obsequi/Obsequi: 7.71% (1.8680 => 2.0120, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.04% (0.2840 => 0.3040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 6.90% (1.5080 => 1.6120, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.4680 => 6.8720, std.dev.: 0.0432) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.15% (11.6440 => 12.3600, std.dev.: 0.0718) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0213) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.95% (9.4842 => 10.0482, std.dev.: 0.0378) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (1.5480 => 1.6400, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.88% (0.7480 => 0.7920, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.71% (5.8121 => 6.1441, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (2.0440 => 2.1560, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.2960 => 0.3120, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0333) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.58% (6.5440 => 6.8440, std.dev.: 0.0330) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.55% (6.5080 => 6.8040, std.dev.: 0.0418) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.0443 => 10.4683, std.dev.: 0.0444) MultiSource/Applications/JM/lencod/lencod: 4.12% (21.9606 => 22.8648, std.dev.: 0.0572) MultiSource/Benchmarks/MallocBench/gs/gs: 4.10% (5.3600 => 5.5800, std.dev.: 0.0443) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.5600 => 1.6240, std.dev.: 0.0159) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.07% (50.0290 => 52.0650, std.dev.: 0.0683) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.95% (2.1240 => 2.2080, std.dev.: 0.0126) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 3.76% (4.7880 => 4.9680, std.dev.: 0.0315) SingleSource/Benchmarks/Linpack/linpack-pc: 3.70% (0.3240 => 0.3360, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.55% (1.4640 => 1.5160, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 3.41% (18.4404 => 19.0686, std.dev.: 0.0535) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 3.26% (6.9844 => 7.2124, std.dev.: 0.0211) MultiSource/Applications/ClamAV/clamscan: 3.19% (19.0444 => 19.6524, std.dev.: 0.0710) MultiSource/Benchmarks/Bullet/bullet: 3.12% (38.4046 => 39.6046, std.dev.: 0.0805) MultiSource/Applications/treecc/treecc: 2.94% (2.5840 => 2.6600, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (16.3483 => 16.8083, std.dev.: 0.0376) MultiSource/Applications/kimwitu++/kc: 2.70% (19.6891 => 20.2211, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.7480 => 0.7680, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0198) MultiSource/Applications/d/make_dparser: 2.52% (3.9681 => 4.0681, std.dev.: 0.0192) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 1.43% (2.7922 => 2.8322, std.dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (13.0563 => 13.2283, std.dev.: 0.0327) MultiSource/Applications/sqlite3/sqlite3: 1.17% (25.6856 => 25.9856, std.dev.: 0.0349) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.46% (2.1401 => 2.4282, std.dev.: 0.0546) MultiSource/Applications/siod/siod: 11.33% (2.8602 => 3.1842, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: 3.13% (7.4205 => 7.6525, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.82% (6.6684 => 6.8564, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: 2.51% (3.9842 => 4.0843, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.44% (4.1003 => 4.2003, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (3.9922 => 4.0763, std.dev.: 0.0253) MultiSource/Applications/lua/lua: 2.04% (21.7374 => 22.1814, std.dev.: 0.0822) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.02% (2.7442 => 2.7722, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.30% (91.8497 => 49.3271, std.dev.: 10.3373) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.69% (26.0616 => 17.0211, std.dev.: 0.0902) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.27% (50.3031 => 33.0621, std.dev.: 0.2627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.04% (42.1466 => 28.6418, std.dev.: 0.4421) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1125) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.01% (4.1243 => 4.0003, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0111) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0217) MultiSource/Benchmarks/mafft/pairlocalalign: -1.32% (26.6977 => 26.3456, std.dev.: 0.0533) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 22:34:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 00:34:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140420053405.760D82A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24769?compare_to=24759&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24769, Order: 206710, Start Time: 2014-04-20 00:57:45, End Time: 2014-04-20 05:40:42 To: 24759, Order: 206688, Start Time: 2014-04-19 20:11:34, End Time: 2014-04-20 00:54:18 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (161 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.29% (0.7000 => 0.8280, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/richards_benchmark: 14.29% (0.0840 => 0.0960, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1920 => 0.2120, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.87% (2.1440 => 2.1840, std.dev.: 0.0140) MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.76% (1.3640 => 1.3880, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 6.00% (3.2682 => 3.4642, std.dev.: 0.0623) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.01% (0.9961 => 0.9761, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0080) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0101) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0078) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 200.00% (0.0120 => 0.0360, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0119) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0066) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0047) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0039) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 54.55% (0.7040 => 1.0880, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: 43.97% (1.3920 => 2.0040, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.30% (1.1841 => 1.4481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.77% (1.1761 => 1.4321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.79% (1.1721 => 1.4041, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.33% (1.2001 => 1.4321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 19.02% (8.5802 => 10.2123, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.78% (0.1800 => 0.2120, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: 15.62% (19.5406 => 22.5927, std.dev.: 0.0361) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 14.79% (1.3521 => 1.5521, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.69% (5.3360 => 6.1201, std.dev.: 0.0304) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.56% (1.7400 => 1.9760, std.dev.: 0.0132) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: 9.45% (11.3843 => 12.4603, std.dev.: 0.0353) MultiSource/Applications/oggenc/oggenc: 8.91% (6.2844 => 6.8444, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.54% (5.6680 => 6.1520, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.24% (5.7280 => 6.2000, std.dev.: 0.0529) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.72% (11.4440 => 12.3280, std.dev.: 0.0790) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.30% (9.5802 => 10.1842, std.dev.: 0.0541) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.16% (1.6240 => 1.7240, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (0.4960 => 0.5200, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.40% (2.0920 => 2.1840, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.4120 => 0.4280, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0101) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.69% (49.1529 => 50.9649, std.dev.: 0.0732) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0466) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.6961 => 1.7521, std.dev.: 0.0128) MultiSource/Benchmarks/PAQ8p/paq8p: 3.23% (2.7282 => 2.8162, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 3.06% (19.2243 => 19.8124, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.62% (24.7575 => 25.4055, std.dev.: 0.0458) MultiSource/Applications/kimwitu++/kc: 2.37% (19.7491 => 20.2171, std.dev.: 0.0400) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0189) MultiSource/Benchmarks/Bullet/bullet: 1.63% (39.0726 => 39.7086, std.dev.: 0.0642) MultiSource/Applications/SPASS/SPASS: 1.40% (18.7966 => 19.0606, std.dev.: 0.0543) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.44% (6.6644 => 17.1571, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 => 0.3200, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 6.30% (2.9842 => 3.1722, std.dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 3.65% (4.0563 => 4.2043, std.dev.: 0.0187) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 3.23% (6.8204 => 7.0404, std.dev.: 0.0346) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.14% (4.1083 => 4.1963, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (25.4536 => 25.7816, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0443 => 4.0963, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.85% (11.0207 => 2.0001, std.dev.: 0.0119) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0057) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -60.00% (0.0200 => 0.0080, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -19.12% (8.9566 => 7.2445, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.26% (21.6534 => 17.9171, std.dev.: 0.0260) SingleSource/Benchmarks/Linpack/linpack-pc: -16.39% (7.8605 => 6.5724, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0885) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.32% (4.5123 => 4.2723, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0370) MultiSource/Applications/viterbi/viterbi: -3.40% (2.7082 => 2.6162, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.06% (2.9162 => 2.8562, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (5.0963 => 5.0163, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 19 22:58:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 00:58:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140420055826.4FD6A2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24770?compare_to=24760&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24770, Order: 206710, Start Time: 2014-04-20 01:18:58, End Time: 2014-04-20 06:05:02 To: 24760, Order: 206688, Start Time: 2014-04-19 20:29:35, End Time: 2014-04-20 01:15:32 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 11 (142 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.82% (0.3520 => 0.3760, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.89% (1.2280 => 1.2880, std.dev.: 0.0220) MultiSource/Benchmarks/McCat/18-imp/imp: 4.46% (0.4480 => 0.4680, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.16% (2.0761 => 2.1001, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 28.95% (0.1520 => 0.1960, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 22.73% (0.0880 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.58% (0.9601 => 1.0041, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.52% (1.1121 => 1.1401, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.88% (17.6723 => 19.7724, std.dev.: 0.0516) MultiSource/Applications/sqlite3/sqlite3: 1424.00% (1.7001 => 25.9096, std.dev.: 0.0392) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.62% (50.1010 => 51.9170, std.dev.: 0.0698) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (11.3920 => 12.3240, std.dev.: 0.0823) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0101) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1043, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7164, std.dev.: 0.0110) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0103) SingleSource/Regression/C++/2011-03-28-Bitfield: 200.00% (0.0080 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.15% (1.8081 => 2.1001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.97% (1.9241 => 2.2121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.71% (1.8761 => 2.1521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.1120 => 0.1280, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.05% (1.8081 => 2.0441, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.41% (1.7721 => 1.9921, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.83% (1.8601 => 2.0801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.79% (2.1041 => 2.3521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0049) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.47% (1.9481 => 2.1521, std.dev.: 0.0169) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.29% (1.0880 => 1.2000, std.dev.: 0.0350) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.06% (0.6360 => 0.7000, std.dev.: 0.0218) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.68% (0.3720 => 0.4080, std.dev.: 0.0132) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.8760 => 2.0560, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.11% (0.1480 => 0.1600, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.82% (0.3520 => 0.3760, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (1.6960 => 1.8080, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0407) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.27% (1.2120 => 1.2880, std.dev.: 0.0220) MultiSource/Applications/Burg/burg: 6.02% (1.5280 => 1.6200, std.dev.: 0.0242) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.93% (2.9721 => 3.1482, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.65% (0.7080 => 0.7480, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.9960 => 1.0520, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (9.6042 => 10.0402, std.dev.: 0.0562) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (6.5320 => 6.8160, std.dev.: 0.0481) MultiSource/Applications/JM/ldecod/ldecod: 4.34% (10.2283 => 10.6724, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (5.8281 => 6.0641, std.dev.: 0.0372) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (6.5360 => 6.7800, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 3.09% (4.7920 => 4.9400, std.dev.: 0.0352) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 2.94% (18.5284 => 19.0725, std.dev.: 0.0526) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.3960 => 5.5440, std.dev.: 0.0390) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (16.3003 => 16.7403, std.dev.: 0.0473) MultiSource/Applications/JM/lencod/lencod: 2.66% (22.2206 => 22.8127, std.dev.: 0.0425) MultiSource/Applications/treecc/treecc: 2.63% (2.5880 => 2.6560, std.dev.: 0.0233) MultiSource/Applications/kimwitu++/kc: 1.98% (19.8291 => 20.2211, std.dev.: 0.0491) MultiSource/Benchmarks/Bullet/bullet: 1.97% (38.6366 => 39.3966, std.dev.: 0.0913) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0163) MultiSource/Benchmarks/PAQ8p/paq8p: 1.72% (2.7842 => 2.8322, std.dev.: 0.0096) MultiSource/Applications/d/make_dparser: 1.61% (3.9761 => 4.0401, std.dev.: 0.0248) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0363 => 13.1683, std.dev.: 0.0509) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.31% (2.1201 => 2.5082, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 11.17% (2.8642 => 3.1842, std.dev.: 0.0114) MultiSource/Benchmarks/llubenchmark/llu: 5.61% (5.0603 => 5.3443, std.dev.: 0.0951) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 3.15% (6.5964 => 6.8044, std.dev.: 0.0287) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (4.0003 => 4.0683, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.70% (4.4803 => 4.5563, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9684 => 6.0644, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5562 => 2.5922, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1285 => 8.2165, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.75% (1.5881 => 1.0521, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.14% (94.8339 => 49.1831, std.dev.: 10.5430) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.14% (49.9431 => 32.8941, std.dev.: 0.1661) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.18% (25.7136 => 17.1811, std.dev.: 0.1039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.42% (37.0863 => 28.4018, std.dev.: 0.3625) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1175) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.66% (7.8165 => 6.7484, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -3.78% (2.7522 => 2.6482, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8043 => 4.6803, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 00:25:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 02:25:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140420072525.258CF2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24771?compare_to=24767&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24771, Order: 206712, Start Time: 2014-04-20 02:52:39, End Time: 2014-04-20 07:31:59 To: 24767, Order: 206708, Start Time: 2014-04-20 00:04:43, End Time: 2014-04-20 04:44:31 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (115 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray: 100.00% (0.0160 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.50% (0.1280 => 0.1440, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.28% (0.6280 => 0.6800, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/bh/bh: 6.02% (0.3320 => 0.3520, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.64% (0.7760 => 0.8120, std.dev.: 0.0126) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.51% (0.5320 => 0.5560, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.24% (0.8921 => 0.9121, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.37% (1.4641 => 1.4841, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 5.84% (5.0683 => 5.3643, std.dev.: 0.0928) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.72% (3.8762 => 4.0203, std.dev.: 0.0478) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.26% (1.2481 => 1.3761, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0106) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0698) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0491) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.28% (0.7640 => 0.8120, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0484) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (4.9200 => 5.1320, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0394) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0429) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (5.8400 => 6.0440, std.dev.: 0.0528) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3480 => 0.3600, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0630) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 2.78% (23.7574 => 24.4175, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0218) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0345) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0095) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.44% (48.1088 => 49.2810, std.dev.: 0.0685) MultiSource/Applications/kimwitu++/kc: 2.08% (18.8170 => 19.2091, std.dev.: 0.0292) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0174) MultiSource/Benchmarks/Bullet/bullet: 1.82% (37.0925 => 37.7686, std.dev.: 0.0687) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0091) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0138) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0450) MultiSource/Applications/ClamAV/clamscan: 1.17% (17.4082 => 17.6122, std.dev.: 0.0532) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 13.05% (2.8802 => 3.2562, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (25.8896 => 26.9377, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0092) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.89% (4.5603 => 4.6923, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 2.50% (21.1533 => 21.6814, std.dev.: 0.0720) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (4.5203 => 4.6283, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 1.80% (6.6564 => 6.7764, std.dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0643 => 4.1163, std.dev.: 0.0169) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -14.15% (7.7485 => 6.6524, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0056) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 02:14:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 04:14:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140420091415.3A5C72A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24772?compare_to=24765&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24772, Order: 206712, Start Time: 2014-04-20 04:34:18, End Time: 2014-04-20 09:20:51 To: 24765, Order: 206707, Start Time: 2014-04-19 23:44:15, End Time: 2014-04-20 04:30:49 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1094 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: 57.14% (0.0280 => 0.0440, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C++/EH/class_hierarchy: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.13% (0.1240 => 0.1440, std.dev.: 0.0076) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.43% (0.1400 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.34% (0.1160 => 0.1280, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.38% (0.1880 => 0.2000, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.10% (0.3280 => 0.3480, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.81% (0.3440 => 0.3640, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (2.0920 => 2.1280, std.dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 2.16% (0.7400 => 0.7560, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -20.83% (0.0960 => 0.0760, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.99% (4.8083 => 4.6643, std.dev.: 0.0542) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0118) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 02:23:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 04:23:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140420092327.BCC312A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24773?compare_to=24766&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24773, Order: 206712, Start Time: 2014-04-20 04:41:03, End Time: 2014-04-20 09:30:04 To: 24766, Order: 206707, Start Time: 2014-04-19 23:48:43, End Time: 2014-04-20 04:37:37 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (139 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/2010-12-08-tls: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2006-02-04-DivRem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 14.29% (0.1400 => 0.1600, std.dev.: 0.0067) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 13.33% (0.1200 => 0.1360, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 2.31% (0.8640 => 0.8840, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.22% (6.2480 => 6.3240, std.dev.: 0.0283) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.86% (0.7000 => 0.7480, std.dev.: 0.0130) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 295.64% (0.4560 => 1.8041, std.dev.: 0.0090) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 27.66% (0.1880 => 0.2400, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.64% (1.6961 => 2.0801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.80% (1.6881 => 2.0561, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.72% (1.6761 => 2.0401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.70% (1.6961 => 2.0641, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.48% (1.7321 => 2.1041, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.31% (1.7641 => 2.1401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.02% (1.8081 => 2.1881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.88% (1.7241 => 2.0841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.88% (1.7241 => 2.0841, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.76% (1.7921 => 2.1641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.12% (1.9881 => 2.3881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/tsp/tsp: 17.65% (0.1360 => 0.1600, std.dev.: 0.0067) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.11% (0.1480 => 0.1600, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.5560 => 0.6000, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (11.7880 => 12.6520, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.63% (3.5002 => 3.7322, std.dev.: 0.0226) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.55% (6.7200 => 7.1600, std.dev.: 0.0452) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.25% (1.7280 => 1.8360, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.25% (0.1920 => 0.2040, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.7800 => 0.8280, std.dev.: 0.0183) MultiSource/Benchmarks/nbench/nbench: 5.71% (1.8201 => 1.9241, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.4160 => 1.4920, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.84% (0.9920 => 1.0400, std.dev.: 0.0175) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0448) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (9.9842 => 10.4362, std.dev.: 0.0628) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.5240 => 1.5920, std.dev.: 0.0200) MultiSource/Applications/treecc/treecc: 4.43% (2.6200 => 2.7360, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (1.0001 => 1.0441, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: 4.34% (3.9641 => 4.1361, std.dev.: 0.0193) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 3.88% (6.9124 => 7.1804, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (6.8321 => 7.0921, std.dev.: 0.0366) MultiSource/Applications/JM/ldecod/ldecod: 3.76% (10.3203 => 10.7084, std.dev.: 0.0339) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0169) MultiSource/Applications/SPASS/SPASS: 3.37% (18.4924 => 19.1165, std.dev.: 0.0483) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0126) MultiSource/Applications/minisat/minisat: 3.27% (0.8560 => 0.8840, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 3.13% (22.6287 => 23.3367, std.dev.: 0.0596) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.98% (51.1089 => 52.6329, std.dev.: 0.1027) MultiSource/Applications/kimwitu++/kc: 2.80% (19.7371 => 20.2891, std.dev.: 0.0713) MultiSource/Applications/siod/siod: 2.61% (2.7562 => 2.8282, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (3.0122 => 3.0882, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 2.35% (38.9366 => 39.8526, std.dev.: 0.0572) MultiSource/Applications/ClamAV/clamscan: 2.19% (20.2445 => 20.6885, std.dev.: 0.0749) MultiSource/Benchmarks/PAQ8p/paq8p: 2.16% (2.7722 => 2.8322, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (16.5963 => 16.9243, std.dev.: 0.0684) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0117) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.65% (25.1895 => 25.6056, std.dev.: 0.0330) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0244 => 6.1044, std.dev.: 0.0265) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0202) MultiSource/Applications/siod/siod: 12.30% (2.8282 => 3.1762, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.26% (1.2121 => 1.3001, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0234) MultiSource/Benchmarks/llubenchmark/llu: 4.15% (5.2083 => 5.4243, std.dev.: 0.0730) MultiSource/Applications/sqlite3/sqlite3: 3.91% (4.0923 => 4.2523, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 3.58% (6.8204 => 7.0644, std.dev.: 0.0363) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.33% (3.4842 => 3.6002, std.dev.: 0.0397) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 2.75% (21.6534 => 22.2494, std.dev.: 0.1797) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.75% (2.0601 => 2.0961, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.39% (4.0203 => 4.0763, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.04% (4.6083 => 4.6563, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.58% (6.2884 => 0.8440, std.dev.: 0.0139) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.19% (1.5881 => 1.1721, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0241) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.05% (7.5041 => 6.3000, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.46% (7.4801 => 6.3240, std.dev.: 0.0283) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0062) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: -2.84% (13.5243 => 13.1403, std.dev.: 0.0493) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.35% (21.6534 => 17.8971, std.dev.: 0.0366) SingleSource/Benchmarks/Linpack/linpack-pc: -15.54% (7.8005 => 6.5884, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0357) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.68% (29.4578 => 28.6698, std.dev.: 0.2898) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (5.1603 => 5.0403, std.dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: -1.69% (8.3085 => 8.1685, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.53% (2.6202 => 2.5802, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -1.13% (11.6527 => 11.5207, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 02:50:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 04:50:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140420095015.8A0E42A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24774?compare_to=24768&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24774, Order: 206712, Start Time: 2014-04-20 05:13:48, End Time: 2014-04-20 09:56:51 To: 24768, Order: 206710, Start Time: 2014-04-20 00:27:34, End Time: 2014-04-20 05:10:40 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 8 (159 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (926 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/globalrefs: 200.00% (0.0080 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C/sumarray2d: 66.67% (0.0240 => 0.0400, std.dev.: 0.0052) SingleSource/Regression/C/sumarray: 57.14% (0.0280 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 24.39% (0.1640 => 0.2040, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.95% (1.0281 => 1.1201, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7121 => 1.7321, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.29% (11.3687 => 3.0362, std.dev.: 0.0123) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0122) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0087) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0058) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0052) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0058) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C/sumarray2d: 66.67% (0.0240 => 0.0400, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0200) SingleSource/Benchmarks/McGill/misr: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.19% (0.6200 => 0.7080, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.08% (1.4241 => 1.5961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.54% (1.4561 => 1.6241, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.1800 => 0.2000, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0145) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.84% (0.3320 => 0.3680, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.31% (1.1640 => 1.2840, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.23% (0.7040 => 0.7760, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: 9.42% (1.8680 => 2.0440, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0111) MultiSource/Applications/Burg/burg: 7.96% (1.5080 => 1.6280, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.55% (0.4240 => 0.4560, std.dev.: 0.0118) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.7680 => 0.8240, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (6.4680 => 6.9160, std.dev.: 0.0434) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (11.6440 => 12.3840, std.dev.: 0.0621) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (5.8121 => 6.1041, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.89% (6.5440 => 6.8640, std.dev.: 0.0316) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (9.4842 => 9.9402, std.dev.: 0.0853) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.64% (2.3281 => 2.4362, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.0443 => 10.5043, std.dev.: 0.0447) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.7400 => 1.8160, std.dev.: 0.0248) MultiSource/Applications/JM/lencod/lencod: 4.35% (21.9606 => 22.9168, std.dev.: 0.0540) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (6.5080 => 6.7800, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.2960 => 0.3080, std.dev.: 0.0044) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.04% (50.0290 => 52.0490, std.dev.: 0.0743) MultiSource/Applications/treecc/treecc: 4.02% (2.5840 => 2.6880, std.dev.: 0.0187) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.96% (1.3120 => 1.3640, std.dev.: 0.0131) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 3.84% (6.9844 => 7.2525, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/gs/gs: 3.73% (5.3600 => 5.5600, std.dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.0440 => 2.1160, std.dev.: 0.0260) MultiSource/Applications/ClamAV/clamscan: 3.47% (19.0444 => 19.7044, std.dev.: 0.0492) MultiSource/Applications/hbd/hbd: 3.46% (1.7360 => 1.7960, std.dev.: 0.0205) MultiSource/Applications/SPASS/SPASS: 3.43% (18.4404 => 19.0726, std.dev.: 0.0534) MultiSource/Applications/lua/lua: 3.26% (4.7880 => 4.9440, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0161) MultiSource/Benchmarks/Bullet/bullet: 3.07% (38.4046 => 39.5846, std.dev.: 0.0606) MultiSource/Applications/kimwitu++/kc: 2.72% (19.6891 => 20.2251, std.dev.: 0.0427) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.7480 => 0.7680, std.dev.: 0.0077) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0099) MultiSource/Applications/d/make_dparser: 2.52% (3.9681 => 4.0681, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (16.3483 => 16.7323, std.dev.: 0.0489) MultiSource/Benchmarks/PAQ8p/paq8p: 1.58% (2.7922 => 2.8362, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (13.0563 => 13.2363, std.dev.: 0.0318) MultiSource/Applications/sqlite3/sqlite3: 1.23% (25.6856 => 26.0016, std.dev.: 0.0330) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.00% (0.1200 => 0.1440, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.96% (2.1401 => 2.4602, std.dev.: 0.0450) MultiSource/Applications/siod/siod: 11.33% (2.8602 => 3.1842, std.dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.75% (3.4122 => 3.5402, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.70% (6.6684 => 6.8484, std.dev.: 0.0305) MultiSource/Applications/sqlite3/sqlite3: 2.61% (3.9842 => 4.0883, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.44% (4.1003 => 4.2003, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0234) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.99% (21.7374 => 22.1694, std.dev.: 0.0874) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.16% (2.9442 => 0.9080, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.31% (91.8497 => 49.3111, std.dev.: 10.3900) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.27% (26.0616 => 17.1291, std.dev.: 0.1014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.10% (50.3031 => 33.1501, std.dev.: 0.1220) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.18% (42.1466 => 28.5858, std.dev.: 0.4310) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1127) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -13.10% (7.7845 => 6.7644, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -7.05% (0.6240 => 0.5800, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.01% (4.1243 => 4.0003, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.79% (2.4602 => 2.4162, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -1.29% (26.6977 => 26.3536, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.01% (1.9761 => 1.9561, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 03:19:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 05:19:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140420101956.71DCC2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24775?compare_to=24769&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24775, Order: 206712, Start Time: 2014-04-20 05:43:46, End Time: 2014-04-20 10:26:30 To: 24769, Order: 206710, Start Time: 2014-04-20 00:57:45, End Time: 2014-04-20 05:40:42 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (150 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR10189: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/UnitTests/Threads/tls: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) MultiSource/Benchmarks/llubenchmark/llu: 20.00% (0.0600 => 0.0720, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/rem: 16.13% (0.1240 => 0.1440, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2240 => 0.2440, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.2560 => 0.2720, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 3.66% (0.3280 => 0.3400, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0069) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.95% (0.6160 => 0.6280, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 1.73% (5.5640 => 5.6600, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.53% (1.5641 => 1.5881, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.29% (1.3161 => 1.4121, std.dev.: 0.0368) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 5.53% (3.8322 => 4.0443, std.dev.: 0.0651) MultiSource/Benchmarks/Olden/bisort/bisort: 2.17% (0.7360 => 0.7520, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2362.50% (0.0320 => 0.7880, std.dev.: 0.0092) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0073) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 979.08% (0.0760 => 0.8201, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0123) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0069) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0064) MultiSource/Applications/obsequi/Obsequi: 45.40% (1.3920 => 2.0240, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 35.29% (0.0680 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 28.57% (0.0560 => 0.0720, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.95% (1.2321 => 1.5641, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.00% (0.1600 => 0.2000, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 22.15% (1.3001 => 1.5881, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.11% (1.1761 => 1.4361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.94% (1.2881 => 1.5321, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 18.84% (8.5802 => 10.1963, std.dev.: 0.0451) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.13% (1.2841 => 1.5041, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 15.52% (19.5406 => 22.5727, std.dev.: 0.0697) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.69% (5.3360 => 6.1201, std.dev.: 0.0469) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.16% (0.1520 => 0.1720, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.95% (0.5560 => 0.6280, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 12.43% (1.3521 => 1.5201, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0334) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0090) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.36% (5.7280 => 6.2640, std.dev.: 0.0393) MultiSource/Benchmarks/mafft/pairlocalalign: 9.14% (11.3843 => 12.4243, std.dev.: 0.0429) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: 8.97% (0.3120 => 0.3400, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 8.50% (0.6120 => 0.6640, std.dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: 8.47% (6.2844 => 6.8164, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (5.6680 => 6.1440, std.dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (11.4440 => 12.3800, std.dev.: 0.0633) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.7640 => 0.8240, std.dev.: 0.0198) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (9.5802 => 10.2642, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (1.4760 => 1.5640, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 5.13% (5.3840 => 5.6600, std.dev.: 0.0348) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.22% (6.8280 => 7.1160, std.dev.: 0.0383) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.61% (49.1529 => 50.9289, std.dev.: 0.0920) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (1.0680 => 1.1040, std.dev.: 0.0125) MultiSource/Applications/lua/lua: 3.19% (4.7720 => 4.9240, std.dev.: 0.0510) MultiSource/Benchmarks/PAQ8p/paq8p: 3.08% (2.7282 => 2.8122, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 2.91% (19.2243 => 19.7844, std.dev.: 0.0608) MultiSource/Applications/sqlite3/sqlite3: 2.75% (24.7575 => 25.4375, std.dev.: 0.0430) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 2.37% (19.7491 => 20.2171, std.dev.: 0.0497) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (3.0402 => 3.0802, std.dev.: 0.0096) MultiSource/Applications/SPASS/SPASS: 1.28% (18.7966 => 19.0365, std.dev.: 0.0500) MultiSource/Benchmarks/Bullet/bullet: 1.24% (39.0726 => 39.5566, std.dev.: 0.0753) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.81% (1.2401 => 1.4361, std.dev.: 0.0203) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.62% (1.3121 => 1.4121, std.dev.: 0.0368) MultiSource/Applications/siod/siod: 6.43% (2.9842 => 3.1762, std.dev.: 0.0215) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 3.85% (4.0563 => 4.2123, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 3.81% (6.8204 => 7.0804, std.dev.: 0.0341) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.04% (4.1083 => 4.1923, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4802 => 3.5282, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (25.4536 => 25.7896, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0200 => 0.0000, std.dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: -81.82% (11.0207 => 2.0041, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: -31.58% (0.0760 => 0.0520, std.dev.: 0.0088) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.53% (21.6534 => 17.8571, std.dev.: 0.0662) SingleSource/Benchmarks/Linpack/linpack-pc: -16.34% (7.8605 => 6.5764, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.64% (3.4722 => 3.1722, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0951) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.23% (4.5123 => 4.2763, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (2.9162 => 2.8602, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (4.1243 => 4.0803, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 03:47:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 05:47:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140420104726.A103C2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24776?compare_to=24770&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24776, Order: 206712, Start Time: 2014-04-20 06:08:04, End Time: 2014-04-20 10:53:59 To: 24770, Order: 206710, Start Time: 2014-04-20 01:18:58, End Time: 2014-04-20 06:05:02 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 12 (133 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.14% (0.1680 => 0.1800, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: -50.00% (0.0240 => 0.0120, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.97% (17.6723 => 19.7883, std.dev.: 0.0377) MultiSource/Applications/sqlite3/sqlite3: 1427.53% (1.7001 => 25.9696, std.dev.: 0.0331) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.54% (50.1010 => 51.8770, std.dev.: 0.0919) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.81% (11.3920 => 12.3960, std.dev.: 0.0709) SingleSource/Benchmarks/Misc/oourafft: -73.40% (11.3407 => 3.0162, std.dev.: 0.0166) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1243, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0088) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0037) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0050) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 26.09% (0.0920 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 17.86% (0.2240 => 0.2640, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.38% (0.4160 => 0.4800, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.05% (1.8601 => 2.1401, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.99% (2.1361 => 2.4562, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.76% (1.9241 => 2.2081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.59% (1.8921 => 2.1681, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.06% (2.1441 => 2.4242, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.19% (1.7721 => 1.9881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.00% (1.9001 => 2.1281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.87% (1.9201 => 2.1481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.61% (1.8601 => 2.0761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0157) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.11% (2.0521 => 2.2801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/EH/except: 10.34% (0.2320 => 0.2560, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0092) MultiSource/Applications/obsequi/Obsequi: 8.96% (1.8760 => 2.0440, std.dev.: 0.0230) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.81% (0.6360 => 0.6920, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.14% (0.3360 => 0.3600, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 7.09% (1.0160 => 1.0880, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (6.4800 => 6.8880, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.21% (0.7080 => 0.7520, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (2.9721 => 3.1562, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: 5.24% (1.5280 => 1.6080, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.03% (1.7480 => 1.8360, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (1.6960 => 1.7800, std.dev.: 0.0225) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.2283 => 10.6764, std.dev.: 0.0398) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0575) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4920 => 0.5120, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (6.5320 => 6.7880, std.dev.: 0.0422) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0329) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (5.8281 => 6.0361, std.dev.: 0.0415) MultiSource/Applications/treecc/treecc: 3.55% (2.5880 => 2.6800, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3960 => 5.5760, std.dev.: 0.0427) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.25% (0.6160 => 0.6360, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (2.1600 => 2.2280, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (6.5360 => 6.7400, std.dev.: 0.0480) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (16.3003 => 16.7723, std.dev.: 0.0611) MultiSource/Applications/oggenc/oggenc: 2.89% (7.0524 => 7.2565, std.dev.: 0.0248) MultiSource/Applications/JM/lencod/lencod: 2.88% (22.2206 => 22.8607, std.dev.: 0.0445) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0212) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.77% (1.3000 => 1.3360, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0077) MultiSource/Applications/SPASS/SPASS: 2.40% (18.5284 => 18.9725, std.dev.: 0.0714) MultiSource/Benchmarks/Bullet/bullet: 2.33% (38.6366 => 39.5366, std.dev.: 0.0552) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0252) MultiSource/Applications/kimwitu++/kc: 1.96% (19.8291 => 20.2171, std.dev.: 0.0513) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2243 => 4.2883, std.dev.: 0.0170) MultiSource/Applications/siod/siod: 1.45% (2.7522 => 2.7922, std.dev.: 0.0136) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7842 => 2.8202, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0363 => 13.1683, std.dev.: 0.0297) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0527) MultiSource/Applications/siod/siod: 10.89% (2.8642 => 3.1762, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 2.91% (6.5964 => 6.7884, std.dev.: 0.0353) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.75% (1.5881 => 1.0521, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.95% (94.8339 => 49.3591, std.dev.: 10.4431) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.08% (49.9431 => 32.9221, std.dev.: 0.1491) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.59% (25.7136 => 17.0771, std.dev.: 0.0807) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.37% (37.0863 => 28.4178, std.dev.: 0.4466) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.1068) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.66% (7.8165 => 6.7484, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0088) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (4.1123 => 4.0483, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -1.00% (4.7883 => 4.7403, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 07:25:25 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 07:25:25 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase2 - living Message-ID: <20140420142536.EE0924FB87AB@lab.llvm.org> The Buildbot has detected a build exception on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7535 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206713 Blamelist: emaste BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 14:20:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 14:20:35 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140420212056.B26124FBB351@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14630 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206717 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': llvm[4]: Compiling ARMAsmBackend.cpp for Release+Asserts build if /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/host-compiler/bin/clang++ -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc -D_DEBUG -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -O3 -stdlib=libc++ -std=c++11 -fvisibility-inlines-hidden -fno-exceptions -fno-rtti -fno-common -Woverloaded-virtual -Wcast-qual -m64 -pedantic -Wno-long-long -Wall -W -Wno-unused-parameter -Wwrite-strings -Wcovered-switch-default -Wno-uninitialized -Wno-missing-field-initializers -c -MMD -MP -MF "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d.tmp" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.o" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d" /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCT argetDesc/ARMAsmBackend.cpp -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.o ; \ then /bin/mv -f "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d.tmp" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d"; else /bin/rm "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d.tmp"; exit 1; fi llvm[4]: Compiling ARMELFObjectWriter.cpp for Release+Asserts build llvm[4]: Compiling ARMELFStreamer.cpp for Release+Asserts build if /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/host-compiler/bin/clang++ -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc -D_DEBUG -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -O3 -stdlib=libc++ -std=c++11 -fvisibility-inlines-hidden -fno-exceptions -fno-rtti -fno-common -Woverloaded-virtual -Wcast-qual -m64 -pedantic -Wno-long-long -Wall -W -Wno-unused-parameter -Wwrite-strings -Wcovered-switch-default -Wno-uninitialized -Wno-missing-field-initializers -c -MMD -MP -MF "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d.tmp" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.o" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d" /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib /Target/ARM/MCTargetDesc/ARMELFObjectWriter.cpp -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.o ; \ then /bin/mv -f "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d.tmp" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d"; else /bin/rm "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d.tmp"; exit 1; fi if /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/host-compiler/bin/clang++ -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc -D_DEBUG -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -O3 -stdlib=libc++ -std=c++11 -fvisibility-inlines-hidden -fno-exceptions -fno-rtti -fno-common -Woverloaded-virtual -Wcast-qual -m64 -pedantic -Wno-long-long -Wall -W -Wno-unused-parameter -Wwrite-strings -Wcovered-switch-default -Wno-uninitialized -Wno-missing-field-initializers -c -MMD -MP -MF "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d.tmp" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.o" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d" /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/ MCTargetDesc/ARMELFStreamer.cpp -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.o ; \ then /bin/mv -f "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d.tmp" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d"; else /bin/rm "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d.tmp"; exit 1; fi llvm[4]: Building Release+Asserts Archive Library libLLVMARMDesc.a /bin/rm -f /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/libLLVMARMDesc.a ar cru /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/libLLVMARMDesc.a /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMCAsmInfo.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMCCodeEmitter.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMCExpr.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMCTargetDesc.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMachORelocationInfo.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMachObjectWriter.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMTargetStreamer.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11- nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMUnwindOpAsm.o ranlib /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/libLLVMARMDesc.a make[1]: *** [Target/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 14:20:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 14:20:35 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140420212056.ABDB94FBB350@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14630 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206717 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': llvm[4]: Compiling ARMAsmBackend.cpp for Release+Asserts build if /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/host-compiler/bin/clang++ -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc -D_DEBUG -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -O3 -stdlib=libc++ -std=c++11 -fvisibility-inlines-hidden -fno-exceptions -fno-rtti -fno-common -Woverloaded-virtual -Wcast-qual -m64 -pedantic -Wno-long-long -Wall -W -Wno-unused-parameter -Wwrite-strings -Wcovered-switch-default -Wno-uninitialized -Wno-missing-field-initializers -c -MMD -MP -MF "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d.tmp" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.o" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d" /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCT argetDesc/ARMAsmBackend.cpp -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.o ; \ then /bin/mv -f "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d.tmp" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d"; else /bin/rm "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.d.tmp"; exit 1; fi llvm[4]: Compiling ARMELFObjectWriter.cpp for Release+Asserts build llvm[4]: Compiling ARMELFStreamer.cpp for Release+Asserts build if /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/host-compiler/bin/clang++ -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc -D_DEBUG -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -O3 -stdlib=libc++ -std=c++11 -fvisibility-inlines-hidden -fno-exceptions -fno-rtti -fno-common -Woverloaded-virtual -Wcast-qual -m64 -pedantic -Wno-long-long -Wall -W -Wno-unused-parameter -Wwrite-strings -Wcovered-switch-default -Wno-uninitialized -Wno-missing-field-initializers -c -MMD -MP -MF "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d.tmp" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.o" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d" /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib /Target/ARM/MCTargetDesc/ARMELFObjectWriter.cpp -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.o ; \ then /bin/mv -f "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d.tmp" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d"; else /bin/rm "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.d.tmp"; exit 1; fi if /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/host-compiler/bin/clang++ -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc/.. -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/MCTargetDesc -D_DEBUG -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -O3 -stdlib=libc++ -std=c++11 -fvisibility-inlines-hidden -fno-exceptions -fno-rtti -fno-common -Woverloaded-virtual -Wcast-qual -m64 -pedantic -Wno-long-long -Wall -W -Wno-unused-parameter -Wwrite-strings -Wcovered-switch-default -Wno-uninitialized -Wno-missing-field-initializers -c -MMD -MP -MF "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d.tmp" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.o" -MT "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d" /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/ARM/ MCTargetDesc/ARMELFStreamer.cpp -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.o ; \ then /bin/mv -f "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d.tmp" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d"; else /bin/rm "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.d.tmp"; exit 1; fi llvm[4]: Building Release+Asserts Archive Library libLLVMARMDesc.a /bin/rm -f /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/libLLVMARMDesc.a ar cru /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/libLLVMARMDesc.a /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMAsmBackend.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFObjectWriter.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMELFStreamer.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMCAsmInfo.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMCCodeEmitter.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMCExpr.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMCTargetDesc.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMachORelocationInfo.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMMachObjectWriter.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMTargetStreamer.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11- nobootstrap-RAincremental/clang-build/lib/Target/ARM/MCTargetDesc/Release+Asserts/ARMUnwindOpAsm.o ranlib /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/libLLVMARMDesc.a make[1]: *** [Target/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 14:20:58 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 14:20:58 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140420212116.81AEB4FBB358@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19068 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206717 Blamelist: atanasyan,rsmith BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 14:20:58 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 14:20:58 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140420212116.81B1F4FBB359@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19068 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206717 Blamelist: atanasyan,rsmith BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: tools/llvm-readobj/StreamWriter.h On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 20 Apr 2014 14:16:41 Changed By: atanasyan Comments: [C++11] Range-based loop simplification.Properties: File: include/llvm/Support/ELF.h On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 20 Apr 2014 14:16:42 Changed By: atanasyan Comments: [Mips] Add more special values for the st_other field in the symbol table entry for MIPS.Properties: Files: lib/Target/X86/Disassembler/CMakeLists.txt lib/Target/X86/Disassembler/X86Disassembler.cpp lib/Target/X86/Disassembler/X86DisassemblerDecoder.c lib/Target/X86/Disassembler/X86DisassemblerDecoder.cpp lib/Target/X86/Disassembler/X86DisassemblerDecoder.h lib/Target/X86/Disassembler/X86DisassemblerDecoderCommon.h On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 20 Apr 2014 14:16:42 Changed By: rsmith Comments: What year is it! This file has no reason to be written in C, and has doubly no reason to expose a global symbol 'decodeInstruction' nor to pollute the global scope with a bunch of external linkage entities (some of which conflict with others elsewhere in LLVM). This is just the initial transition to C++; more cleanups to follow. Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 15:19:39 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 15:19:39 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140420221952.80BDD4FBBB55@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19069 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206718 Blamelist: rsmith Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 15:28:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 15:28:35 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase2 - living Message-ID: <20140420222848.209374FBBD2F@lab.llvm.org> The Buildbot has detected a restored build on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7536 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206714 Blamelist: rsmith Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 17:06:57 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 17:06:57 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140421000725.9B3A04FBCB0F@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19074 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206726 Blamelist: rsmith BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 17:06:37 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 17:06:37 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase2 - living Message-ID: <20140421000725.9C6CD4FBCB10@lab.llvm.org> The Buildbot has detected a build exception on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7537 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206718 Blamelist: atanasyan,rsmith BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 17:26:04 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 17:26:04 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140421002618.8C9A04FBCDE0@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19075 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206727 Blamelist: dblaikie Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sun Apr 20 18:17:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 20:17:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140421011752.2C04D2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24777?compare_to=24771&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24777, Order: 206714, Start Time: 2014-04-20 20:42:44, End Time: 2014-04-21 01:24:25 To: 24771, Order: 206712, Start Time: 2014-04-20 02:52:39, End Time: 2014-04-20 07:31:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (108 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2003-07-09-SignedArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/div: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.00% (0.1000 => 0.1120, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 5.88% (0.2040 => 0.2160, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.54% (1.2961 => 1.3161, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.94% (0.2560 => 0.2840, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0170) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 10.20% (0.1960 => 0.2160, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.74% (10.6960 => 11.5240, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0412) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0522) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0155) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0430) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1880 => 1.2280, std.dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0385) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (7.8562 => 8.0802, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0354) MultiSource/Applications/sqlite3/sqlite3: 2.69% (23.7574 => 24.3975, std.dev.: 0.0478) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0143) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0061) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.39% (48.1088 => 49.2569, std.dev.: 0.0965) MultiSource/Benchmarks/Bullet/bullet: 1.83% (37.0925 => 37.7726, std.dev.: 0.0553) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1610, std.dev.: 0.0576) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: 1.26% (17.4082 => 17.6282, std.dev.: 0.0432) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0457) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.33% (0.1800 => 0.2040, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 13.33% (2.8802 => 3.2642, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.76% (1.0881 => 1.2161, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 11.11% (0.1800 => 0.2000, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.5040 => 0.5400, std.dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (25.8896 => 26.9537, std.dev.: 0.0230) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (1.3481 => 1.3961, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.06% (3.5322 => 3.6402, std.dev.: 0.0375) MultiSource/Applications/lua/lua: 2.82% (21.1533 => 21.7494, std.dev.: 0.1337) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.81% (4.5603 => 4.6883, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0643 => 4.1163, std.dev.: 0.0109) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0422) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -14.09% (7.7485 => 6.6564, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.30% (1.2601 => 1.1681, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -5.88% (0.4080 => 0.3840, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 18:18:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 20:18:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140421011818.E49FD2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24778?compare_to=24774&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24778, Order: 206714, Start Time: 2014-04-20 20:42:09, End Time: 2014-04-21 01:24:56 To: 24774, Order: 206712, Start Time: 2014-04-20 05:13:48, End Time: 2014-04-20 09:56:51 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 6 (154 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-07-17-INT-To-FP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.34% (0.1160 => 0.1280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3000 => 0.3120, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.94% (1.6481 => 1.6801, std.dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (9.9402 => 10.0482, std.dev.: 0.0250) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0078) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0117) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 295.67% (0.4600 => 1.8201, std.dev.: 0.0120) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0041) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2002-10-12-StructureArgs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/IntMM: 44.44% (0.0360 => 0.0520, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 35.71% (0.0560 => 0.0760, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0720 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.19% (0.6200 => 0.7080, std.dev.: 0.0155) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.58% (0.3240 => 0.3680, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.81% (1.4561 => 1.6281, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.80% (1.4241 => 1.5921, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.76% (1.5241 => 1.6881, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.67% (1.6121 => 1.7841, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.31% (1.1640 => 1.2840, std.dev.: 0.0182) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.08% (1.5481 => 1.7041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.05% (1.5521 => 1.7081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.95% (1.5281 => 1.6801, std.dev.: 0.0081) MultiSource/Applications/obsequi/Obsequi: 9.85% (1.8680 => 2.0520, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0121) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.19% (1.4161 => 1.5321, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.08% (1.4361 => 1.5521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0092) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.02% (0.2280 => 0.2440, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3440 => 0.3680, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 6.90% (1.5080 => 1.6120, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (6.4680 => 6.8800, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (11.6440 => 12.3840, std.dev.: 0.0566) MultiSource/Applications/spiff/spiff: 6.35% (1.0080 => 1.0720, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 6.03% (1.1280 => 1.1960, std.dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.95% (9.4842 => 10.0482, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.7400 => 1.8360, std.dev.: 0.0194) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0357) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.49% (6.5080 => 6.8000, std.dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0150) MultiSource/Applications/JM/lencod/lencod: 4.41% (21.9606 => 22.9288, std.dev.: 0.0500) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.0443 => 10.4843, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (6.5440 => 6.8240, std.dev.: 0.0570) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 4.18% (5.3600 => 5.5840, std.dev.: 0.0473) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0103) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.05% (50.0290 => 52.0570, std.dev.: 0.0531) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0126) MultiSource/Applications/lua/lua: 3.84% (4.7880 => 4.9720, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.35% (4.1843 => 4.3243, std.dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: 3.34% (18.4404 => 19.0565, std.dev.: 0.0515) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0187) MultiSource/Applications/ClamAV/clamscan: 3.11% (19.0444 => 19.6364, std.dev.: 0.0636) MultiSource/Applications/treecc/treecc: 3.10% (2.5840 => 2.6640, std.dev.: 0.0228) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 2.97% (38.4046 => 39.5446, std.dev.: 0.0880) MultiSource/Applications/kimwitu++/kc: 2.50% (19.6891 => 20.1811, std.dev.: 0.0471) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (16.3483 => 16.7323, std.dev.: 0.0537) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0293) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (13.0563 => 13.2243, std.dev.: 0.0329) MultiSource/Applications/sqlite3/sqlite3: 1.25% (25.6856 => 26.0056, std.dev.: 0.0354) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7922 => 2.8242, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.77% (2.1401 => 2.4562, std.dev.: 0.0375) MultiSource/Applications/siod/siod: 10.63% (2.8602 => 3.1642, std.dev.: 0.0215) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 2.76% (6.6684 => 6.8524, std.dev.: 0.0305) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.0881 => 1.1161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (4.1003 => 4.2043, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (3.9922 => 4.0923, std.dev.: 0.0352) MultiSource/Applications/sqlite3/sqlite3: 2.41% (3.9842 => 4.0803, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4205 => 7.5925, std.dev.: 0.0210) MultiSource/Applications/lua/lua: 1.90% (21.7374 => 22.1494, std.dev.: 0.0848) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9724 => 6.0644, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.18% (8.1245 => 8.2205, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.02% (2.7442 => 2.7722, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.17% (10.6247 => 2.0001, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.25% (91.8497 => 49.3711, std.dev.: 10.4576) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.67% (26.0616 => 17.0251, std.dev.: 0.1361) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.12% (50.3031 => 33.1381, std.dev.: 0.1854) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.84% (42.1466 => 28.7258, std.dev.: 0.3522) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.1050) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.16% (7.7845 => 6.7604, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.91% (4.1243 => 4.0042, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.99% (4.0283 => 3.9482, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.79% (2.4602 => 2.4162, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0150) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (26.6977 => 26.3656, std.dev.: 0.0295) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 18:21:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 20:21:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140421012105.B327F2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24779?compare_to=24776&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24779, Order: 206714, Start Time: 2014-04-20 20:42:12, End Time: 2014-04-21 01:27:44 To: 24776, Order: 206712, Start Time: 2014-04-20 06:08:04, End Time: 2014-04-20 10:53:59 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 4 (130 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1107 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 60.00% (0.0400 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 5.66% (0.2120 => 0.2240, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 5.58% (1.7200 => 1.8160, std.dev.: 0.0195) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.78% (1.7281 => 1.6801, std.dev.: 0.0164) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.75% (17.6723 => 19.7483, std.dev.: 0.0556) MultiSource/Applications/sqlite3/sqlite3: 1427.77% (1.7001 => 25.9736, std.dev.: 0.0248) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.54% (50.1010 => 51.8770, std.dev.: 0.0999) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0329) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.99% (11.3920 => 12.4160, std.dev.: 0.0520) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0119) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.1283, std.dev.: 0.0247) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0147) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/2002-05-02-ManyArguments: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0028) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 45.45% (0.0440 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 30.00% (0.0800 => 0.1040, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.93% (0.1720 => 0.2080, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.13% (0.2480 => 0.2880, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.90% (1.9601 => 2.2521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.80% (1.8921 => 2.1721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.71% (1.8761 => 2.1521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.62% (1.8601 => 2.1321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.83% (1.8081 => 2.0401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.64% (1.7721 => 1.9961, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.50% (0.2240 => 0.2520, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.98% (2.1041 => 2.3561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (1.8361 => 2.0521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0090) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.88% (1.9481 => 2.1601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0170) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.19% (1.0880 => 1.1880, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: 7.68% (1.8760 => 2.0200, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.14% (0.7280 => 0.7800, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.78% (0.2360 => 0.2520, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.60% (6.4800 => 6.9080, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.45% (0.2480 => 0.2640, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 5.91% (1.0160 => 1.0760, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (1.5640 => 1.6480, std.dev.: 0.0245) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.11% (0.7040 => 0.7400, std.dev.: 0.0133) MultiSource/Applications/hbd/hbd: 5.09% (1.7280 => 1.8160, std.dev.: 0.0195) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (9.6042 => 10.0642, std.dev.: 0.0229) MultiSource/Applications/sgefa/sgefa: 4.55% (0.6160 => 0.6440, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0259) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.2283 => 10.6684, std.dev.: 0.0426) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (5.8281 => 6.0761, std.dev.: 0.0291) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0073) MultiSource/Applications/Burg/burg: 3.93% (1.5280 => 1.5880, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (6.5320 => 6.7800, std.dev.: 0.0445) MultiSource/Applications/lua/lua: 3.67% (4.7920 => 4.9680, std.dev.: 0.0271) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (2.1240 => 2.2000, std.dev.: 0.0237) MultiSource/Applications/treecc/treecc: 3.55% (2.5880 => 2.6800, std.dev.: 0.0231) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (5.3960 => 5.5720, std.dev.: 0.0446) MultiSource/Applications/SPASS/SPASS: 3.07% (18.5284 => 19.0965, std.dev.: 0.0241) MultiSource/Applications/JM/lencod/lencod: 2.79% (22.2206 => 22.8407, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 2.55% (7.0524 => 7.2325, std.dev.: 0.0232) MultiSource/Applications/d/make_dparser: 2.52% (3.9761 => 4.0761, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (16.3003 => 16.7083, std.dev.: 0.0766) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (2.1600 => 2.2120, std.dev.: 0.0193) MultiSource/Benchmarks/Bullet/bullet: 2.34% (38.6366 => 39.5406, std.dev.: 0.0634) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 2.04% (19.8291 => 20.2331, std.dev.: 0.0438) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7842 => 2.8202, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.34% (2.1201 => 2.4242, std.dev.: 0.0363) MultiSource/Applications/siod/siod: 10.89% (2.8642 => 3.1762, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.55% (6.5964 => 6.7644, std.dev.: 0.0601) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.71% (3.7442 => 3.8082, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9684 => 6.0684, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.50% (4.0003 => 4.0603, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0274) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.88% (2.9562 => 0.9200, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.75% (1.5881 => 1.0521, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.25% (94.8339 => 49.0791, std.dev.: 9.5582) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.97% (49.9431 => 32.9781, std.dev.: 0.1767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.73% (25.7136 => 17.0411, std.dev.: 0.1092) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.86% (37.0863 => 28.6098, std.dev.: 0.6487) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.66% (7.8165 => 6.7484, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.71% (0.3400 => 0.3240, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0059) MultiSource/Applications/aha/aha: -3.92% (2.7522 => 2.6442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8043 => 4.6843, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (2.7722 => 2.7122, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (4.1123 => 4.0483, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.5442 => 3.5042, std.dev.: 0.0144) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 18:22:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 20:22:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140421012228.065EE2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24780?compare_to=24772&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24780, Order: 206714, Start Time: 2014-04-20 20:42:11, End Time: 2014-04-21 01:29:04 To: 24772, Order: 206712, Start Time: 2014-04-20 04:34:18, End Time: 2014-04-20 09:20:51 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: 21.43% (0.0560 => 0.0680, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 9.43% (0.2120 => 0.2320, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0054) SingleSource/Regression/C/bigstack: 6.98% (0.1720 => 0.1840, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.7401 => 1.7681, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.39% (1.7241 => 1.7481, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 16.80% (0.9761 => 1.1401, std.dev.: 0.0389) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.23% (0.2600 => 0.2840, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/obsequi/Obsequi: -3.54% (2.1441 => 2.0681, std.dev.: 0.0277) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0143) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 20 18:24:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Apr 2014 20:24:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140421012428.96CA92A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24781?compare_to=24773&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24781, Order: 206714, Start Time: 2014-04-20 20:42:10, End Time: 2014-04-21 01:31:05 To: 24773, Order: 206712, Start Time: 2014-04-20 04:41:03, End Time: 2014-04-20 09:30:04 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (132 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 100.00% (0.0160 => 0.0320, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 8.33% (0.1440 => 0.1560, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.35% (0.2720 => 0.2920, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.82% (0.3520 => 0.3760, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.69% (1.1360 => 1.2120, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.36% (0.6720 => 0.7080, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/chomp: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.90% (0.6320 => 0.6440, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -23.53% (0.0680 => 0.0520, std.dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0061) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.77% (1.6721 => 2.0361, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.39% (1.7201 => 2.0881, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.68% (1.7681 => 2.1161, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.08% (1.9081 => 2.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.03% (1.9761 => 2.3521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.31% (1.9641 => 2.3041, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.69% (0.6120 => 0.7080, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: 12.77% (0.1880 => 0.2120, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 11.32% (0.2120 => 0.2360, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/09-vor/vor: 7.14% (0.3920 => 0.4200, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0175) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.7200 => 7.1440, std.dev.: 0.0399) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.29% (3.5002 => 3.7202, std.dev.: 0.0266) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.25% (0.1920 => 0.2040, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (11.7880 => 12.4880, std.dev.: 0.0831) MultiSource/Benchmarks/nbench/nbench: 5.71% (1.8201 => 1.9241, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.62% (0.3560 => 0.3760, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.5240 => 1.6080, std.dev.: 0.0202) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.42% (2.0680 => 2.1800, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.6120 => 0.6440, std.dev.: 0.0030) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.04% (1.3480 => 1.4160, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 5.01% (4.7920 => 5.0320, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.97% (9.9842 => 10.4802, std.dev.: 0.0287) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0061) MultiSource/Applications/d/make_dparser: 4.44% (3.9641 => 4.1401, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0139) MultiSource/Applications/minisat/minisat: 4.21% (0.8560 => 0.8920, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (6.8321 => 7.1121, std.dev.: 0.0329) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0199) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.1440 => 1.1880, std.dev.: 0.0147) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 3.64% (18.4924 => 19.1646, std.dev.: 0.0413) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (10.3203 => 10.6884, std.dev.: 0.0467) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (2.0440 => 2.1160, std.dev.: 0.0190) MultiSource/Applications/treecc/treecc: 3.36% (2.6200 => 2.7080, std.dev.: 0.0341) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 2.79% (22.6287 => 23.2607, std.dev.: 0.0639) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.79% (51.1089 => 52.5329, std.dev.: 0.1417) MultiSource/Applications/siod/siod: 2.61% (2.7562 => 2.8282, std.dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: 2.45% (20.2445 => 20.7405, std.dev.: 0.0718) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 2.23% (19.7371 => 20.1771, std.dev.: 0.0704) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 2.14% (38.9366 => 39.7686, std.dev.: 0.0994) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (2.2721 => 2.3201, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (16.5963 => 16.9243, std.dev.: 0.0749) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.0244 => 6.1364, std.dev.: 0.0188) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.43% (25.1895 => 25.5495, std.dev.: 0.0409) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0129) MultiSource/Applications/siod/siod: 12.30% (2.8282 => 3.1762, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: 3.32% (4.0923 => 4.2283, std.dev.: 0.0276) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0395) MultiSource/Applications/lua/lua: 2.84% (21.6534 => 22.2694, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (3.4402 => 3.5282, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.35% (5.0963 => 5.2163, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.94% (2.0601 => 2.1001, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.94% (4.1323 => 4.2123, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.68% (5.9604 => 6.0604, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0148) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/nestedloop: -60.86% (2.9642 => 1.1601, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0075) SingleSource/UnitTests/Threads/tls: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.83% (7.4801 => 6.2960, std.dev.: 0.0275) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.73% (7.5041 => 6.3240, std.dev.: 0.0407) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -2.60% (13.5243 => 13.1723, std.dev.: 0.0454) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.53% (21.6534 => 17.8571, std.dev.: 0.0436) SingleSource/Benchmarks/Linpack/linpack-pc: -15.49% (7.8005 => 6.5924, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.32% (5.8884 => 5.5163, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -2.87% (5.1603 => 5.0123, std.dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -1.54% (8.3085 => 8.1805, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.37% (2.6202 => 2.5842, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -1.24% (2.9122 => 2.8762, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -1.17% (11.6527 => 11.5167, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 20 21:44:14 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 20 Apr 2014 21:44:14 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase2 - living Message-ID: <20140421044430.73F884FBEAAF@lab.llvm.org> The Buildbot has detected a restored build on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7539 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206727 Blamelist: dblaikie,rsmith Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 00:19:45 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 00:19:45 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase2 - living Message-ID: <20140421072035.E88A34FBFD7C@lab.llvm.org> The Buildbot has detected a build exception on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7541 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206732 Blamelist: chandlerc,mzolotukhin,tfiala BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 01:53:11 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 01:53:11 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140421085327.54AD04FC0B15@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19082 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206739 Blamelist: chandlerc,lhames BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 03:01:59 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 03:01:59 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140421100211.E57EC4FC1377@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19083 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206740 Blamelist: d0k Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 03:53:47 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 03:53:47 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140421105414.22EDE4FC19E2@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building compiler-rt. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19084 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206742 Blamelist: kcc BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 04:32:28 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 04:32:28 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140421113240.D863F4FC1F61@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19085 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206743 Blamelist: chapuni Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 05:50:49 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 05:50:49 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140421125139.2DB154FC2A6F@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6791 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206735 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Debug+Asserts/UtilsTests/SpecialCaseListTest.Substring (17773 of 17774) PASS: LLVM-Unit :: Support/Debug+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17774 of 17774) 1 warning(s) in tests. Testing Time: 667.12s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17624 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 05:50:49 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 05:50:49 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140421125138.8D2554FC2A6E@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6791 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206735 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Debug+Asserts/UtilsTests/SpecialCaseListTest.Substring (17773 of 17774) PASS: LLVM-Unit :: Support/Debug+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17774 of 17774) 1 warning(s) in tests. Testing Time: 667.12s ******************** Failing Tests (1): Clang :: Modules/missing-header.m Expected Passes : 17624 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::missing-header.m': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang.src/test/Modules/missing-header.m:13:11: error: expected string not found in input // CHECK: could not build module 'missing_headers' ^ :2:2: note: scanning from here module missing { header "missing.h" } ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 12:14:10 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 12:14:10 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140421191422.7D32B4FC5FB7@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19103 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206772 Blamelist: arsenm Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 12:54:27 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 12:54:27 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140421195452.8A5634FC6564@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19104 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206773 Blamelist: grosbach BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 13:13:51 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 13:13:51 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140421201402.ED1314FC6890@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19105 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206774 Blamelist: yjiang Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 16:17:48 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 16:17:48 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140421231807.40D064FC8BD9@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14679 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206821 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': 6 llvm-tblgen 0x000000010a464077 llvm::EmitDFAPacketizer(llvm::RecordKeeper&, llvm::raw_ostream&) + 8823 7 llvm-tblgen 0x000000010a4cf915 (anonymous namespace)::LLVMTableGenMain(llvm::raw_ostream&, llvm::RecordKeeper&) + 229 8 llvm-tblgen 0x000000010a4e02a8 llvm::TableGenMain(char*, bool (*)(llvm::raw_ostream&, llvm::RecordKeeper&)) + 2344 9 llvm-tblgen 0x000000010a4cf80c main + 92 10 llvm-tblgen 0x000000010a3937c4 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/llvm-tblgen -I /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600 -I /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target -gen-dfa-packetizer -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenDFAPacketizer.inc.tmp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/AMDGPU.td /usr/bin/cmp -s AMDGPUGenMCCodeEmitter.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenMCCodeEmitter.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenMCCodeEmitter.inc.tmp AMDGPUGenMCCodeEmitter.inc /usr/bin/cmp -s AMDGPUGenCallingConv.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenCallingConv.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenCallingConv.inc.tmp AMDGPUGenCallingConv.inc /usr/bin/cmp -s AMDGPUGenIntrinsics.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenIntrinsics.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenIntrinsics.inc.tmp AMDGPUGenIntrinsics.inc make[3]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenDFAPacketizer.inc.tmp] Illegal instruction: 4 make[3]: *** Waiting for unfinished jobs.... make[2]: *** [R600/.makeall] Error 2 make[1]: *** [Target/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 16:17:48 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 16:17:48 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140421231807.555074FC8BDB@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14679 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206821 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': 6 llvm-tblgen 0x000000010a464077 llvm::EmitDFAPacketizer(llvm::RecordKeeper&, llvm::raw_ostream&) + 8823 7 llvm-tblgen 0x000000010a4cf915 (anonymous namespace)::LLVMTableGenMain(llvm::raw_ostream&, llvm::RecordKeeper&) + 229 8 llvm-tblgen 0x000000010a4e02a8 llvm::TableGenMain(char*, bool (*)(llvm::raw_ostream&, llvm::RecordKeeper&)) + 2344 9 llvm-tblgen 0x000000010a4cf80c main + 92 10 llvm-tblgen 0x000000010a3937c4 start + 52 Stack dump: 0. Program arguments: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/llvm-tblgen -I /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600 -I /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include -I /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target -gen-dfa-packetizer -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenDFAPacketizer.inc.tmp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/Target/R600/AMDGPU.td /usr/bin/cmp -s AMDGPUGenMCCodeEmitter.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenMCCodeEmitter.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenMCCodeEmitter.inc.tmp AMDGPUGenMCCodeEmitter.inc /usr/bin/cmp -s AMDGPUGenCallingConv.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenCallingConv.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenCallingConv.inc.tmp AMDGPUGenCallingConv.inc /usr/bin/cmp -s AMDGPUGenIntrinsics.inc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenIntrinsics.inc.tmp || /bin/cp /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenIntrinsics.inc.tmp AMDGPUGenIntrinsics.inc make[3]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/Target/R600/Release+Asserts/AMDGPUGenDFAPacketizer.inc.tmp] Illegal instruction: 4 make[3]: *** Waiting for unfinished jobs.... make[2]: *** [R600/.makeall] Error 2 make[1]: *** [Target/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 16:18:07 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 16:18:07 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140421231822.329344FC8BE2@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19117 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206821 Blamelist: dblaikie BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 16:18:07 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 16:18:07 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140421231822.129904FC8BE1@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19117 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206821 Blamelist: dblaikie BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: utils/TableGen/DFAPacketizerEmitter.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Mon 21 Apr 2014 15:46:42 Changed By: dblaikie Comments: Store State objects by value in TableGen's DFAPacketizerEmitter Removes some extra manual dynamic memory allocation/management. It does get a bit quirky having to make State's members mutable and pointers/references to const rather than non-const, but that's a necessary workaround to dealing with the std::set elements.Properties: File: utils/TableGen/DFAPacketizerEmitter.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Mon 21 Apr 2014 15:56:44 Changed By: dblaikie Comments: Fix builds that use an stl missing std::set::emplaceProperties: LOGS: From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 16:53:23 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 16:53:23 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140421235345.8C41B4FC9098@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19118 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206825 Blamelist: chandlerc,dblaikie,ruiu Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 17:21:12 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 17:21:12 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422002144.09CB94FC9509@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19119 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206827 Blamelist: delesley,dnovillo BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 17:36:40 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 17:36:40 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140422003806.D96CB4FC973D@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14682 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206830 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': 1 warning(s) in tests. Testing Time: 368.97s ******************** Failing Tests (3): LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Exact LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Inbounds LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.OverflowBits Expected Passes : 17634 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 3 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM-Unit::CloneInstruction.Exact': 1 UtilsTests 0x0000000104d9f324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x0000000104cbc2c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x0000000104cb46e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x0000000104ccfed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000104cd0430 testing::TestCase::Run() + 448 9 UtilsTests 0x0000000104cd75d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x0000000104cd709a testing::UnitTest::Run() + 106 11 UtilsTests 0x0000000104ce5061 main + 65 12 UtilsTests 0x0000000104cacd54 start + 52 13 UtilsTests 0x0000000000000002 start + 4214567650 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.Inbounds': 1 UtilsTests 0x0000000109f24324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x0000000109e412c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x0000000109e396e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x0000000109e54ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000109e55430 testing::TestCase::Run() + 448 9 UtilsTests 0x0000000109e5c5d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x0000000109e5c09a testing::UnitTest::Run() + 106 11 UtilsTests 0x0000000109e6a061 main + 65 12 UtilsTests 0x0000000109e31d54 start + 52 13 UtilsTests 0x0000000000000002 start + 4129088226 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.OverflowBits': 0 UtilsTests 0x0000000103121e48 llvm::sys::PrintStackTrace(__sFILE*) + 40 1 UtilsTests 0x0000000103122324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000004000 _sigtramp + 1807360800 4 UtilsTests 0x00000001030386ab llvm::BinaryOperator* (anonymous namespace)::CloneInstruction::clone(llvm::BinaryOperator*) + 27 5 UtilsTests 0x0000000103039f4e (anonymous namespace)::CloneInstruction_OverflowBits_Test::TestBody() + 4094 6 UtilsTests 0x0000000103052661 testing::Test::Run() + 801 7 UtilsTests 0x0000000103052ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000103053430 testing::TestCase::Run() + 448 9 UtilsTests 0x000000010305a5d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x000000010305a09a testing::UnitTest::Run() + 106 11 UtilsTests 0x0000000103068061 main + 65 12 UtilsTests 0x000000010302fd54 start + 52 ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 17:36:40 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 17:36:40 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140422003806.BDED14FC973C@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14682 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206830 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': 1 warning(s) in tests. Testing Time: 368.97s ******************** Failing Tests (3): LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Exact LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Inbounds LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.OverflowBits Expected Passes : 17634 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 3 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM-Unit::CloneInstruction.Exact': 1 UtilsTests 0x0000000104d9f324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x0000000104cbc2c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x0000000104cb46e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x0000000104ccfed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000104cd0430 testing::TestCase::Run() + 448 9 UtilsTests 0x0000000104cd75d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x0000000104cd709a testing::UnitTest::Run() + 106 11 UtilsTests 0x0000000104ce5061 main + 65 12 UtilsTests 0x0000000104cacd54 start + 52 13 UtilsTests 0x0000000000000002 start + 4214567650 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.Inbounds': 1 UtilsTests 0x0000000109f24324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x0000000109e412c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x0000000109e396e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x0000000109e54ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000109e55430 testing::TestCase::Run() + 448 9 UtilsTests 0x0000000109e5c5d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x0000000109e5c09a testing::UnitTest::Run() + 106 11 UtilsTests 0x0000000109e6a061 main + 65 12 UtilsTests 0x0000000109e31d54 start + 52 13 UtilsTests 0x0000000000000002 start + 4129088226 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.OverflowBits': 0 UtilsTests 0x0000000103121e48 llvm::sys::PrintStackTrace(__sFILE*) + 40 1 UtilsTests 0x0000000103122324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000004000 _sigtramp + 1807360800 4 UtilsTests 0x00000001030386ab llvm::BinaryOperator* (anonymous namespace)::CloneInstruction::clone(llvm::BinaryOperator*) + 27 5 UtilsTests 0x0000000103039f4e (anonymous namespace)::CloneInstruction_OverflowBits_Test::TestBody() + 4094 6 UtilsTests 0x0000000103052661 testing::Test::Run() + 801 7 UtilsTests 0x0000000103052ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000103053430 testing::TestCase::Run() + 448 9 UtilsTests 0x000000010305a5d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x000000010305a09a testing::UnitTest::Run() + 106 11 UtilsTests 0x0000000103068061 main + 65 12 UtilsTests 0x000000010302fd54 start + 52 ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 17:38:17 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 17:38:17 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140422003829.849EE4FC975E@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19120 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206830 Blamelist: chandlerc,dblaikie BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: unittests/Transforms/Utils/Cloning.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Mon 21 Apr 2014 17:00:42 Changed By: dblaikie Comments: Use unique_ptr to handle ownership of Value*s in Cloning unit tests.Properties: File: lib/Support/Host.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Mon 21 Apr 2014 17:06:43 Changed By: chandlerc Comments: [Modules] Followup to r206822 to add a DEBUG_TYPE which is used on ARM and PPC, but not x86.Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 17:38:17 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 17:38:17 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140422003829.85F214FC975F@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19120 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206830 Blamelist: chandlerc,dblaikie BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 18:35:39 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 18:35:39 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422013553.179B54FC9E92@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19121 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206832 Blamelist: rtrieu BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:39:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:39:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422013943.5BBF52A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24782?compare_to=24778&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24782, Order: 206782, Start Time: 2014-04-21 21:03:30, End Time: 2014-04-22 01:46:07 To: 24778, Order: 206714, Start Time: 2014-04-20 20:42:09, End Time: 2014-04-21 01:24:56 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 17 (145 on baseline) Performance Improvements: 8 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1087 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.59% (0.4640 => 0.4760, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: 1.80% (2.0001 => 2.0361, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.51% (4.5523 => 4.7123, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.26% (3.7162 => 3.8002, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (2.9122 => 2.9762, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.9482 => 4.0283, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0160) MultiSource/Applications/hexxagon/hexxagon: 1.88% (11.4807 => 11.6967, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.50% (4.0042 => 4.0643, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: 1.01% (6.7604 => 6.8284, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -10.94% (0.2560 => 0.2280, std.dev.: 0.0103) MultiSource/Applications/lua/lua: -1.45% (4.9720 => 4.9000, std.dev.: 0.0246) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.63% (1.2121 => 1.1681, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.24% (5.1723 => 5.0563, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -1.87% (4.0803 => 4.0042, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.71% (4.2043 => 4.1323, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -1.23% (22.1494 => 21.8774, std.dev.: 0.0647) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0114) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0130) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0079) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0040) SingleSource/UnitTests/TestLoop: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 17.65% (0.1360 => 0.1600, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0156) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0138) SingleSource/Regression/C/test_indvars: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.08% (1.4241 => 1.5961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.54% (1.4561 => 1.6241, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 11.11% (0.1440 => 0.1600, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.89% (0.3640 => 0.4000, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: 9.64% (1.8680 => 2.0480, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.43% (0.4240 => 0.4640, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.42% (1.5281 => 1.6721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (1.0240 => 1.1160, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0200) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.91% (1.4161 => 1.5281, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.39% (0.7040 => 0.7560, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.04% (0.2840 => 0.3040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: 6.75% (1.0080 => 1.0760, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.56% (11.6440 => 12.4080, std.dev.: 0.0571) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (6.4680 => 6.8920, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.02% (0.3320 => 0.3520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0132) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (9.4842 => 10.0082, std.dev.: 0.0409) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.8881 => 0.9361, std.dev.: 0.0104) MultiSource/Applications/Burg/burg: 5.31% (1.5080 => 1.5880, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0267) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.06% (1.6601 => 1.7441, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.5600 => 1.6360, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0237) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.65% (6.5440 => 6.8480, std.dev.: 0.0458) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 4.41% (6.9844 => 7.2925, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0240) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (3.0282 => 3.1522, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.0443 => 10.4523, std.dev.: 0.0526) MultiSource/Applications/JM/lencod/lencod: 3.97% (21.9606 => 22.8328, std.dev.: 0.0728) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0102) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (5.3600 => 5.5520, std.dev.: 0.0542) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0121) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.45% (50.0290 => 51.7530, std.dev.: 0.1086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.35% (4.1843 => 4.3243, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (6.5080 => 6.7240, std.dev.: 0.0561) MultiSource/Applications/SPASS/SPASS: 3.28% (18.4404 => 19.0445, std.dev.: 0.0450) MultiSource/Applications/ClamAV/clamscan: 2.69% (19.0444 => 19.5564, std.dev.: 0.0412) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0210) MultiSource/Applications/treecc/treecc: 2.63% (2.5840 => 2.6520, std.dev.: 0.0232) MultiSource/Benchmarks/Bullet/bullet: 2.58% (38.4046 => 39.3966, std.dev.: 0.0580) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0203) MultiSource/Applications/kimwitu++/kc: 2.40% (19.6891 => 20.1611, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (16.3483 => 16.7323, std.dev.: 0.0380) MultiSource/Applications/lua/lua: 2.34% (4.7880 => 4.9000, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.38% (6.1044 => 6.1884, std.dev.: 0.0178) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (13.0563 => 13.2043, std.dev.: 0.0389) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 23.33% (0.1200 => 0.1480, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.70% (2.1401 => 2.4762, std.dev.: 0.0408) MultiSource/Applications/siod/siod: 10.63% (2.8602 => 3.1642, std.dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.28% (6.6684 => 6.8204, std.dev.: 0.0425) MultiSource/Applications/hexxagon/hexxagon: 1.63% (11.5087 => 11.6967, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/hash2: 1.50% (2.9322 => 2.9762, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.02% (2.7442 => 2.7722, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.84% (10.6247 => 2.0361, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.16% (2.9442 => 0.9080, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.11% (91.8497 => 49.4991, std.dev.: 10.3574) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.39% (50.3031 => 33.0061, std.dev.: 0.2319) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.21% (26.0616 => 17.1451, std.dev.: 0.0956) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.98% (42.1466 => 28.6698, std.dev.: 0.3305) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.68% (3.1122 => 2.3441, std.dev.: 0.1136) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.76% (0.3400 => 0.3000, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0125) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.45% (4.1243 => 4.0643, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:42:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:42:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422014210.56EE62A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24783?compare_to=24777&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24783, Order: 206790, Start Time: 2014-04-21 21:08:52, End Time: 2014-04-22 01:48:37 To: 24777, Order: 206714, Start Time: 2014-04-20 20:42:44, End Time: 2014-04-21 01:24:25 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (108 on baseline) Performance Improvements: 5 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 33.33% (0.0600 => 0.0800, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.26% (1.2721 => 1.2881, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.24% (1.2921 => 1.3081, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 1.23% (5.8564 => 5.9284, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.20% (1.3361 => 1.3521, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 1.89% (4.6683 => 4.7563, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 1.66% (21.7494 => 22.1094, std.dev.: 0.1177) SingleSource/Benchmarks/Misc/whetstone: 1.13% (1.4161 => 1.4321, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/PR640: -37.50% (0.0320 => 0.0200, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -5.63% (4.6883 => 4.4243, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.29% (1.3961 => 1.3641, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: -2.04% (4.1163 => 4.0323, std.dev.: 0.0144) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0651) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.33% (0.3000 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (5.8000 => 6.0680, std.dev.: 0.0390) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0547) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0462) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 2.59% (17.6165 => 18.0725, std.dev.: 0.0616) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: 2.49% (1.1240 => 1.1520, std.dev.: 0.0107) MultiSource/Applications/oggenc/oggenc: 2.28% (5.7964 => 5.9284, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.27% (48.1088 => 49.2009, std.dev.: 0.0766) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8486, std.dev.: 0.0806) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0359) MultiSource/Applications/kimwitu++/kc: 1.85% (18.8170 => 19.1651, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 1.79% (23.7574 => 24.1815, std.dev.: 0.0465) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0096) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (5.7564 => 5.8244, std.dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0442) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 18.02% (0.9321 => 1.1001, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0148) MultiSource/Applications/lua/lua: 4.52% (21.1533 => 22.1094, std.dev.: 0.1177) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 3.71% (5.8164 => 6.0324, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (25.8896 => 26.8057, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0312) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0049) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0196) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.19% (1.3481 => 1.3641, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:42:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:42:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422014251.C1ABD2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24784?compare_to=24777&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24784, Order: 206775, Start Time: 2014-04-21 21:02:54, End Time: 2014-04-22 01:49:28 To: 24777, Order: 206714, Start Time: 2014-04-20 20:42:44, End Time: 2014-04-21 01:24:25 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (107 on baseline) Performance Improvements: 5 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C/PR491: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 13.43% (0.2680 => 0.3040, std.dev.: 0.0132) SingleSource/Benchmarks/McGill/queens: 1.83% (2.1841 => 2.2241, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: 1.80% (4.6683 => 4.7523, std.dev.: 0.0194) MultiSource/Applications/lua/lua: 1.75% (21.7494 => 22.1294, std.dev.: 0.0308) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.14% (8.0802 => 7.9882, std.dev.: 0.0332) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -5.55% (4.6883 => 4.4283, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.15% (1.3961 => 1.3521, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: -1.85% (4.1163 => 4.0403, std.dev.: 0.0168) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0668) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0067) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0161) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0170) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0304) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0426) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0334) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0354) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0540) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0466) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0385) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.17% (48.1088 => 49.1529, std.dev.: 0.0912) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 1.68% (23.7574 => 24.1575, std.dev.: 0.0565) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (7.8562 => 7.9882, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0110) MultiSource/Applications/kimwitu++/kc: 1.25% (18.8170 => 19.0530, std.dev.: 0.0482) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0184) MultiSource/Benchmarks/Bullet/bullet: 1.09% (37.0925 => 37.4965, std.dev.: 0.0982) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0228) MultiSource/Applications/lua/lua: 4.61% (21.1533 => 22.1294, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (25.8896 => 26.7177, std.dev.: 0.0370) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0242) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1921 => 2.2241, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0035) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0577) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0175) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -25.93% (0.1080 => 0.0800, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:43:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:43:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422014302.2755D2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24785?compare_to=24784&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24785, Order: 206782, Start Time: 2014-04-21 21:05:54, End Time: 2014-04-22 01:49:41 To: 24784, Order: 206775, Start Time: 2014-04-21 21:02:54, End Time: 2014-04-22 01:49:28 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (101 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/badidx: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/llubenchmark/llu: 36.36% (0.0440 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: 21.43% (0.0560 => 0.0680, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 8.77% (0.2280 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.5120 => 0.5320, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6880 => 0.7120, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.04% (1.3721 => 1.4001, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.88% (1.2761 => 1.3001, std.dev.: 0.0087) MultiSource/Applications/oggenc/oggenc: 1.57% (5.8524 => 5.9444, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.55% (1.2921 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.52% (1.3161 => 1.3361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.26% (1.2721 => 1.2881, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.20% (1.3281 => 1.3441, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.30% (0.7280 => 0.7520, std.dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0064) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.45% (0.3760 => 0.4040, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (6.0160 => 6.4480, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0666) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (8.1441 => 8.5681, std.dev.: 0.0487) MultiSource/Applications/lua/lua: 5.04% (4.5200 => 4.7480, std.dev.: 0.0241) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0446) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0440) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0483) MultiSource/Applications/oggenc/oggenc: 2.55% (5.7964 => 5.9444, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0348) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0143) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.22% (48.1088 => 49.1769, std.dev.: 0.0889) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0378) MultiSource/Applications/sqlite3/sqlite3: 1.80% (23.7574 => 24.1855, std.dev.: 0.0299) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: 1.69% (37.0925 => 37.7205, std.dev.: 0.0623) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1330, std.dev.: 0.0664) MultiSource/Applications/SPASS/SPASS: 1.25% (17.5484 => 17.7684, std.dev.: 0.0520) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0225) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 4.67% (21.1533 => 22.1414, std.dev.: 0.2122) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (25.8896 => 26.7857, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0166) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0278) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0446) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/mason/mason: -26.32% (0.0760 => 0.0560, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.85% (0.8641 => 0.8481, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 18:49:43 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 18:49:43 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140422014958.C8C344FCA08B@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14683 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206832 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': 1 warning(s) in tests. Testing Time: 348.82s ******************** Failing Tests (3): LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Exact LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Inbounds LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.OverflowBits Expected Passes : 17635 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 3 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM-Unit::CloneInstruction.OverflowBits': 0 UtilsTests 0x0000000105face48 llvm::sys::PrintStackTrace(__sFILE*) + 40 1 UtilsTests 0x0000000105fad324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000004000 _sigtramp + 1807360800 4 UtilsTests 0x0000000105ec36ab llvm::BinaryOperator* (anonymous namespace)::CloneInstruction::clone(llvm::BinaryOperator*) + 27 5 UtilsTests 0x0000000105ec4f4e (anonymous namespace)::CloneInstruction_OverflowBits_Test::TestBody() + 4094 6 UtilsTests 0x0000000105edd661 testing::Test::Run() + 801 7 UtilsTests 0x0000000105edded0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000105ede430 testing::TestCase::Run() + 448 9 UtilsTests 0x0000000105ee55d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x0000000105ee509a testing::UnitTest::Run() + 106 11 UtilsTests 0x0000000105ef3061 main + 65 12 UtilsTests 0x0000000105ebad54 start + 52 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.Inbounds': 1 UtilsTests 0x0000000101ab9324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x00000001019d62c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x00000001019ce6e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x00000001019e9ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x00000001019ea430 testing::TestCase::Run() + 448 9 UtilsTests 0x00000001019f15d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x00000001019f109a testing::UnitTest::Run() + 106 11 UtilsTests 0x00000001019ff061 main + 65 12 UtilsTests 0x00000001019c6d54 start + 52 13 UtilsTests 0x0000000000000002 start + 4267938530 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.Exact': 1 UtilsTests 0x00000001006e5324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x00000001006022c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x00000001005fa6e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x0000000100615ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000100616430 testing::TestCase::Run() + 448 9 UtilsTests 0x000000010061d5d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x000000010061d09a testing::UnitTest::Run() + 106 11 UtilsTests 0x000000010062b061 main + 65 12 UtilsTests 0x00000001005f2d54 start + 52 13 UtilsTests 0x0000000000000002 start + 4288729826 ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:44:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:44:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140422014412.7F43E2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24786?compare_to=24779&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24786, Order: 206782, Start Time: 2014-04-21 21:03:38, End Time: 2014-04-22 01:50:49 To: 24779, Order: 206714, Start Time: 2014-04-20 20:42:12, End Time: 2014-04-21 01:27:44 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 16 (131 on baseline) Performance Improvements: 5 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2005-07-17-INT-To-FP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/five11/five11: 31.25% (0.0640 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.09% (0.3880 => 0.4000, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5480 => 0.5600, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 1.11% (7.2325 => 7.3125, std.dev.: 0.0249) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.1760 => 0.2000, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.18% (4.6843 => 4.8803, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.91% (3.7162 => 3.8242, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.36% (2.7122 => 2.7762, std.dev.: 0.0157) SingleSource/Benchmarks/McGill/queens: 2.01% (2.1841 => 2.2281, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.88% (11.4887 => 11.7047, std.dev.: 0.0245) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.23% (1.2241 => 1.1601, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -2.91% (4.1283 => 4.0083, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.12% (4.9963 => 4.9403, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2443 => 4.2003, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.07% (17.6723 => 19.6283, std.dev.: 0.0695) MultiSource/Applications/sqlite3/sqlite3: 1419.06% (1.7001 => 25.8256, std.dev.: 0.0430) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.32% (50.1010 => 51.7650, std.dev.: 0.1291) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (11.3920 => 12.3480, std.dev.: 0.0694) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0098) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0083, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3681, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7124, std.dev.: 0.0160) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0100) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/Regression/C/testtrace: 60.00% (0.0200 => 0.0320, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.00% (0.1000 => 0.1200, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 19.23% (0.1040 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.05% (1.8601 => 2.1401, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.61% (1.9161 => 2.1961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.38% (1.8081 => 2.0681, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.67% (1.9601 => 2.2281, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.30% (1.9241 => 2.1801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.97% (1.9121 => 2.1601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.19% (1.7721 => 1.9881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.8361 => 2.0241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.00% (0.1200 => 0.1320, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0357) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0155) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.95% (0.7280 => 0.7640, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0228) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 4.54% (10.2283 => 10.6924, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (5.8281 => 6.0921, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.49% (0.9801 => 1.0241, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.48% (1.6960 => 1.7720, std.dev.: 0.0196) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (6.5320 => 6.8160, std.dev.: 0.0360) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (9.6042 => 10.0082, std.dev.: 0.0366) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0315) MultiSource/Applications/oggenc/oggenc: 3.69% (7.0524 => 7.3125, std.dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 3.59% (1.7841 => 1.8481, std.dev.: 0.0140) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (2.1600 => 2.2320, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 3.04% (5.3960 => 5.5600, std.dev.: 0.0461) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 2.94% (18.5284 => 19.0725, std.dev.: 0.0344) MultiSource/Applications/JM/lencod/lencod: 2.74% (22.2206 => 22.8287, std.dev.: 0.0597) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (6.5360 => 6.7120, std.dev.: 0.0487) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.48% (0.4840 => 0.4960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (2.1240 => 2.1760, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (16.3003 => 16.6883, std.dev.: 0.0524) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2243 => 4.3243, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0141) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0186) MultiSource/Benchmarks/Bullet/bullet: 1.96% (38.6366 => 39.3926, std.dev.: 0.0919) MultiSource/Applications/kimwitu++/kc: 1.78% (19.8291 => 20.1811, std.dev.: 0.0495) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (13.0363 => 13.2123, std.dev.: 0.0362) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.34% (2.1201 => 2.4242, std.dev.: 0.0536) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 3.09% (6.5964 => 6.8004, std.dev.: 0.0578) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.4967 => 11.7047, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.58% (4.8043 => 4.8803, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.23% (0.6880 => 0.6520, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.95% (94.8339 => 49.3631, std.dev.: 8.5286) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.13% (49.9431 => 32.8981, std.dev.: 0.1634) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.60% (25.7136 => 17.0731, std.dev.: 0.0722) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.53% (37.0863 => 28.7298, std.dev.: 0.4039) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0128) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:44:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:44:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422014431.B8FA22A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24787?compare_to=24784&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24787, Order: 206779, Start Time: 2014-04-21 21:03:29, End Time: 2014-04-22 01:51:06 To: 24784, Order: 206775, Start Time: 2014-04-21 21:02:54, End Time: 2014-04-22 01:49:28 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (99 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/badidx: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) MultiSource/Benchmarks/llubenchmark/llu: 36.36% (0.0440 => 0.0600, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 35.00% (0.0800 => 0.1080, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.00% (0.1000 => 0.1120, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 8.77% (0.2280 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.57% (1.2761 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.55% (1.2921 => 1.3121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.51% (1.3241 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.46% (1.3721 => 1.3921, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3481 => 2.3041, std.dev.: 0.0170) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0074) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0178) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0873) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (6.0160 => 6.3520, std.dev.: 0.0618) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0266) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0445) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (10.4082 => 10.7122, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0274) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0410) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.39% (48.1088 => 49.2570, std.dev.: 0.1030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0342) MultiSource/Applications/sqlite3/sqlite3: 1.99% (23.7574 => 24.2295, std.dev.: 0.0419) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0150) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1210, std.dev.: 0.0316) MultiSource/Benchmarks/Bullet/bullet: 1.48% (37.0925 => 37.6406, std.dev.: 0.0766) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0551) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0156) MultiSource/Applications/lua/lua: 4.39% (21.1533 => 22.0814, std.dev.: 0.0934) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (25.8896 => 26.7977, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0458) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0069) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 1.14% (6.6564 => 6.7324, std.dev.: 0.0195) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0347) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:47:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:47:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422014729.92A602A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24788?compare_to=24780&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24788, Order: 206790, Start Time: 2014-04-21 21:06:22, End Time: 2014-04-22 01:54:06 To: 24780, Order: 206714, Start Time: 2014-04-20 20:42:11, End Time: 2014-04-21 01:29:04 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 5 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1091 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0800 => 0.0960, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.21% (0.4280 => 0.4760, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.45% (0.2480 => 0.2640, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.68% (0.3520 => 0.3720, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 3.00% (0.4000 => 0.4120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.32% (1.8201 => 1.8441, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.00% (0.1000 => 0.1120, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 9.38% (0.1280 => 0.1400, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.75% (0.9481 => 1.0121, std.dev.: 0.0139) MultiSource/Applications/lambda-0_1_3/lambda: 3.35% (5.0203 => 5.1883, std.dev.: 0.0429) SingleSource/Benchmarks/McGill/queens: 3.10% (2.1921 => 2.2601, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.16% (2.7722 => 2.8322, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 1.92% (2.9162 => 2.9722, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/chomp: 1.80% (1.1081 => 1.1281, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.78% (4.6563 => 4.4803, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.52% (4.2043 => 4.0563, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -3.11% (4.2443 => 4.1123, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.66% (4.0563 => 3.9482, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -1.89% (3.1762 => 3.1162, std.dev.: 0.0219) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -21.98% (0.7280 => 0.5680, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:48:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:48:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140422014828.CB9F72A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24789?compare_to=24781&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24789, Order: 206782, Start Time: 2014-04-21 21:05:27, End Time: 2014-04-22 01:55:06 To: 24781, Order: 206714, Start Time: 2014-04-20 20:42:10, End Time: 2014-04-21 01:31:05 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (138 on baseline) Performance Improvements: 7 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1088 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.38% (0.1280 => 0.1400, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.05% (0.7920 => 0.8320, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0076) SingleSource/Benchmarks/Linpack/linpack-pc: 3.57% (0.3360 => 0.3480, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.18% (3.7202 => 3.7642, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.14% (1.0561 => 1.0681, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 5.21% (0.3840 => 0.4040, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 4.31% (5.0123 => 5.2283, std.dev.: 0.0318) SingleSource/Benchmarks/McGill/queens: 2.73% (2.1961 => 2.2561, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.85% (1.2961 => 1.3201, std.dev.: 0.0089) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.31% (5.5163 => 5.5883, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.16% (1.3761 => 1.3921, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -8.20% (3.4642 => 3.1802, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.35% (4.6523 => 4.4963, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.04% (4.2123 => 4.0843, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.61% (5.2163 => 5.0803, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -2.08% (22.2694 => 21.8054, std.dev.: 0.0529) MultiSource/Applications/sqlite3/sqlite3: -2.08% (4.2283 => 4.1403, std.dev.: 0.0178) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0102) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0059) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.43% (0.0920 => 0.1200, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.04% (1.6921 => 2.0481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.12% (1.9881 => 2.3881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.00% (1.7401 => 2.0881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.07% (1.8881 => 2.2481, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.03% (1.8081 => 2.1521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.64% (0.2360 => 0.2800, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.86% (1.8361 => 2.1641, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/puzzle: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.67% (0.1200 => 0.1400, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 13.21% (0.2120 => 0.2400, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Linpack/linpack-pc: 10.13% (0.3160 => 0.3480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.80% (0.6120 => 0.6720, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.10% (1.2400 => 1.3280, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.7800 => 0.8320, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.07% (1.6481 => 1.7481, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (6.7200 => 7.1240, std.dev.: 0.0461) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.67% (11.7880 => 12.4560, std.dev.: 0.0938) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (1.7280 => 1.8240, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0068) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0089) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (9.9842 => 10.4762, std.dev.: 0.0327) MultiSource/Applications/lua/lua: 4.92% (4.7920 => 5.0280, std.dev.: 0.0278) MultiSource/Applications/oggenc/oggenc: 4.75% (6.9124 => 7.2405, std.dev.: 0.0228) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0186) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.22% (6.8321 => 7.1201, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.92% (0.4080 => 0.4240, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0125) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.50% (1.3720 => 1.4200, std.dev.: 0.0163) MultiSource/Applications/JM/ldecod/ldecod: 3.49% (10.3203 => 10.6804, std.dev.: 0.0435) MultiSource/Applications/SPASS/SPASS: 3.25% (18.4924 => 19.0925, std.dev.: 0.0408) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 2.72% (22.6287 => 23.2447, std.dev.: 0.0609) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (3.0122 => 3.0922, std.dev.: 0.0120) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.51% (51.1089 => 52.3929, std.dev.: 0.0981) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (5.5480 => 5.6840, std.dev.: 0.0463) MultiSource/Applications/kimwitu++/kc: 2.25% (19.7371 => 20.1811, std.dev.: 0.0415) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2203 => 4.3123, std.dev.: 0.0104) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 1.98% (20.2445 => 20.6445, std.dev.: 0.0758) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (16.5963 => 16.8763, std.dev.: 0.0612) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.57% (38.9366 => 39.5486, std.dev.: 0.0689) MultiSource/Applications/sqlite3/sqlite3: 1.35% (25.1895 => 25.5295, std.dev.: 0.0529) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/bigfib: 10.77% (0.2600 => 0.2880, std.dev.: 0.0109) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0244) MultiSource/Applications/minisat/minisat: 3.75% (6.8204 => 7.0764, std.dev.: 0.0189) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (4.4883 => 4.5563, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 1.48% (5.9604 => 6.0484, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0203 => 4.0723, std.dev.: 0.0171) MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.0923 => 4.1403, std.dev.: 0.0178) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: -20.24% (2.6481 => 2.1120, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.85% (7.4801 => 6.2200, std.dev.: 0.0374) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.83% (7.5041 => 6.3160, std.dev.: 0.0416) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -2.72% (13.5243 => 13.1563, std.dev.: 0.0369) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.48% (21.6534 => 17.8691, std.dev.: 0.0429) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0085) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.03% (29.4578 => 28.5658, std.dev.: 0.3304) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0535) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:49:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:49:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422014924.6154D2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24790?compare_to=24784&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24790, Order: 206778, Start Time: 2014-04-21 21:07:32, End Time: 2014-04-22 01:56:01 To: 24784, Order: 206775, Start Time: 2014-04-21 21:02:54, End Time: 2014-04-22 01:49:28 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (100 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-08-BitOpsTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/misr: 26.67% (0.0600 => 0.0760, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.63% (0.1640 => 0.1880, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.45% (0.3480 => 0.3600, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.51% (1.2761 => 1.3081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.85% (1.2961 => 1.3201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.55% (1.2881 => 1.3081, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 1.39% (2.5961 => 2.6321, std.dev.: 0.0093) SingleSource/UnitTests/Vector/constpool: 1.19% (2.0201 => 2.0441, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.88% (0.9721 => 1.0001, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.87% (1.2201 => 1.3161, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0563) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0544) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0212) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0209) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0401) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 2.68% (17.6165 => 18.0885, std.dev.: 0.0476) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.50% (48.1088 => 49.3130, std.dev.: 0.0741) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0413) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0397) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1491, std.dev.: 0.0490) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0213) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0254) MultiSource/Benchmarks/Bullet/bullet: 1.25% (37.0925 => 37.5565, std.dev.: 0.0914) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 4.41% (21.1533 => 22.0854, std.dev.: 0.0825) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.17% (0.9601 => 1.0001, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0087) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0366) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -81.24% (10.8967 => 2.0441, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.04% (3.4682 => 3.4322, std.dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 18:54:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Apr 2014 20:54:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140422015417.2E2EF2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24791?compare_to=24775&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24791, Order: 206790, Start Time: 2014-04-21 21:07:27, End Time: 2014-04-22 02:00:56 To: 24775, Order: 206712, Start Time: 2014-04-20 05:43:46, End Time: 2014-04-20 10:26:30 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (160 on baseline) Performance Improvements: 5 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/perlin: 28.57% (0.0560 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.67% (0.1800 => 0.1920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.33% (1.5041 => 1.5241, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.09% (1.4681 => 1.4841, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 1.06% (6.8164 => 6.8884, std.dev.: 0.0177) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 4.14% (5.0203 => 5.2283, std.dev.: 0.0180) SingleSource/Benchmarks/McGill/queens: 2.92% (2.1921 => 2.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.65% (4.0803 => 4.1883, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.54% (5.0403 => 5.1683, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.06% (1.3561 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.82% (2.8602 => 2.9122, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.68% (4.7563 => 4.8363, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.36% (3.8122 => 3.8642, std.dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -5.81% (0.6200 => 0.5840, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.3240 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.48% (4.1923 => 4.0883, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -2.01% (3.1762 => 3.1122, std.dev.: 0.0169) MultiSource/Applications/sqlite3/sqlite3: -1.04% (4.2123 => 4.1683, std.dev.: 0.0143) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0053) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0100) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 195.24% (0.2520 => 0.7440, std.dev.: 0.0144) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0071) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0041) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 62.50% (0.0320 => 0.0520, std.dev.: 0.0027) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: 43.39% (1.3920 => 1.9960, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: 40.00% (0.0600 => 0.0840, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.68% (1.2481 => 1.5561, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0130) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.77% (1.1361 => 1.3721, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.45% (1.2321 => 1.4841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.45% (1.2321 => 1.4841, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 18.00% (8.5802 => 10.1243, std.dev.: 0.0388) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.53% (1.2321 => 1.4481, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 15.33% (19.5406 => 22.5367, std.dev.: 0.0456) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.17% (5.3360 => 6.0921, std.dev.: 0.0425) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0152) MultiSource/Benchmarks/nbench/nbench: 12.72% (1.3521 => 1.5241, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.36% (0.1760 => 0.1960, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0076) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0161) MultiSource/Applications/oggenc/oggenc: 9.61% (6.2844 => 6.8884, std.dev.: 0.0177) MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (11.3843 => 12.4363, std.dev.: 0.0323) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.45% (5.7280 => 6.2120, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (5.6680 => 6.1440, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (11.4440 => 12.3560, std.dev.: 0.0420) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.35% (9.5802 => 10.1882, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.7360 => 0.7760, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0234) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 4.53% (4.7720 => 4.9880, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0038) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/gs/gs: 4.16% (5.3840 => 5.6080, std.dev.: 0.0273) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (6.8280 => 7.0880, std.dev.: 0.0449) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0163) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (49.1529 => 50.8329, std.dev.: 0.0867) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 2.85% (19.2243 => 19.7723, std.dev.: 0.0426) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 2.54% (24.7575 => 25.3855, std.dev.: 0.0422) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 2.12% (1.6961 => 1.7321, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: 1.86% (19.7491 => 20.1171, std.dev.: 0.0610) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.0124 => 6.1244, std.dev.: 0.0206) MultiSource/Benchmarks/Bullet/bullet: 1.59% (39.0726 => 39.6926, std.dev.: 0.0669) MultiSource/Applications/SPASS/SPASS: 1.06% (18.7966 => 18.9964, std.dev.: 0.0552) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (29.3298 => 29.6379, std.dev.: 0.0365) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.81% (1.2401 => 1.4361, std.dev.: 0.0164) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 6.40% (1.3121 => 1.3961, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0169) MultiSource/Applications/minisat/minisat: 3.93% (6.8204 => 7.0884, std.dev.: 0.0435) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.91% (1.1001 => 1.1321, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 2.76% (4.0563 => 4.1683, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/salsa20: 2.68% (7.3085 => 7.5045, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (5.0963 => 5.2283, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: 2.06% (1.3601 => 1.3881, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (25.4536 => 25.9136, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.53% (21.6534 => 17.8571, std.dev.: 0.0457) SingleSource/Benchmarks/Linpack/linpack-pc: -16.08% (7.8605 => 6.5964, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -9.33% (3.4722 => 3.1482, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0959) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0196) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0201) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 20:10:49 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 20:10:49 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140422031123.1DC9E4FCAE9A@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14685 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206834 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': 1 warning(s) in tests. Testing Time: 370.93s ******************** Failing Tests (3): LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Exact LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Inbounds LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.OverflowBits Expected Passes : 17635 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 3 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM-Unit::CloneInstruction.Inbounds': 1 UtilsTests 0x000000010c478324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x000000010c3952c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x000000010c38d6e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x000000010c3a8ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x000000010c3a9430 testing::TestCase::Run() + 448 9 UtilsTests 0x000000010c3b05d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x000000010c3b009a testing::UnitTest::Run() + 106 11 UtilsTests 0x000000010c3be061 main + 65 12 UtilsTests 0x000000010c385d54 start + 52 13 UtilsTests 0x0000000000000002 start + 4089946850 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.OverflowBits': 0 UtilsTests 0x000000010ac93e48 llvm::sys::PrintStackTrace(__sFILE*) + 40 1 UtilsTests 0x000000010ac94324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000004000 _sigtramp + 1807360800 4 UtilsTests 0x000000010abaa6ab llvm::BinaryOperator* (anonymous namespace)::CloneInstruction::clone(llvm::BinaryOperator*) + 27 5 UtilsTests 0x000000010ababf4e (anonymous namespace)::CloneInstruction_OverflowBits_Test::TestBody() + 4094 6 UtilsTests 0x000000010abc4661 testing::Test::Run() + 801 7 UtilsTests 0x000000010abc4ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x000000010abc5430 testing::TestCase::Run() + 448 9 UtilsTests 0x000000010abcc5d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x000000010abcc09a testing::UnitTest::Run() + 106 11 UtilsTests 0x000000010abda061 main + 65 12 UtilsTests 0x000000010aba1d54 start + 52 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.Exact': 1 UtilsTests 0x000000010439e324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x00000001042bb2c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x00000001042b36e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x00000001042ceed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x00000001042cf430 testing::TestCase::Run() + 448 9 UtilsTests 0x00000001042d65d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x00000001042d609a testing::UnitTest::Run() + 106 11 UtilsTests 0x00000001042e4061 main + 65 12 UtilsTests 0x00000001042abd54 start + 52 13 UtilsTests 0x0000000000000002 start + 4225057506 ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 20:54:39 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 20:54:39 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140422035614.AF36D4FCB7C2@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14686 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206836 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': 1 warning(s) in tests. Testing Time: 368.80s ******************** Failing Tests (3): LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Exact LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.Inbounds LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/CloneInstruction.OverflowBits Expected Passes : 17635 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 3 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM-Unit::CloneInstruction.OverflowBits': 0 UtilsTests 0x000000010e990e48 llvm::sys::PrintStackTrace(__sFILE*) + 40 1 UtilsTests 0x000000010e991324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000004000 _sigtramp + 1807360800 4 UtilsTests 0x000000010e8a76ab llvm::BinaryOperator* (anonymous namespace)::CloneInstruction::clone(llvm::BinaryOperator*) + 27 5 UtilsTests 0x000000010e8a8f4e (anonymous namespace)::CloneInstruction_OverflowBits_Test::TestBody() + 4094 6 UtilsTests 0x000000010e8c1661 testing::Test::Run() + 801 7 UtilsTests 0x000000010e8c1ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x000000010e8c2430 testing::TestCase::Run() + 448 9 UtilsTests 0x000000010e8c95d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x000000010e8c909a testing::UnitTest::Run() + 106 11 UtilsTests 0x000000010e8d7061 main + 65 12 UtilsTests 0x000000010e89ed54 start + 52 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.Inbounds': 1 UtilsTests 0x0000000109ee6324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x0000000109e032c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x0000000109dfb6e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x0000000109e16ed0 testing::TestInfo::Run() + 832 8 UtilsTests 0x0000000109e17430 testing::TestCase::Run() + 448 9 UtilsTests 0x0000000109e1e5d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x0000000109e1e09a testing::UnitTest::Run() + 106 11 UtilsTests 0x0000000109e2c061 main + 65 12 UtilsTests 0x0000000109df3d54 start + 52 13 UtilsTests 0x0000000000000002 start + 4129342178 ******************** Last 15 lines of 'LLVM-Unit::CloneInstruction.Exact': 1 UtilsTests 0x000000010e2cc324 _ZL13SignalHandleri + 564 2 libsystem_c.dylib 0x00007fff94461cfa _sigtramp + 26 3 libsystem_c.dylib 0x0000000000000190 _sigtramp + 1807344816 4 libsystem_c.dylib 0x00007fff9445f84c free + 389 5 UtilsTests 0x000000010e1e92c0 std::__1::__tree >, std::__1::less > >, std::__1::allocator > > >::destroy(std::__1::__tree_node >, void*>*) + 64 6 UtilsTests 0x000000010e1e16e0 (anonymous namespace)::CloneInstruction::TearDown() + 64 7 UtilsTests 0x000000010e1fced0 testing::TestInfo::Run() + 832 8 UtilsTests 0x000000010e1fd430 testing::TestCase::Run() + 448 9 UtilsTests 0x000000010e2045d5 testing::internal::UnitTestImpl::RunAllTests() + 1317 10 UtilsTests 0x000000010e20409a testing::UnitTest::Run() + 106 11 UtilsTests 0x000000010e212061 main + 65 12 UtilsTests 0x000000010e1d9d54 start + 52 13 UtilsTests 0x0000000000000002 start + 4058145506 ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Mon Apr 21 21:57:18 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 21 Apr 2014 21:57:18 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422045732.E42034FCC020@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19126 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206864 Blamelist: arsenm,chandlerc,dexonsmith,jiangning Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Mon Apr 21 23:41:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 01:41:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422064102.35A212A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24792?compare_to=24783&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24792, Order: 206834, Start Time: 2014-04-22 02:07:08, End Time: 2014-04-22 06:47:02 To: 24783, Order: 206790, Start Time: 2014-04-21 21:08:52, End Time: 2014-04-22 01:48:37 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 20 (113 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 200.00% (0.0080 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Queens: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 13.33% (0.1200 => 0.1360, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.11% (0.1480 => 0.1600, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.78% (0.6920 => 0.7320, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3200 => 0.3360, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4360 => 0.4520, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.16% (1.0120 => 1.0440, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 1.79% (4.6840 => 4.7680, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.54% (1.3001 => 1.3201, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.53% (1.3081 => 1.3281, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.50% (6.4040 => 6.5000, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.48% (1.3481 => 1.3681, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.47% (1.3561 => 1.3761, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (4.9960 => 5.0680, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (2.8722 => 2.9122, std.dev.: 0.0154) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (8.4881 => 8.5881, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.08% (4.0843 => 4.1283, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.15% (5.9284 => 5.8604, std.dev.: 0.0170) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0065) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.13% (1.1881 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.07% (1.1601 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.04% (1.1961 => 1.3281, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.26% (1.2481 => 1.3761, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0165) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.05% (6.0160 => 6.5000, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0587) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.67% (0.9880 => 1.0440, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 5.49% (4.5200 => 4.7680, std.dev.: 0.0241) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.45% (8.1441 => 8.5881, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (4.9200 => 5.1320, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0574) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0458) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (5.8400 => 6.0600, std.dev.: 0.0394) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (4.9000 => 5.0680, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 3.32% (17.6165 => 18.2005, std.dev.: 0.0447) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.90% (48.1088 => 49.5049, std.dev.: 0.0759) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.89% (4.0122 => 4.1283, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0154) MultiSource/Applications/siod/siod: 2.80% (2.5721 => 2.6441, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 2.76% (37.0925 => 38.1166, std.dev.: 0.0534) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0456) MultiSource/Applications/kimwitu++/kc: 2.40% (18.8170 => 19.2691, std.dev.: 0.0451) MultiSource/Applications/sqlite3/sqlite3: 2.27% (23.7574 => 24.2975, std.dev.: 0.0512) MultiSource/Applications/SPASS/SPASS: 1.80% (17.5484 => 17.8644, std.dev.: 0.0466) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 1.26% (17.4082 => 17.6282, std.dev.: 0.0557) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0201) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.68% (0.2480 => 0.2720, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 4.97% (21.1533 => 22.2054, std.dev.: 0.0613) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.14% (3.3802 => 3.5202, std.dev.: 0.0495) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0366) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.95% (4.5043 => 4.5923, std.dev.: 0.0218) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0242) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 23:50:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 01:50:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140422065014.4F3A02A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24793?compare_to=24786&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24793, Order: 206834, Start Time: 2014-04-22 02:09:14, End Time: 2014-04-22 06:56:52 To: 24786, Order: 206782, Start Time: 2014-04-21 21:03:38, End Time: 2014-04-22 01:50:49 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 20 (141 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/Vector/sumarray: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/mst/mst: 18.75% (0.1280 => 0.1520, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 7.89% (0.1520 => 0.1640, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 4.30% (0.7440 => 0.7760, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 2.46% (0.4880 => 0.5000, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (1.1040 => 1.1280, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.74% (2.0681 => 2.1041, std.dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.8481 => 1.8801, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.67% (6.7120 => 6.8240, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.38% (2.0241 => 2.0521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.35% (2.0721 => 2.1001, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 1.12% (39.3926 => 39.8326, std.dev.: 0.0726) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 9.17% (4.9283 => 5.3803, std.dev.: 0.1022) MultiSource/Applications/lua/lua: 1.43% (21.7574 => 22.0694, std.dev.: 0.0740) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.55% (1.7281 => 1.6841, std.dev.: 0.0153) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.63% (17.6723 => 19.7284, std.dev.: 0.0571) MultiSource/Applications/sqlite3/sqlite3: 1424.00% (1.7001 => 25.9096, std.dev.: 0.0438) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.18% (50.1010 => 52.1930, std.dev.: 0.1025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (11.3920 => 12.3560, std.dev.: 0.0885) SingleSource/Benchmarks/Misc/oourafft: -73.12% (11.3407 => 3.0482, std.dev.: 0.0037) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0003, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0110) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0048) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/UnitTests/Vector/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0051) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 31.25% (0.0640 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.00% (0.1000 => 0.1200, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.41% (1.8281 => 2.1281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.37% (1.8081 => 2.1041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 16.04% (1.8201 => 2.1121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.73% (1.8561 => 2.1481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.58% (2.0281 => 2.3441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.22% (1.8921 => 2.1801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.17% (2.1361 => 2.4602, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.01% (1.9721 => 2.2681, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.92% (1.8761 => 2.1561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.02% (1.9121 => 2.1801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.93% (1.9521 => 2.2241, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.05% (1.8081 => 2.0441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.47% (1.7961 => 2.0201, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.79% (2.1041 => 2.3521, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.76% (1.8361 => 2.0521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (1.9761 => 2.2041, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.31% (2.0521 => 2.2841, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.03% (1.0880 => 1.2080, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0177) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.69% (0.6360 => 0.7040, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0142) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/em3d/em3d: 9.43% (0.2120 => 0.2320, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: 8.74% (1.8760 => 2.0400, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.95% (0.7040 => 0.7600, std.dev.: 0.0103) MultiSource/Applications/spiff/spiff: 7.87% (1.0160 => 1.0960, std.dev.: 0.0171) SingleSource/Benchmarks/Linpack/linpack-pc: 7.50% (0.3200 => 0.3440, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.4800 => 6.9320, std.dev.: 0.0357) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 5.38% (1.7841 => 1.8801, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.28% (1.2120 => 1.2760, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.21% (6.5320 => 6.8720, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.03% (1.7480 => 1.8360, std.dev.: 0.0159) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.00% (9.6042 => 10.0842, std.dev.: 0.0514) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (5.8281 => 6.1001, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.5640 => 1.6360, std.dev.: 0.0198) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.41% (6.5360 => 6.8240, std.dev.: 0.0304) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0176) MultiSource/Applications/JM/ldecod/ldecod: 4.15% (10.2283 => 10.6524, std.dev.: 0.0410) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0284) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 3.93% (5.3960 => 5.6080, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 3.41% (18.5284 => 19.1605, std.dev.: 0.0337) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0271) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.38% (1.3000 => 1.3440, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.27% (3.0562 => 3.1562, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (16.3003 => 16.8123, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.12% (4.2243 => 4.3563, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 3.10% (38.6366 => 39.8326, std.dev.: 0.0726) MultiSource/Applications/JM/lencod/lencod: 2.92% (22.2206 => 22.8688, std.dev.: 0.0388) MultiSource/Applications/oggenc/oggenc: 2.67% (7.0524 => 7.2405, std.dev.: 0.0226) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (2.1600 => 2.2160, std.dev.: 0.0209) MultiSource/Applications/kimwitu++/kc: 2.44% (19.8291 => 20.3131, std.dev.: 0.0554) MultiSource/Applications/d/make_dparser: 2.41% (3.9761 => 4.0721, std.dev.: 0.0243) MultiSource/Applications/siod/siod: 2.33% (2.7522 => 2.8162, std.dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (13.0363 => 13.2323, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.1484 => 6.2124, std.dev.: 0.0211) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.23% (2.1201 => 2.4642, std.dev.: 0.0409) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0221) MultiSource/Benchmarks/llubenchmark/llu: 6.32% (5.0603 => 5.3803, std.dev.: 0.1022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.74% (3.4242 => 3.5522, std.dev.: 0.0463) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 3.34% (6.5964 => 6.8164, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/salsa20: 3.26% (7.3725 => 7.6125, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.91% (11.4967 => 11.7167, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.67% (4.8043 => 4.8843, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 1.23% (21.8014 => 22.0694, std.dev.: 0.0740) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0169) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -66.67% (0.0240 => 0.0080, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.23% (94.8339 => 49.0951, std.dev.: 9.7937) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.90% (49.9431 => 33.0101, std.dev.: 0.1905) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.63% (25.7136 => 17.0651, std.dev.: 0.0894) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.86% (37.0863 => 28.6098, std.dev.: 0.4213) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.0973) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -13.25% (2.7482 => 2.3841, std.dev.: 0.1190) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0346) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.78% (5.6124 => 5.5123, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.57% (2.8002 => 2.7562, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.41% (2.8442 => 2.8042, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 23:53:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 01:53:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422065350.EAADB2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24794?compare_to=24788&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24794, Order: 206834, Start Time: 2014-04-22 02:12:26, End Time: 2014-04-22 07:00:23 To: 24788, Order: 206790, Start Time: 2014-04-21 21:06:22, End Time: 2014-04-22 01:54:06 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 19 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C/globalrefs: 200.00% (0.0080 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 17.78% (0.1800 => 0.2120, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: 10.53% (0.2280 => 0.2520, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3600 => 0.3840, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 5.17% (0.2320 => 0.2440, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.88% (1.7001 => 1.7321, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (2.1000 => 2.1360, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.61% (1.7441 => 1.7721, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.59% (2.0121 => 2.0441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.59% (1.7641 => 1.7921, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 46.15% (0.0520 => 0.0760, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.84% (0.6360 => 0.7240, std.dev.: 0.0204) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.87% (0.8561 => 0.8721, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0117) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 21 23:56:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 01:56:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140422065647.5D9452A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24795?compare_to=24789&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24795, Order: 206834, Start Time: 2014-04-22 02:13:25, End Time: 2014-04-22 07:03:26 To: 24789, Order: 206782, Start Time: 2014-04-21 21:05:27, End Time: 2014-04-22 01:55:06 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 25 (148 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1087 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Queens: 44.44% (0.0360 => 0.0520, std.dev.: 0.0036) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.64% (0.1880 => 0.2080, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 3.66% (0.6560 => 0.6800, std.dev.: 0.0065) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.16% (1.3920 => 1.4360, std.dev.: 0.0158) MultiSource/Applications/hexxagon/hexxagon: 2.37% (1.1800 => 1.2080, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 2.27% (0.8800 => 0.9000, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.78% (2.2481 => 2.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.73% (2.0841 => 2.1201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.66% (2.1641 => 2.2001, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.48% (6.2200 => 6.3120, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.40% (2.0041 => 2.0321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.38% (2.0321 => 2.0601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.34% (2.0961 => 2.1241, std.dev.: 0.0108) MultiSource/Benchmarks/Bullet/bullet: 1.27% (39.5486 => 40.0526, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.17% (2.0521 => 2.0761, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.16% (1.0321 => 1.0441, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.13% (2.1241 => 2.1481, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.7043 => 4.7923, std.dev.: 0.0287) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0122) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0049) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.40% (1.6961 => 2.0761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.40% (1.7321 => 2.1201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.04% (1.6881 => 2.0601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.82% (1.6681 => 2.0321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.79% (1.7441 => 2.1241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.78% (1.8001 => 2.1921, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.77% (1.7641 => 2.1481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.46% (1.6961 => 2.0601, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.28% (1.6921 => 2.0521, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.19% (1.8881 => 2.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.16% (1.7201 => 2.0841, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.80% (1.8081 => 2.1841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.76% (1.7921 => 2.1641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.40% (1.8041 => 2.1721, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.13% (1.8281 => 2.1961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.92% (1.9881 => 2.3841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.82% (1.8361 => 2.2001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.87% (1.9081 => 2.2681, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.53% (1.9641 => 2.3281, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.38% (1.9801 => 2.3441, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.61% (1.9761 => 2.3241, std.dev.: 0.0170) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0249) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.64% (0.1880 => 0.2080, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.26% (0.9920 => 1.0640, std.dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.86% (0.4080 => 0.4360, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (6.7200 => 7.1720, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0041) MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.53% (1.3480 => 1.4360, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 6.14% (0.4560 => 0.4840, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.7200 => 0.7640, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.67% (11.7880 => 12.4560, std.dev.: 0.0901) MultiSource/Applications/hexxagon/hexxagon: 5.59% (1.1440 => 1.2080, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (1.2400 => 1.3080, std.dev.: 0.0180) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.7280 => 1.8200, std.dev.: 0.0241) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0137) MultiSource/Applications/minisat/minisat: 5.14% (0.8560 => 0.9000, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.05% (9.9842 => 10.4882, std.dev.: 0.0436) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 4.94% (3.9641 => 4.1601, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.84% (0.2480 => 0.2600, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/football/football: 4.73% (1.1000 => 1.1520, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0282) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (1.0001 => 1.0441, std.dev.: 0.0042) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.37% (1.3720 => 1.4320, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (6.8321 => 7.1161, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.07% (0.4920 => 0.5120, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 3.97% (2.6200 => 2.7240, std.dev.: 0.0330) MultiSource/Applications/SPASS/SPASS: 3.94% (18.4924 => 19.2206, std.dev.: 0.0359) MultiSource/Applications/oggenc/oggenc: 3.93% (6.9124 => 7.1844, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0176) MultiSource/Applications/JM/ldecod/ldecod: 3.61% (10.3203 => 10.6924, std.dev.: 0.0457) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.47% (1.0361 => 1.0721, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 3.34% (22.6287 => 23.3848, std.dev.: 0.0502) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (5.5480 => 5.7320, std.dev.: 0.0429) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 3.20% (19.7371 => 20.3691, std.dev.: 0.0458) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.09% (51.1089 => 52.6889, std.dev.: 0.1337) MultiSource/Applications/siod/siod: 3.05% (2.7562 => 2.8402, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.94% (4.2203 => 4.3443, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (3.0122 => 3.1002, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: 2.87% (38.9366 => 40.0526, std.dev.: 0.0460) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (2.2721 => 2.3361, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 2.59% (20.2445 => 20.7685, std.dev.: 0.0527) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (16.5963 => 16.9483, std.dev.: 0.0541) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.06% (6.0244 => 6.1484, std.dev.: 0.0281) MultiSource/Applications/sqlite3/sqlite3: 1.97% (25.1895 => 25.6856, std.dev.: 0.0563) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0112) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (29.4578 => 29.7579, std.dev.: 0.0752) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0241) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0219) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 2.07% (21.6534 => 22.1014, std.dev.: 0.1452) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.96% (4.7003 => 4.7923, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (4.0203 => 4.0843, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (1.3681 => 1.3881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (4.2443 => 4.3003, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: -28.95% (0.7600 => 0.5400, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: -20.09% (2.6481 => 2.1160, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.62% (7.4801 => 6.3120, std.dev.: 0.0292) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.51% (7.5041 => 6.3400, std.dev.: 0.0372) SingleSource/UnitTests/Vector/multiplies: -14.63% (0.1640 => 0.1400, std.dev.: 0.0056) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: -2.48% (13.5243 => 13.1883, std.dev.: 0.0452) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.57% (21.6534 => 17.8491, std.dev.: 0.0498) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0095) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.66% (0.3280 => 0.3160, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -2.36% (8.3085 => 8.1125, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0477) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.26% (4.1323 => 4.0803, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 00:03:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 02:03:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140422070335.4973A2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24796?compare_to=24791&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24796, Order: 206834, Start Time: 2014-04-22 02:19:15, End Time: 2014-04-22 07:10:13 To: 24791, Order: 206790, Start Time: 2014-04-21 21:07:27, End Time: 2014-04-22 02:00:56 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 26 (173 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1086 (918 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/globalrefs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/Threads/tls: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0022) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 14.29% (0.0840 => 0.0960, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 13.89% (0.1440 => 0.1640, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.43% (0.2120 => 0.2320, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary: 8.70% (0.2760 => 0.3000, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.58% (1.1080 => 1.1920, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.35% (0.2720 => 0.2920, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 5.18% (1.5440 => 1.6240, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (0.3840 => 0.4000, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.15% (1.5240 => 1.5720, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.49% (1.4481 => 1.4841, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 2.17% (2.7642 => 2.8242, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.03% (1.3761 => 1.4041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.74% (1.6121 => 1.6401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.70% (1.4081 => 1.4321, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 1.22% (10.1243 => 10.2483, std.dev.: 0.0220) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 5.48% (0.5840 => 0.6160, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.8601 => 0.8761, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2312.50% (0.0320 => 0.7720, std.dev.: 0.0138) SingleSource/Benchmarks/Stanford/Puzzle: 1206.53% (0.1240 => 1.6201, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 979.08% (0.0760 => 0.8201, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0094) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 204.76% (0.2520 => 0.7680, std.dev.: 0.0143) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 88.46% (0.1040 => 0.1960, std.dev.: 0.0121) SingleSource/Regression/C/bigstack: 84.62% (0.0520 => 0.0960, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0044) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0047) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 43.39% (1.3920 => 1.9960, std.dev.: 0.0201) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.95% (1.2321 => 1.5641, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.00% (1.2481 => 1.5601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.47% (1.1761 => 1.4521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 23.16% (1.1401 => 1.4041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.00% (1.2001 => 1.4761, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.63% (1.1841 => 1.4521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.60% (1.2921 => 1.5841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.45% (1.1761 => 1.4401, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 22.26% (1.1321 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 22.04% (1.2161 => 1.4841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 22.03% (1.1441 => 1.3961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.84% (1.1721 => 1.4281, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.53% (1.1521 => 1.4001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.48% (1.1361 => 1.3801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.33% (1.1441 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.16% (1.1721 => 1.4201, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.05% (0.1520 => 0.1840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/chomp: 20.83% (0.1920 => 0.2320, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.78% (1.2321 => 1.4881, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.69% (1.1601 => 1.4001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.54% (1.1881 => 1.4321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.45% (1.2321 => 1.4841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.45% (1.2521 => 1.5081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0114) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.88% (1.3681 => 1.6401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: 19.44% (8.5802 => 10.2483, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.31% (1.2841 => 1.5321, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.23% (0.1040 => 0.1240, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.94% (1.2881 => 1.5321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.21% (1.3841 => 1.6361, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 16.09% (19.5406 => 22.6847, std.dev.: 0.0362) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.29% (5.3360 => 6.1521, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0151) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.18% (1.7400 => 1.9520, std.dev.: 0.0327) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 9.80% (11.3843 => 12.5003, std.dev.: 0.0534) MultiSource/Applications/oggenc/oggenc: 9.29% (6.2844 => 6.8684, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.29% (5.7280 => 6.2600, std.dev.: 0.0384) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.26% (0.6480 => 0.7080, std.dev.: 0.0170) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.96% (5.6680 => 6.1760, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (11.4440 => 12.4120, std.dev.: 0.0602) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.38% (0.7640 => 0.8280, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.61% (0.7360 => 0.7920, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.27% (0.2200 => 0.2360, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.26% (9.5802 => 10.2762, std.dev.: 0.0386) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.90% (1.6240 => 1.7360, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.38% (0.3760 => 0.4000, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (1.1240 => 1.1920, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.63% (6.8280 => 7.1440, std.dev.: 0.0421) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (5.3840 => 5.6280, std.dev.: 0.0465) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 4.44% (4.7720 => 4.9840, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/bigfib: 4.30% (0.7440 => 0.7760, std.dev.: 0.0068) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.26% (49.1529 => 51.2449, std.dev.: 0.0740) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.63% (1.4320 => 1.4840, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.6961 => 1.7521, std.dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 3.25% (19.2243 => 19.8484, std.dev.: 0.0533) MultiSource/Applications/sqlite3/sqlite3: 3.05% (24.7575 => 25.5135, std.dev.: 0.0507) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (2.7282 => 2.8082, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (1.5280 => 1.5720, std.dev.: 0.0169) MultiSource/Applications/kimwitu++/kc: 2.77% (19.7491 => 20.2971, std.dev.: 0.0412) MultiSource/Applications/siod/siod: 2.47% (2.7562 => 2.8242, std.dev.: 0.0190) MultiSource/Benchmarks/Bullet/bullet: 2.20% (39.0726 => 39.9326, std.dev.: 0.0727) MultiSource/Applications/SPASS/SPASS: 1.70% (18.7966 => 19.1166, std.dev.: 0.0512) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0124 => 6.1124, std.dev.: 0.0227) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (29.3298 => 29.7939, std.dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (3.0402 => 3.0882, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (4.2803 => 4.3243, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.01% (16.7083 => 16.8763, std.dev.: 0.0522) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0096) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0186) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.47% (3.3122 => 3.4602, std.dev.: 0.0541) MultiSource/Applications/siod/siod: 4.42% (2.9842 => 3.1162, std.dev.: 0.0272) MultiSource/Applications/minisat/minisat: 4.16% (6.8204 => 7.1044, std.dev.: 0.0304) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 3.06% (5.0963 => 5.2523, std.dev.: 0.0515) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.03% (5.0203 => 5.1723, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (25.4536 => 25.9176, std.dev.: 0.0206) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.54% (1.2961 => 1.3161, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.45% (4.1243 => 4.1843, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.35% (1.4761 => 1.4961, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0200 => 0.0000, std.dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: -81.60% (11.0207 => 2.0281, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.42% (21.6534 => 17.8811, std.dev.: 0.0594) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.66% (3.4442 => 3.0082, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0614) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9242 => 2.8362, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.85% (4.7643 => 4.6763, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0178) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 00:06:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 02:06:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422070620.B45F82A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24797?compare_to=24792&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24797, Order: 206837, Start Time: 2014-04-22 02:31:09, End Time: 2014-04-22 07:12:58 To: 24792, Order: 206834, Start Time: 2014-04-22 02:07:08, End Time: 2014-04-22 06:47:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (117 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (975 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 25.00% (0.0640 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 11.54% (0.1040 => 0.1160, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.76% (0.1640 => 0.1800, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.15% (1.3001 => 1.3281, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.19% (1.3401 => 1.3561, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 14.11% (0.9921 => 1.1321, std.dev.: 0.0463) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4322 => 2.4602, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 27.78% (0.0720 => 0.0920, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 16.00% (0.1000 => 0.1160, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 13.12% (1.1281 => 1.2761, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.25% (1.2081 => 1.3561, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.90% (1.1761 => 1.3161, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.82% (1.1841 => 1.3241, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.41% (1.1921 => 1.3281, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0129) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.26% (1.2481 => 1.3761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.26% (1.2521 => 1.3681, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0971) MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.06% (1.1880 => 1.2600, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (6.0160 => 6.3520, std.dev.: 0.0655) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (8.1441 => 8.5921, std.dev.: 0.0405) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.97% (5.8000 => 6.0880, std.dev.: 0.0555) MultiSource/Benchmarks/MallocBench/gs/gs: 4.72% (4.9200 => 5.1520, std.dev.: 0.0432) MultiSource/Benchmarks/Olden/bh/bh: 4.71% (0.3400 => 0.3560, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0173) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (10.4082 => 10.8482, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3800 => 1.4360, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0216) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (5.8400 => 6.0560, std.dev.: 0.0322) MultiSource/Applications/JM/lencod/lencod: 3.56% (17.6165 => 18.2445, std.dev.: 0.0378) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.53% (2.8322 => 2.9322, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0325) MultiSource/Applications/siod/siod: 2.95% (2.5721 => 2.6481, std.dev.: 0.0178) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.81% (48.1088 => 49.4609, std.dev.: 0.1299) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (4.0122 => 4.1243, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0390) MultiSource/Benchmarks/Bullet/bullet: 2.65% (37.0925 => 38.0766, std.dev.: 0.0671) MultiSource/Applications/kimwitu++/kc: 2.64% (18.8170 => 19.3131, std.dev.: 0.0387) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.44% (1.1480 => 1.1760, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 2.27% (23.7574 => 24.2975, std.dev.: 0.0390) MultiSource/Applications/SPASS/SPASS: 1.62% (17.5484 => 17.8324, std.dev.: 0.0519) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (15.2282 => 15.4162, std.dev.: 0.0483) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (5.7564 => 5.8244, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0156) MultiSource/Applications/lua/lua: 4.97% (21.1533 => 22.2054, std.dev.: 0.0937) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (25.8896 => 26.7897, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.31% (3.3802 => 3.4922, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.13% (1.2601 => 1.2081, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 00:17:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 02:17:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422071702.94C8B2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24798?compare_to=24797&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24798, Order: 206838, Start Time: 2014-04-22 02:37:23, End Time: 2014-04-22 07:23:40 To: 24797, Order: 206837, Start Time: 2014-04-22 02:31:09, End Time: 2014-04-22 07:12:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (102 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-13-SDivTwo: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/Vector/build: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2003-07-06-IntOverflow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/2005-07-17-INT-To-FP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.25% (0.2760 => 0.2960, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.9481 => 0.9721, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (2.3201 => 2.3481, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9642 => 4.0042, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/flops: -10.34% (0.1160 => 0.1040, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.13% (1.1881 => 1.3441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.41% (1.1601 => 1.3041, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.30% (1.1681 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.00% (1.2361 => 1.3721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.84% (1.1441 => 1.2681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.79% (1.2601 => 1.3961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.26% (1.2481 => 1.3761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.38% (1.3641 => 1.4921, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.26% (1.2521 => 1.3681, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (10.6960 => 11.5120, std.dev.: 0.0633) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0437) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0154) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.72% (1.1880 => 1.2560, std.dev.: 0.0165) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.35% (8.1441 => 8.5801, std.dev.: 0.0472) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (4.9200 => 5.1560, std.dev.: 0.0366) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0181) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (5.8000 => 6.0560, std.dev.: 0.0365) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (10.4082 => 10.8402, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (5.8400 => 6.0600, std.dev.: 0.0395) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 3.45% (17.6165 => 18.2245, std.dev.: 0.0502) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.8322 => 2.9242, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.89% (4.0122 => 4.1283, std.dev.: 0.0072) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.81% (48.1088 => 49.4610, std.dev.: 0.1116) MultiSource/Applications/kimwitu++/kc: 2.79% (18.8170 => 19.3411, std.dev.: 0.0339) MultiSource/Benchmarks/Bullet/bullet: 2.77% (37.0925 => 38.1206, std.dev.: 0.0731) MultiSource/Applications/treecc/treecc: 2.45% (2.4480 => 2.5080, std.dev.: 0.0198) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0396) MultiSource/Applications/sqlite3/sqlite3: 2.16% (23.7574 => 24.2695, std.dev.: 0.0433) MultiSource/Applications/SPASS/SPASS: 1.73% (17.5484 => 17.8524, std.dev.: 0.0524) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (15.2282 => 15.4602, std.dev.: 0.0347) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0200) MultiSource/Applications/ClamAV/clamscan: 1.01% (17.4082 => 17.5842, std.dev.: 0.0520) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.36% (2.8802 => 3.2362, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.53% (0.3040 => 0.3360, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 4.95% (21.1533 => 22.2014, std.dev.: 0.1710) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0434) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0216) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 00:30:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 02:30:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422073025.E7BDD2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24799?compare_to=24798&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24799, Order: 206839, Start Time: 2014-04-22 02:47:34, End Time: 2014-04-22 07:36:45 To: 24798, Order: 206838, Start Time: 2014-04-22 02:37:23, End Time: 2014-04-22 07:23:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (111 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-18-LoopBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct-bitfield-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C/matrixTranspose: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 28.57% (0.0560 => 0.0720, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.38% (0.1040 => 0.1200, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1440 => 0.1600, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.88% (0.3400 => 0.3600, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.05% (0.7880 => 0.8120, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.26% (0.4560 => 0.4800, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -1.03% (8.1605 => 8.0765, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/ary3: -1.02% (3.5442 => 3.5082, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.19% (1.1481 => 1.2881, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.97% (1.1361 => 1.2721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.82% (1.1841 => 1.3241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.15% (1.2201 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.73% (1.1561 => 1.2801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.07% (1.1921 => 1.3121, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.06% (1.2321 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.2721 => 1.4001, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.69% (1.2801 => 1.4041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.58% (1.2521 => 1.3721, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.6840 => 0.7400, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0197) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0461) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0514) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.28% (0.7640 => 0.8120, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.99% (8.1441 => 8.6321, std.dev.: 0.0271) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0096) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.9640 => 2.0600, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0416) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0234) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (4.9200 => 5.1480, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (10.4082 => 10.8282, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0422) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 3.47% (17.6165 => 18.2285, std.dev.: 0.0398) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (1.4400 => 1.4880, std.dev.: 0.0139) MultiSource/Applications/treecc/treecc: 3.10% (2.4480 => 2.5240, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0142) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.92% (48.1088 => 49.5130, std.dev.: 0.1181) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0403) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0467) MultiSource/Applications/siod/siod: 2.64% (2.5721 => 2.6401, std.dev.: 0.0135) MultiSource/Benchmarks/Bullet/bullet: 2.64% (37.0925 => 38.0726, std.dev.: 0.0646) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0447) MultiSource/Applications/kimwitu++/kc: 2.55% (18.8170 => 19.2971, std.dev.: 0.0457) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.0122 => 4.1123, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 2.04% (23.7574 => 24.2415, std.dev.: 0.0464) MultiSource/Applications/SPASS/SPASS: 1.76% (17.5484 => 17.8564, std.dev.: 0.0425) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.31% (15.2282 => 15.4282, std.dev.: 0.0456) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0197) MultiSource/Applications/lua/lua: 4.88% (21.1533 => 22.1854, std.dev.: 0.1118) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0342) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0247) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0191) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1921 => 2.2241, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0051) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 9.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 00:37:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 02:37:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422073708.E46642A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24800?compare_to=24799&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24800, Order: 206840, Start Time: 2014-04-22 02:57:29, End Time: 2014-04-22 07:43:43 To: 24799, Order: 206839, Start Time: 2014-04-22 02:47:34, End Time: 2014-04-22 07:36:45 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (115 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (975 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 400.00% (0.0040 => 0.0200, std.dev.: 0.0047) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/almabench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Applications/aha/aha: 10.34% (0.1160 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.74% (1.3801 => 1.4041, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.19% (6.0320 => 6.1040, std.dev.: 0.0208) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.33% (0.1200 => 0.1040, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -1.19% (2.3481 => 2.3201, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.50% (0.1600 => 0.1880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 11.43% (1.2601 => 1.4041, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.15% (1.2201 => 1.3561, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.00% (1.2361 => 1.3721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.06% (1.2321 => 1.3561, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.75% (1.2721 => 1.3961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.93% (10.6960 => 11.5440, std.dev.: 0.0468) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0545) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 5.40% (4.5200 => 4.7640, std.dev.: 0.0218) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.39% (1.1880 => 1.2520, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.24% (5.8000 => 6.1040, std.dev.: 0.0208) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0682) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.9200 => 5.1280, std.dev.: 0.0357) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (10.4082 => 10.8362, std.dev.: 0.0299) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0227) MultiSource/Applications/JM/lencod/lencod: 3.43% (17.6165 => 18.2205, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (5.8400 => 6.0400, std.dev.: 0.0455) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 3.05% (0.7880 => 0.8120, std.dev.: 0.0085) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.92% (48.1088 => 49.5130, std.dev.: 0.0851) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (7.8562 => 8.0842, std.dev.: 0.0340) MultiSource/Applications/siod/siod: 2.80% (2.5721 => 2.6441, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0403) MultiSource/Benchmarks/Bullet/bullet: 2.74% (37.0925 => 38.1086, std.dev.: 0.0603) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0141) MultiSource/Applications/kimwitu++/kc: 2.34% (18.8170 => 19.2571, std.dev.: 0.0558) MultiSource/Applications/sqlite3/sqlite3: 2.16% (23.7574 => 24.2695, std.dev.: 0.0603) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0167) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0398) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (5.7564 => 5.8204, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (15.2282 => 15.3842, std.dev.: 0.0471) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0196) MultiSource/Applications/lua/lua: 4.73% (21.1533 => 22.1534, std.dev.: 0.1563) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0136) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/SmallPT/smallpt: 1.26% (14.0009 => 14.1769, std.dev.: 0.0672) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 01:38:59 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 01:38:59 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422083926.56C9B4FCDAF1@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19131 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206869 Blamelist: lhames BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 01:52:17 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 01:52:17 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422085232.671514FCDCEA@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19132 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206870 Blamelist: chapuni Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 03:44:25 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 03:44:25 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422104437.28B064FCEC48@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19136 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206877 Blamelist: _svnsync,tnorthover Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 22 04:28:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 06:28:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422112812.10FD52A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24801?compare_to=24800&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24801, Order: 206867, Start Time: 2014-04-22 06:55:14, End Time: 2014-04-22 11:34:44 To: 24800, Order: 206840, Start Time: 2014-04-22 02:57:29, End Time: 2014-04-22 07:43:43 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (108 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0560 => 0.0720, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.29% (0.0840 => 0.0960, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.47% (0.2360 => 0.2560, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.98% (0.1720 => 0.1840, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.53% (0.9800 => 1.0440, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (1.7400 => 1.7680, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.38% (2.3201 => 2.3521, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.00% (0.1600 => 0.1840, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.16% (0.3040 => 0.3440, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.92% (1.2081 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.82% (1.1841 => 1.3241, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.51% (1.2161 => 1.3561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.97% (1.2401 => 1.3761, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.84% (1.1441 => 1.2681, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.23% (1.2121 => 1.3361, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0568) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.05% (0.6240 => 0.6680, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0531) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: 5.67% (0.9880 => 1.0440, std.dev.: 0.0206) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0535) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (5.8000 => 6.0760, std.dev.: 0.0391) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0360) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (4.9200 => 5.1240, std.dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.1201 => 2.2041, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0179) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0197) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0496) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0290) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0494) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0244) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.86% (48.1088 => 49.4850, std.dev.: 0.0629) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0144) MultiSource/Applications/siod/siod: 2.64% (2.5721 => 2.6401, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.0122 => 4.1123, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 2.42% (18.8170 => 19.2731, std.dev.: 0.0480) MultiSource/Benchmarks/Bullet/bullet: 2.39% (37.0925 => 37.9806, std.dev.: 0.0783) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.2480 => 1.2760, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0495) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.39% (15.2282 => 15.4402, std.dev.: 0.0494) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (5.7564 => 5.8364, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 4.90% (21.1533 => 22.1894, std.dev.: 0.0816) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0300) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0315) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0182) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0186) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 04:31:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 06:31:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422113154.49F082A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24802?compare_to=24782&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24802, Order: 206867, Start Time: 2014-04-22 06:55:14, End Time: 2014-04-22 11:38:32 To: 24782, Order: 206782, Start Time: 2014-04-21 21:03:30, End Time: 2014-04-22 01:46:07 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 22 (160 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (926 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 29.41% (0.0680 => 0.0880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.32% (0.6360 => 0.7080, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/objinst: 10.53% (0.2280 => 0.2520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.34% (0.1160 => 0.1280, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.47% (0.8040 => 0.8560, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.25% (0.1920 => 0.2040, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.55% (0.7920 => 0.8280, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.17% (0.3840 => 0.4000, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 4.13% (0.4840 => 0.5040, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.86% (1.7201 => 1.7521, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.81% (0.6640 => 0.6760, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.78% (6.7240 => 6.8440, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.27% (1.8841 => 1.9081, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.02% (1.5641 => 1.5801, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0103) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0106) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0084) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0055) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0045) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.92% (0.2920 => 0.3560, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.19% (0.6200 => 0.7080, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 13.89% (0.1440 => 0.1640, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.36% (1.4241 => 1.6001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.31% (1.5601 => 1.7521, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.32% (1.4841 => 1.6521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.23% (1.4601 => 1.6241, std.dev.: 0.0109) MultiSource/Applications/obsequi/Obsequi: 11.13% (1.8680 => 2.0760, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.87% (0.1840 => 0.2040, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.43% (0.4600 => 0.5080, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.17% (1.6121 => 1.7761, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.91% (1.7361 => 1.9081, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.77% (1.0240 => 1.1240, std.dev.: 0.0282) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.62% (1.1640 => 1.2760, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.43% (1.6121 => 1.7641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.01% (1.4201 => 1.5481, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0150) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.43% (0.3320 => 0.3600, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.36% (1.4841 => 1.6081, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.27% (1.6921 => 1.8321, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.24% (1.1160 => 1.2080, std.dev.: 0.0240) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0148) MultiSource/Applications/spiff/spiff: 7.94% (1.0080 => 1.0880, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.91% (1.4161 => 1.5281, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.81% (0.7680 => 0.8280, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.63% (1.4681 => 1.5801, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.54% (0.7960 => 0.8560, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.43% (0.7000 => 0.7520, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.42% (6.4680 => 6.9480, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.90% (1.7401 => 1.8601, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 6.63% (1.5080 => 1.6080, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.63% (11.6440 => 12.4160, std.dev.: 0.0579) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.8440 => 1.9640, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.12% (9.4842 => 10.0642, std.dev.: 0.0366) MultiSource/Applications/hexxagon/hexxagon: 6.03% (1.1280 => 1.1960, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (5.8121 => 6.1241, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (6.5080 => 6.8440, std.dev.: 0.0335) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (1.7921 => 1.8801, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.5600 => 1.6360, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.64% (2.3281 => 2.4362, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (5.3600 => 5.6080, std.dev.: 0.0342) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 4.48% (21.9606 => 22.9448, std.dev.: 0.0709) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.46% (6.5440 => 6.8360, std.dev.: 0.0524) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (10.0443 => 10.4883, std.dev.: 0.0407) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.23% (3.0282 => 3.1562, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0276) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.01% (50.0290 => 52.0370, std.dev.: 0.1292) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0093) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.77% (2.1240 => 2.2040, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 3.71% (18.4404 => 19.1246, std.dev.: 0.0359) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0147) MultiSource/Applications/lua/lua: 3.51% (4.7880 => 4.9560, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0199) MultiSource/Applications/hbd/hbd: 3.46% (1.7360 => 1.7960, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.44% (4.1843 => 4.3283, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 3.37% (38.4046 => 39.7006, std.dev.: 0.0557) MultiSource/Applications/siod/siod: 3.24% (2.7162 => 2.8042, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (16.3483 => 16.8483, std.dev.: 0.0319) MultiSource/Applications/kimwitu++/kc: 2.99% (19.6891 => 20.2771, std.dev.: 0.0628) MultiSource/Applications/d/make_dparser: 2.92% (3.9681 => 4.0841, std.dev.: 0.0255) MultiSource/Applications/ClamAV/clamscan: 2.71% (19.0444 => 19.5603, std.dev.: 0.0780) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (6.1044 => 6.1804, std.dev.: 0.0247) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (13.0563 => 13.2163, std.dev.: 0.0260) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0366) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0065) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.04% (6.6684 => 6.8044, std.dev.: 0.0400) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.5087 => 11.7207, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.81% (3.9922 => 4.0643, std.dev.: 0.0226) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 1.49% (21.7374 => 22.0614, std.dev.: 0.1056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0137) MultiSource/Applications/JM/lencod/lencod: 1.18% (8.1245 => 8.2205, std.dev.: 0.0210) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.84% (10.6247 => 2.0361, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.16% (2.9442 => 0.9080, std.dev.: 0.0213) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.40% (91.8497 => 49.2351, std.dev.: 10.3261) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.57% (26.0616 => 17.0531, std.dev.: 0.1455) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.04% (50.3031 => 33.1781, std.dev.: 0.0864) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.87% (42.1466 => 28.2938, std.dev.: 0.4869) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1107) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0236) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0147) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.45% (4.1243 => 4.0643, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 04:44:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 06:44:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140422114439.857342A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24803?compare_to=24793&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24803, Order: 206867, Start Time: 2014-04-22 07:04:26, End Time: 2014-04-22 11:51:19 To: 24793, Order: 206834, Start Time: 2014-04-22 02:09:14, End Time: 2014-04-22 06:56:52 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 10 (141 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-09-18-BitFieldTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 30.77% (0.0520 => 0.0680, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.8400 => 0.8640, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (2.3761 => 2.4122, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.17% (2.0521 => 2.0761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.10% (2.1801 => 2.2041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.09% (2.2041 => 2.2281, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.50% (17.6723 => 19.7043, std.dev.: 0.0525) MultiSource/Applications/sqlite3/sqlite3: 1419.06% (1.7001 => 25.8256, std.dev.: 0.0574) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.07% (50.1010 => 52.1410, std.dev.: 0.0967) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (1.0520 => 1.0840, std.dev.: 0.0400) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.09% (11.3920 => 12.4280, std.dev.: 0.0673) SingleSource/Benchmarks/Misc/oourafft: -73.16% (11.3407 => 3.0442, std.dev.: 0.0099) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0203, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3521, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0113) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0070) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0062) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 45.45% (0.0440 => 0.0640, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.59% (1.8081 => 2.1081, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 16.26% (1.8201 => 2.1161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.97% (1.8281 => 2.1201, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.91% (1.8601 => 2.1561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 15.80% (1.9241 => 2.2281, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.73% (2.1361 => 2.4722, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.71% (1.9601 => 2.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.66% (1.9161 => 2.2161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.47% (1.8361 => 2.1201, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.38% (2.0281 => 2.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 15.27% (1.9121 => 2.2041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.14% (1.8761 => 2.1601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.01% (1.8921 => 2.1761, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.21% (2.1121 => 2.4122, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 13.05% (1.8081 => 2.0441, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.69% (1.7961 => 2.0241, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.58% (1.8441 => 2.0761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.55% (1.9761 => 2.2241, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.41% (1.7721 => 1.9921, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.29% (1.9201 => 2.1561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.20% (1.8361 => 2.0601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.00% (1.9001 => 2.1281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.89% (2.0521 => 2.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.80% (2.0681 => 2.3121, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.61% (1.8601 => 2.0761, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.60% (2.1041 => 2.3481, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0051) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.43% (0.6360 => 0.6960, std.dev.: 0.0232) MultiSource/Applications/obsequi/Obsequi: 9.38% (1.8760 => 2.0520, std.dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.46% (1.0880 => 1.1800, std.dev.: 0.0312) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.21% (0.7080 => 0.7520, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (6.4800 => 6.8680, std.dev.: 0.0465) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.93% (2.9721 => 3.1482, std.dev.: 0.0185) MultiSource/Benchmarks/nbench/nbench: 5.64% (1.7721 => 1.8721, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 5.50% (1.5280 => 1.6120, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.49% (5.8281 => 6.1481, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0234) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (9.6042 => 10.1002, std.dev.: 0.0344) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.14% (6.5320 => 6.8680, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0251) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.2283 => 10.6884, std.dev.: 0.0344) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.49% (0.9801 => 1.0241, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0156) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.8280 => 0.8640, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.28% (2.3401 => 2.4402, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.22% (6.5360 => 6.8120, std.dev.: 0.0400) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (5.3960 => 5.6200, std.dev.: 0.0407) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0070) MultiSource/Applications/treecc/treecc: 3.86% (2.5880 => 2.6880, std.dev.: 0.0266) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.77% (2.1240 => 2.2040, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (16.3003 => 16.8563, std.dev.: 0.0335) MultiSource/Applications/SPASS/SPASS: 3.22% (18.5284 => 19.1246, std.dev.: 0.0479) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.08% (1.3000 => 1.3400, std.dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 3.06% (22.2206 => 22.9007, std.dev.: 0.0545) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (3.0562 => 3.1482, std.dev.: 0.0154) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0092) MultiSource/Applications/d/make_dparser: 2.82% (3.9761 => 4.0881, std.dev.: 0.0268) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.5040 => 1.5440, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 2.64% (19.8291 => 20.3531, std.dev.: 0.0450) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2243 => 4.3283, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 2.44% (38.6366 => 39.5806, std.dev.: 0.1001) MultiSource/Applications/lemon/lemon: 1.88% (1.4881 => 1.5161, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 1.87% (2.7842 => 2.8362, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (13.0363 => 13.2163, std.dev.: 0.0282) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.72% (2.1201 => 2.4322, std.dev.: 0.0403) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.46% (6.5964 => 6.8244, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.03% (5.0243 => 5.1763, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.91% (3.7122 => 3.8202, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.4967 => 11.7087, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (4.0003 => 4.0643, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.58% (4.8043 => 4.8803, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.08% (9.2446 => 9.3446, std.dev.: 0.0298) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0121) SingleSource/UnitTests/2002-05-02-CastTest: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.12% (94.8339 => 49.1991, std.dev.: 10.6356) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.88% (49.9431 => 33.0221, std.dev.: 0.1710) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.48% (25.7136 => 17.1051, std.dev.: 0.0994) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.92% (3.0722 => 2.3681, std.dev.: 0.1103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.65% (37.0863 => 28.6858, std.dev.: 0.6643) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3521 => 2.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 04:48:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 06:48:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422114848.E2BCC2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24804?compare_to=24794&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24804, Order: 206867, Start Time: 2014-04-22 07:08:02, End Time: 2014-04-22 11:55:27 To: 24794, Order: 206834, Start Time: 2014-04-22 02:12:26, End Time: 2014-04-22 07:00:23 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2008-04-20-LoopBug2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.67% (0.0600 => 0.0760, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: 18.18% (0.0880 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: 11.54% (0.1040 => 0.1160, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 7.89% (0.1520 => 0.1640, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.3520 => 0.3760, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.76% (0.2520 => 0.2640, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.55% (0.7920 => 0.8280, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 20.00% (0.0600 => 0.0720, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.48% (0.9481 => 1.0001, std.dev.: 0.0149) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 04:53:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 06:53:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140422115358.83BFE2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24805?compare_to=24795&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24805, Order: 206867, Start Time: 2014-04-22 07:10:59, End Time: 2014-04-22 12:00:36 To: 24795, Order: 206834, Start Time: 2014-04-22 02:13:25, End Time: 2014-04-22 07:03:26 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (137 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.57% (0.1400 => 0.1520, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.4520 => 0.4880, std.dev.: 0.0107) SingleSource/Regression/C/bigstack: 7.14% (0.1680 => 0.1800, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 6.56% (0.2440 => 0.2600, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.54% (2.0801 => 2.1121, std.dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 1.25% (1.9161 => 1.9401, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 1.18% (1.3561 => 1.3721, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.16% (2.0681 => 2.0921, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.60% (1.0001 => 1.0361, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0065) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/UnitTests/Threads/2010-12-08-tls: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 38.30% (0.1880 => 0.2600, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 23.11% (1.6961 => 2.0881, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.82% (1.6681 => 2.0321, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.71% (1.7321 => 2.1081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.63% (1.7201 => 2.0921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.58% (1.7241 => 2.0961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.55% (1.8001 => 2.1881, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.46% (1.6961 => 2.0601, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.43% (1.7921 => 2.1761, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.38% (1.7401 => 2.1121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.29% (1.6721 => 2.0281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.16% (1.7201 => 2.0841, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.04% (1.6921 => 2.0481, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.88% (1.7241 => 2.0841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.61% (1.9801 => 2.3881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.57% (1.8281 => 2.2041, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.40% (1.8041 => 2.1721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.22% (1.8201 => 2.1881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.92% (1.9881 => 2.3841, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.82% (1.8361 => 2.2001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.74% (1.9641 => 2.3321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.58% (1.9801 => 2.3481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0263) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.87% (0.9920 => 1.0800, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0169) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.16% (11.7880 => 12.6320, std.dev.: 0.0704) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (3.5002 => 3.7362, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (6.7200 => 7.1640, std.dev.: 0.0494) MultiSource/Benchmarks/nbench/nbench: 6.59% (1.8201 => 1.9401, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.4600 => 0.4880, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.07% (1.6481 => 1.7481, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (1.2400 => 1.3080, std.dev.: 0.0203) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/18-imp/imp: 5.26% (0.4560 => 0.4800, std.dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 5.24% (1.1440 => 1.2040, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0271) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.09% (9.9842 => 10.4922, std.dev.: 0.0554) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.99% (1.5240 => 1.6000, std.dev.: 0.0291) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 4.54% (3.9641 => 4.1441, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0243) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.44% (0.3600 => 0.3760, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0193) MultiSource/Applications/minisat/minisat: 4.21% (0.8560 => 0.8920, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (6.8321 => 7.1121, std.dev.: 0.0338) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0147) MultiSource/Applications/treecc/treecc: 3.97% (2.6200 => 2.7240, std.dev.: 0.0200) MultiSource/Applications/SPASS/SPASS: 3.96% (18.4924 => 19.2247, std.dev.: 0.0383) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.3203 => 10.7284, std.dev.: 0.0335) SingleSource/Benchmarks/Misc/oourafft: 3.75% (0.3200 => 0.3320, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0091) MultiSource/Applications/lua/lua: 3.67% (4.7920 => 4.9680, std.dev.: 0.0462) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 3.48% (22.6287 => 23.4168, std.dev.: 0.0321) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.37% (51.1089 => 52.8329, std.dev.: 0.0553) MultiSource/Applications/kimwitu++/kc: 3.06% (19.7371 => 20.3411, std.dev.: 0.0621) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.7320 => 1.7840, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (3.0122 => 3.1002, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (2.2721 => 2.3361, std.dev.: 0.0108) MultiSource/Applications/siod/siod: 2.76% (2.7562 => 2.8322, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (4.2203 => 4.3283, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: 2.56% (38.9366 => 39.9326, std.dev.: 0.0891) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.26% (6.0244 => 6.1604, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.5963 => 16.9523, std.dev.: 0.0637) MultiSource/Applications/ClamAV/clamscan: 2.09% (20.2445 => 20.6685, std.dev.: 0.0626) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (2.7722 => 2.8282, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 1.91% (25.1895 => 25.6696, std.dev.: 0.0256) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (29.4578 => 29.9219, std.dev.: 0.0576) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.93% (1.2681 => 1.4321, std.dev.: 0.0284) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.02% (0.9961 => 1.0361, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 2.11% (21.6534 => 22.1094, std.dev.: 0.1700) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (1.2921 => 1.3121, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.0923 => 4.1523, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (2.5322 => 2.5602, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 1.01% (7.5485 => 7.6245, std.dev.: 0.0198) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0127) SingleSource/UnitTests/Vector/constpool: -81.45% (10.9087 => 2.0241, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0047) SingleSource/Regression/C/PR10189: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0067) MultiSource/Applications/obsequi/Obsequi: -20.55% (2.6481 => 2.1040, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.35% (7.5041 => 6.3520, std.dev.: 0.0360) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.35% (7.4801 => 6.3320, std.dev.: 0.0305) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0050) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: -2.37% (13.5243 => 13.2043, std.dev.: 0.0392) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.61% (21.6534 => 17.8411, std.dev.: 0.0562) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: -2.41% (8.3085 => 8.1085, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 05:00:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 07:00:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140422120032.87BBD2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24806?compare_to=24796&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24806, Order: 206867, Start Time: 2014-04-22 07:17:48, End Time: 2014-04-22 12:07:10 To: 24796, Order: 206834, Start Time: 2014-04-22 02:19:15, End Time: 2014-04-22 07:10:13 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (161 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/test_indvars: 36.36% (0.0440 => 0.0600, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.00% (0.0600 => 0.0720, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 8.43% (0.3320 => 0.3600, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 5.70% (0.6320 => 0.6680, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.2920 => 0.3080, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 1.82% (1.5361 => 1.5641, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 46.15% (0.0520 => 0.0760, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.13% (0.1240 => 0.1440, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.23% (0.9921 => 1.0241, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (1.3001 => 1.3281, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/EH/except: -9.37% (0.2560 => 0.2320, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0083) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0066) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0088) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0210) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0078) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0059) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0072) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0068) SingleSource/Regression/C++/pointer_method2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: 45.40% (1.3920 => 2.0240, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.94% (1.2160 => 1.5801, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0087) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.27% (1.2321 => 1.5681, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.32% (1.2481 => 1.5641, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 23.16% (1.1401 => 1.4041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.63% (1.1841 => 1.4521, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.29% (1.2921 => 1.5801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 22.26% (1.1321 => 1.3841, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.11% (1.1761 => 1.4361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.18% (1.1521 => 1.3961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (1.1441 => 1.3841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.45% (1.2321 => 1.4841, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.13% (1.2521 => 1.5041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.86% (1.1881 => 1.4241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.33% (1.2001 => 1.4321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.25% (1.2881 => 1.5361, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: 18.65% (8.5802 => 10.1803, std.dev.: 0.0491) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0105) MultiSource/Applications/sgefa/sgefa: 16.07% (0.4480 => 0.5200, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 15.70% (19.5406 => 22.6087, std.dev.: 0.0616) MultiSource/Benchmarks/nbench/nbench: 15.68% (1.3521 => 1.5641, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.44% (5.3360 => 6.1601, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0246) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0098) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: 9.52% (11.3843 => 12.4683, std.dev.: 0.0186) MultiSource/Benchmarks/McCat/05-eks/eks: 9.15% (0.6120 => 0.6680, std.dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 8.66% (6.2844 => 6.8284, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (5.6680 => 6.1440, std.dev.: 0.0603) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.38% (0.7640 => 0.8280, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2440 => 0.2640, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.7280 => 6.1960, std.dev.: 0.0584) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.79% (11.4440 => 12.3360, std.dev.: 0.0863) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0141) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.10% (9.5802 => 10.2602, std.dev.: 0.0549) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.7360 => 0.7840, std.dev.: 0.0121) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0261) MultiSource/Applications/spiff/spiff: 5.34% (1.0480 => 1.1040, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.86% (6.8280 => 7.1600, std.dev.: 0.0314) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (0.4960 => 0.5200, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 4.78% (4.7720 => 5.0000, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 4.01% (5.3840 => 5.6000, std.dev.: 0.0502) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0147) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.47% (49.1529 => 50.8569, std.dev.: 0.1228) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (1.7600 => 1.8200, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0147) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 2.91% (19.2243 => 19.7844, std.dev.: 0.0567) MultiSource/Applications/sqlite3/sqlite3: 2.86% (24.7575 => 25.4655, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (1.7320 => 1.7800, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (2.7282 => 2.8002, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 2.41% (19.7491 => 20.2251, std.dev.: 0.0335) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.93% (6.0124 => 6.1284, std.dev.: 0.0171) MultiSource/Benchmarks/Bullet/bullet: 1.55% (39.0726 => 39.6766, std.dev.: 0.1037) MultiSource/Applications/d/make_dparser: 1.17% (4.1081 => 4.1561, std.dev.: 0.0157) MultiSource/Applications/SPASS/SPASS: 1.15% (18.7966 => 19.0126, std.dev.: 0.0609) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (16.7083 => 16.8963, std.dev.: 0.0431) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (29.3298 => 29.6379, std.dev.: 0.0639) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.83% (3.9842 => 4.2963, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.49% (1.3121 => 1.3841, std.dev.: 0.0277) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0119) MultiSource/Applications/minisat/minisat: 3.93% (6.8204 => 7.0884, std.dev.: 0.0366) SingleSource/Benchmarks/McGill/queens: 3.67% (2.1801 => 2.2601, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.64% (0.9881 => 1.0241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (5.0963 => 5.2323, std.dev.: 0.0446) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.07% (4.0563 => 4.1403, std.dev.: 0.0321) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.85% (5.4123 => 5.5123, std.dev.: 0.0355) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (25.4536 => 25.8656, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.11% (3.2362 => 3.2722, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.56% (11.0207 => 2.0321, std.dev.: 0.0326) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -19.12% (8.9566 => 7.2445, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.51% (21.6534 => 17.8611, std.dev.: 0.0508) SingleSource/Benchmarks/Linpack/linpack-pc: -15.98% (7.8605 => 6.6044, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0804) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 05:16:53 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 05:16:53 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422121706.BFFF54FCFA31@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19141 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206884 Blamelist: rkhasanov BUILD FAILED: exception interrupted sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 05:40:34 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 05:40:34 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422124048.F18754FCFD53@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19142 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206885 Blamelist: lhames Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 22 05:41:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 07:41:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422124120.D63F52A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24807?compare_to=24801&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24807, Order: 206869, Start Time: 2014-04-22 08:01:35, End Time: 2014-04-22 12:47:58 To: 24801, Order: 206867, Start Time: 2014-04-22 06:55:14, End Time: 2014-04-22 11:34:44 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (117 on baseline) Performance Improvements: 2 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (971 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 36.36% (0.0440 => 0.0600, std.dev.: 0.0041) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 10.53% (0.2280 => 0.2520, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.26% (0.2280 => 0.2400, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 4.00% (0.7000 => 0.7280, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.10% (0.5160 => 0.5320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.7200 => 0.7360, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.6361 => 1.6681, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.89% (1.2681 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.53% (1.3041 => 1.3241, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.16% (1.3761 => 1.3921, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.16% (1.3841 => 1.4001, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -33.33% (0.0360 => 0.0240, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.47% (1.3561 => 1.3361, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0067) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0166) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.41% (1.1601 => 1.3041, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.97% (1.1361 => 1.2721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.90% (1.1761 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.54% (0.6240 => 0.6960, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.73% (1.1561 => 1.2801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.69% (1.2721 => 1.4081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.48% (1.2601 => 1.3921, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.40% (1.1921 => 1.3161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.06% (1.2321 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.2721 => 1.4001, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.69% (1.2801 => 1.4041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.77% (1.3681 => 1.4881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0139) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0403) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0592) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.14% (0.2240 => 0.2400, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0160) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.60% (8.1441 => 8.6001, std.dev.: 0.0342) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.26% (0.9880 => 1.0400, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (5.8000 => 6.0920, std.dev.: 0.0249) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (1.3760 => 1.4440, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.9640 => 2.0600, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2600 => 0.2720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0347) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (10.4082 => 10.8122, std.dev.: 0.0298) MultiSource/Applications/JM/lencod/lencod: 3.54% (17.6165 => 18.2405, std.dev.: 0.0535) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.8322 => 2.9242, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0401) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (7.8562 => 8.0922, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0314) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.87% (48.1088 => 49.4890, std.dev.: 0.0950) MultiSource/Applications/kimwitu++/kc: 2.49% (18.8170 => 19.2851, std.dev.: 0.0700) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0172) MultiSource/Benchmarks/Bullet/bullet: 2.26% (37.0925 => 37.9326, std.dev.: 0.0722) MultiSource/Applications/SIBsim4/SIBsim4: 2.21% (1.6321 => 1.6681, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 2.01% (17.5484 => 17.9004, std.dev.: 0.0347) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0434) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (15.2282 => 15.4322, std.dev.: 0.0399) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (5.7564 => 5.8244, std.dev.: 0.0198) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.12% (28.1538 => 28.4698, std.dev.: 0.0291) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0181) MultiSource/Applications/lua/lua: 4.92% (21.1533 => 22.1934, std.dev.: 0.1081) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.81% (3.9962 => 4.1883, std.dev.: 0.0657) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (25.8896 => 26.7817, std.dev.: 0.0290) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0148) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0068) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0120) SingleSource/UnitTests/SignlessTypes/ccc: -57.14% (0.0280 => 0.0120, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -33.33% (0.0360 => 0.0240, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.13% (4.2403 => 4.1923, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0100) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 06:14:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 08:14:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422131427.3AC1E2A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24808?compare_to=24807&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24808, Order: 206870, Start Time: 2014-04-22 08:35:14, End Time: 2014-04-22 13:21:05 To: 24807, Order: 206869, Start Time: 2014-04-22 08:01:35, End Time: 2014-04-22 12:47:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (115 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (976 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct_pack_layout: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.05% (0.0840 => 0.1000, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 6.38% (0.1880 => 0.2000, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.24% (1.2521 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.19% (1.4600 => 1.4920, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 16.67% (0.1200 => 0.1400, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -13.37% (1.4361 => 1.2441, std.dev.: 0.0742) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.78% (4.1883 => 3.9882, std.dev.: 0.0584) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.52% (1.1241 => 1.2761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.50% (1.1481 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.41% (1.1921 => 1.3281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.07% (1.1561 => 1.2841, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.04% (1.1961 => 1.3281, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.96% (1.1681 => 1.2961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.75% (1.2281 => 1.3601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.39% (1.2321 => 1.3601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.07% (1.1921 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.69% (1.2801 => 1.4041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.26% (1.2521 => 1.3681, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.77% (1.3681 => 1.4881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (10.6960 => 11.4920, std.dev.: 0.0543) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.81% (0.7640 => 0.8160, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0193) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0638) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.48% (5.8000 => 6.0600, std.dev.: 0.0439) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0357) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.1201 => 2.2041, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0359) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.61% (1.4400 => 1.4920, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: 3.27% (17.6165 => 18.1925, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0415) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (7.8562 => 8.0962, std.dev.: 0.0399) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.80% (48.1088 => 49.4570, std.dev.: 0.0969) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0431) MultiSource/Benchmarks/Bullet/bullet: 2.58% (37.0925 => 38.0486, std.dev.: 0.0616) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 2.49% (18.8170 => 19.2851, std.dev.: 0.0391) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.9561 => 0.9761, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.05% (23.7574 => 24.2455, std.dev.: 0.0385) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: 1.50% (17.5484 => 17.8124, std.dev.: 0.0521) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (15.2282 => 15.4322, std.dev.: 0.0390) MultiSource/Applications/ClamAV/clamscan: 1.17% (17.4082 => 17.6122, std.dev.: 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (28.1538 => 28.4738, std.dev.: 0.0388) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0243) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 4.92% (21.1533 => 22.1934, std.dev.: 0.0750) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0730) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0306) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 06:36:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 08:36:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422133644.284502A6C025@llvm.org> http://llvm.org/perf/db_default/v4/nts/24809?compare_to=24808&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24809, Order: 206871, Start Time: 2014-04-22 08:59:00, End Time: 2014-04-22 13:43:22 To: 24808, Order: 206870, Start Time: 2014-04-22 08:35:14, End Time: 2014-04-22 13:21:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (109 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-06-08-VirtualFunctions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2003-08-20-FoldBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0960 => 0.1080, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 10.53% (0.1520 => 0.1680, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (2.0040 => 2.0600, std.dev.: 0.0207) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (2.3241 => 2.3481, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.37% (0.1960 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.32% (1.1361 => 1.2761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.82% (1.1841 => 1.3241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.50% (1.1481 => 1.2801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.50% (1.1481 => 1.2801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.18% (1.2161 => 1.3521, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.04% (1.1961 => 1.3281, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.96% (1.1681 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.84% (1.1441 => 1.2681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.69% (1.2801 => 1.4041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.98% (0.6520 => 0.7040, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67% (10.6960 => 11.5160, std.dev.: 0.0414) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (6.0160 => 6.4600, std.dev.: 0.0382) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.14% (0.2800 => 0.3000, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.05% (0.6240 => 0.6680, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0185) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (8.1441 => 8.6121, std.dev.: 0.0377) MultiSource/Applications/spiff/spiff: 5.67% (0.9880 => 1.0440, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.9640 => 2.0600, std.dev.: 0.0207) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (10.4082 => 10.8442, std.dev.: 0.0321) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (4.9200 => 5.1240, std.dev.: 0.0443) MultiSource/Applications/JM/lencod/lencod: 3.50% (17.6165 => 18.2325, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0398) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0691) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (7.8562 => 8.1042, std.dev.: 0.0344) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.8322 => 2.9162, std.dev.: 0.0102) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.87% (48.1088 => 49.4889, std.dev.: 0.0875) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.69% (4.0122 => 4.1203, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 2.53% (37.0925 => 38.0326, std.dev.: 0.0589) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0309) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 2.47% (18.8170 => 19.2811, std.dev.: 0.0422) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.99% (23.7574 => 24.2295, std.dev.: 0.0447) MultiSource/Applications/SPASS/SPASS: 1.85% (17.5484 => 17.8724, std.dev.: 0.0489) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.21% (15.2282 => 15.4122, std.dev.: 0.0522) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0244) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (28.1538 => 28.4418, std.dev.: 0.0685) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0205) MultiSource/Applications/lua/lua: 4.86% (21.1533 => 22.1814, std.dev.: 0.1140) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0373) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0165) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0300) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.5522 => 3.5122, std.dev.: 0.0144) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 07:02:37 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 07:02:37 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422140306.7D6BB4FD09E1@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19145 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206891 Blamelist: amusman BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 07:17:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 07:17:35 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422141751.DBED24FD0C2D@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19146 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206895 Blamelist: emaste Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 07:54:01 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 07:54:01 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422145423.B264B4FD1174@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19148 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206897 Blamelist: chapuni,delena BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 08:00:15 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 08:00:15 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-RA Message-ID: <20140422150103.D22C84FD12A8@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-RA/builds/6800 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206883 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/eprintf/libcompiler_rt.a] Error 1 make[5]: *** Waiting for unfinished jobs.... lipo: no input files specified lipo: Usage: lipo [input_file] ... [-arch input_file] ... [-info] [-detailed_info] [-output output_file] [-create] [-arch_blank ] [-thin ] [-remove ] ... [-extract ] ... [-extract_family ] ... [-verify_arch ...] [-replace ] ... make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/10.4/libcompiler_rt.a] Error 1 ASSEMBLE: clang_darwin/ios/armv7: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib/builtins/arm/divmodsi4.S COMPILE: clang_darwin/ios/armv7: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib/builtins/int_util.c /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/clang -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/include -arch armv7 -fvisibility=hidden -DVISIBILITY_HIDDEN -Wall -Werror -O3 -fomit-frame-pointer -mios-version-min=1.0 -isysroot /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/SDKs/darwin -c -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/ios/armv7/SubDir.lib__builtins__arm/divmodsi4.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib/builtins/arm/divmodsi4.S /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/clang -fPIC -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/include -arch armv7 -fvisibility=hidden -DVISIBILITY_HIDDEN -Wall -Werror -O3 -fomit-frame-pointer -mios-version-min=1.0 -isysroot /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/SDKs/darwin -c -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/ios/armv7/SubDir.lib__builtins/int_util.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib/builtins/int_util.c make[4]: *** [BuildRuntimeLibraries] Error 2 rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/lib/clang/3.5.0/lib/darwin/.dir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/lib/clang/3.5.0/lib/macho_embedded/.dir make[3]: *** [compiler-rt/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 08:00:14 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 08:00:14 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-RA Message-ID: <20140422150103.D37034FD12A9@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-RA/builds/6800 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206883 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/eprintf/libcompiler_rt.a] Error 1 make[5]: *** Waiting for unfinished jobs.... lipo: no input files specified lipo: Usage: lipo [input_file] ... [-arch input_file] ... [-info] [-detailed_info] [-output output_file] [-create] [-arch_blank ] [-thin ] [-remove ] ... [-extract ] ... [-extract_family ] ... [-verify_arch ...] [-replace ] ... make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/10.4/libcompiler_rt.a] Error 1 ASSEMBLE: clang_darwin/ios/armv7: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib/builtins/arm/divmodsi4.S COMPILE: clang_darwin/ios/armv7: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib/builtins/int_util.c /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/clang -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/include -arch armv7 -fvisibility=hidden -DVISIBILITY_HIDDEN -Wall -Werror -O3 -fomit-frame-pointer -mios-version-min=1.0 -isysroot /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/SDKs/darwin -c -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/ios/armv7/SubDir.lib__builtins__arm/divmodsi4.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib/builtins/arm/divmodsi4.S /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/clang -fPIC -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/include -arch armv7 -fvisibility=hidden -DVISIBILITY_HIDDEN -Wall -Werror -O3 -fomit-frame-pointer -mios-version-min=1.0 -isysroot /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/SDKs/darwin -c -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/ios/armv7/SubDir.lib__builtins/int_util.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/projects/compiler-rt/lib/builtins/int_util.c make[4]: *** [BuildRuntimeLibraries] Error 2 rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/lib/clang/3.5.0/lib/darwin/.dir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/lib/clang/3.5.0/lib/macho_embedded/.dir make[3]: *** [compiler-rt/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Tue Apr 22 08:01:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 10:01:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422150138.E43EF2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24810?compare_to=24809&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24810, Order: 206873, Start Time: 2014-04-22 10:26:22, End Time: 2014-04-22 15:08:17 To: 24809, Order: 206871, Start Time: 2014-04-22 08:59:00, End Time: 2014-04-22 13:43:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (104 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.41% (0.0680 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 8.93% (0.2240 => 0.2440, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.15% (0.3880 => 0.4080, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.87% (5.9840 => 6.0960, std.dev.: 0.0226) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.2161 => 1.3481, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.05% (6.0160 => 6.5000, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0738) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9200 => 0.9720, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (1.7360 => 1.8280, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.7040 => 0.7400, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (5.8000 => 6.0960, std.dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0429) MultiSource/Benchmarks/MallocBench/gs/gs: 4.55% (4.9200 => 5.1440, std.dev.: 0.0290) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0343) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0335) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: 3.55% (0.7880 => 0.8160, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (5.8400 => 6.0440, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0208) MultiSource/Applications/JM/ldecod/ldecod: 3.26% (7.8562 => 8.1122, std.dev.: 0.0342) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.99% (4.0122 => 4.1323, std.dev.: 0.0102) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.88% (48.1088 => 49.4929, std.dev.: 0.0734) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0330) MultiSource/Applications/siod/siod: 2.64% (2.5721 => 2.6401, std.dev.: 0.0152) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 2.49% (37.0925 => 38.0165, std.dev.: 0.0919) MultiSource/Applications/kimwitu++/kc: 2.49% (18.8170 => 19.2851, std.dev.: 0.0438) MultiSource/Applications/SPASS/SPASS: 1.85% (17.5484 => 17.8724, std.dev.: 0.0525) MultiSource/Applications/sqlite3/sqlite3: 1.77% (23.7574 => 24.1775, std.dev.: 0.0521) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (15.2282 => 15.4482, std.dev.: 0.0275) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.32% (5.7564 => 5.8324, std.dev.: 0.0290) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (28.1538 => 28.4738, std.dev.: 0.0655) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0187) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 4.77% (21.1533 => 22.1614, std.dev.: 0.1179) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0155) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0318) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 08:42:43 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 08:42:43 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422154257.C76EA4FD1807@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19150 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206899 Blamelist: delesley Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 08:53:48 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 08:53:48 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140422155416.7AA374FD192B@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6806 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206883 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': echo 'Created.' > /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/asan_osx_dynamic/.dir echo 'Created.' > /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/ubsan_osx/.dir lipo: lipo: no input files specifiedno input files specified lipo: Usage: lipo [input_file] ... [-arch input_file] ... [-info] [-detailed_info] [-output output_file] [-create] [-arch_blank ] [-thin ] [-remove ] ... [-extract ] ... [-extract_family ] ... [-verify_arch ...] [-replace ] ... lipo: Usage: lipo [input_file] ... [-arch input_file] ... [-info] [-detailed_info] [-output output_file] [-create] [-arch_blank ] [-thin ] [-remove ] ... [-extract ] ... [-extract_family ] ... [-verify_arch ...] [-replace ] ... make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/eprintf/libcompiler_rt.a] Error 1 make[5]: *** Waiting for unfinished jobs.... make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/10.4/libcompiler_rt.a] Error 1 make[4]: *** [BuildRuntimeLibraries] Error 2 rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/lib/clang/3.5.0/lib/darwin/.dir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/lib/clang/3.5.0/lib/macho_embedded/.dir make[3]: *** [compiler-rt/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 08:53:48 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 08:53:48 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140422155416.402454FD192A@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6806 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 206883 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': echo 'Created.' > /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/asan_osx_dynamic/.dir echo 'Created.' > /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/ubsan_osx/.dir lipo: lipo: no input files specifiedno input files specified lipo: Usage: lipo [input_file] ... [-arch input_file] ... [-info] [-detailed_info] [-output output_file] [-create] [-arch_blank ] [-thin ] [-remove ] ... [-extract ] ... [-extract_family ] ... [-verify_arch ...] [-replace ] ... lipo: Usage: lipo [input_file] ... [-arch input_file] ... [-info] [-detailed_info] [-output output_file] [-create] [-arch_blank ] [-thin ] [-remove ] ... [-extract ] ... [-extract_family ] ... [-verify_arch ...] [-replace ] ... make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/eprintf/libcompiler_rt.a] Error 1 make[5]: *** Waiting for unfinished jobs.... make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/10.4/libcompiler_rt.a] Error 1 make[4]: *** [BuildRuntimeLibraries] Error 2 rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/lib/clang/3.5.0/lib/darwin/.dir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/lib/clang/3.5.0/lib/macho_embedded/.dir make[3]: *** [compiler-rt/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Tue Apr 22 09:15:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 11:15:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422161509.F1B262A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24811?compare_to=24810&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24811, Order: 206883, Start Time: 2014-04-22 11:49:02, End Time: 2014-04-22 16:21:48 To: 24810, Order: 206873, Start Time: 2014-04-22 10:26:22, End Time: 2014-04-22 15:08:17 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 7 (7 on baseline) Performance Regressions: 6 (106 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0240 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0480 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (7.2805 => 0.0000, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -98.96% (4.2163 => 0.0440, std.dev.: 0.0053) MultiSource/Applications/lua/lua: -100.00% (22.1614 => 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: -100.00% (2.3241 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/globalrefs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 3.74% (0.4280 => 0.4440, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.17% (0.7360 => 0.7520, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -99.96% (9.5126 => 0.0040, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0200 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0400 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (7.3085 => 0.0000, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -98.95% (4.2043 => 0.0440, std.dev.: 0.0053) MultiSource/Applications/lua/lua: -100.00% (21.1533 => 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: -100.00% (2.3361 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 12.66% (0.3160 => 0.3560, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.97% (1.1361 => 1.2721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.92% (1.2081 => 1.3521, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.57% (0.1400 => 0.1520, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.4120 => 0.4440, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0678) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0461) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 6.07% (0.9880 => 1.0480, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (8.1441 => 8.6081, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 4.96% (4.5200 => 4.7440, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.9200 => 5.1280, std.dev.: 0.0603) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0318) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 3.25% (17.6165 => 18.1885, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0321) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.02% (48.1088 => 49.5609, std.dev.: 0.0722) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.8322 => 2.9162, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 2.95% (2.5721 => 2.6481, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (7.8562 => 8.0842, std.dev.: 0.0336) MultiSource/Applications/kimwitu++/kc: 2.76% (18.8170 => 19.3371, std.dev.: 0.0352) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.69% (4.0122 => 4.1203, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: 2.67% (37.0925 => 38.0846, std.dev.: 0.0457) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.02% (23.7574 => 24.2375, std.dev.: 0.0567) MultiSource/Applications/SPASS/SPASS: 1.94% (17.5484 => 17.8884, std.dev.: 0.0372) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7964 => 5.9084, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (5.7564 => 5.8404, std.dev.: 0.0180) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.31% (15.2282 => 15.4282, std.dev.: 0.0410) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.11% (28.1538 => 28.4658, std.dev.: 0.0486) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (25.8896 => 26.7297, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.17% (0.7360 => 0.7520, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0087) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0120) SingleSource/UnitTests/2002-08-02-CastTest: -75.00% (0.0160 => 0.0040, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -99.96% (9.4686 => 0.0040, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 09:21:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 11:21:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422162157.F12152A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24812?compare_to=24802&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24812, Order: 206883, Start Time: 2014-04-22 11:52:54, End Time: 2014-04-22 16:28:37 To: 24802, Order: 206867, Start Time: 2014-04-22 06:55:14, End Time: 2014-04-22 11:38:32 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Failures: 6 (6 on baseline) New Passes: 0 (2 on baseline) Performance Regressions: 16 (153 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (923 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0240 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0480 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.2205 => 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -98.95% (4.1963 => 0.0440, std.dev.: 0.0052) MultiSource/Applications/lua/lua: -100.00% (22.0614 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-18-LoopBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.43% (0.1120 => 0.1360, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.2960 => 0.3120, std.dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 5.08% (0.2360 => 0.2480, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.7200 => 0.7480, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.26% (1.5960 => 1.6480, std.dev.: 0.0161) MultiSource/Applications/minisat/minisat: 2.30% (0.8680 => 0.8880, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 12.00% (0.1000 => 0.1120, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 3.69% (0.9761 => 1.0121, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (0.6000 => 0.6200, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (1.1521 => 1.1641, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4886 => 0.0000, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0160 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0400 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1245 => 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -98.96% (4.2123 => 0.0440, std.dev.: 0.0052) MultiSource/Applications/lua/lua: -100.00% (21.7374 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0126) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0127) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0104) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0036) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0035) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0076) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0116) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.22% (1.4401 => 1.6161, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.80% (1.4241 => 1.5921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.54% (1.5601 => 1.7401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.14% (1.6521 => 1.8361, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.05% (1.4841 => 1.6481, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.76% (1.5241 => 1.6881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.34% (1.5481 => 1.7081, std.dev.: 0.0092) MultiSource/Applications/spiff/spiff: 10.32% (1.0080 => 1.1120, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.92% (1.6121 => 1.7721, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.69% (1.5281 => 1.6761, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.62% (1.1640 => 1.2760, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/bh/bh: 9.09% (0.4840 => 0.5280, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.93% (1.6121 => 1.7561, std.dev.: 0.0068) MultiSource/Applications/obsequi/Obsequi: 8.78% (1.8680 => 2.0320, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.38% (1.4801 => 1.6041, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/objinst: 8.33% (0.2400 => 0.2600, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.29% (1.4481 => 1.5681, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.24% (1.1160 => 1.2080, std.dev.: 0.0245) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.05% (1.5401 => 1.6641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.91% (1.4161 => 1.5281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.89% (1.5201 => 1.6401, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.69% (1.4561 => 1.5681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.56% (1.6921 => 1.8201, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.34% (1.5801 => 1.6961, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.4680 => 6.9280, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.07% (1.5841 => 1.6961, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0135) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.90% (1.7401 => 1.8601, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (11.6440 => 12.4400, std.dev.: 0.0622) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.46% (1.5480 => 1.6480, std.dev.: 0.0161) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0115) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.16% (9.4842 => 10.0682, std.dev.: 0.0468) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.93% (1.4841 => 1.5721, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (5.8121 => 6.1361, std.dev.: 0.0364) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.2960 => 0.3120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.30% (1.6601 => 1.7481, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 5.02% (10.0443 => 10.5483, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/gs/gs: 5.00% (5.3600 => 5.6280, std.dev.: 0.0417) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.73% (6.5080 => 6.8160, std.dev.: 0.0377) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0178) MultiSource/Applications/JM/lencod/lencod: 4.61% (21.9606 => 22.9728, std.dev.: 0.0575) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.58% (6.5440 => 6.8440, std.dev.: 0.0487) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0138) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0112) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.26% (50.0290 => 52.1610, std.dev.: 0.0973) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0066) MultiSource/Applications/lua/lua: 4.01% (4.7880 => 4.9800, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (3.0282 => 3.1482, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: 3.78% (18.4404 => 19.1366, std.dev.: 0.0468) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0235) MultiSource/Applications/siod/siod: 3.68% (2.7162 => 2.8162, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.54% (4.1843 => 4.3323, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 3.48% (38.4046 => 39.7406, std.dev.: 0.0549) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 3.26% (0.8600 => 0.8880, std.dev.: 0.0065) MultiSource/Applications/treecc/treecc: 3.25% (2.5840 => 2.6680, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (16.3483 => 16.8483, std.dev.: 0.0485) MultiSource/Applications/kimwitu++/kc: 3.03% (19.6891 => 20.2851, std.dev.: 0.0562) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0184) MultiSource/Applications/ClamAV/clamscan: 2.92% (19.0444 => 19.6003, std.dev.: 0.0531) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0085) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.57% (6.1044 => 6.2004, std.dev.: 0.0181) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.27% (29.3338 => 29.7059, std.dev.: 0.0633) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0563 => 13.1963, std.dev.: 0.0410) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.90% (2.1401 => 2.4162, std.dev.: 0.0465) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (3.9922 => 4.1123, std.dev.: 0.0216) MultiSource/Applications/minisat/minisat: 2.40% (6.6684 => 6.8284, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0064) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.5087 => 11.7167, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/mandel-2: 1.63% (0.9801 => 0.9961, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 1.50% (2.9322 => 2.9762, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.87% (10.6247 => 2.0321, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.48% (2.9442 => 0.9280, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4566 => 0.0000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.21% (91.8497 => 49.4031, std.dev.: 10.4490) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.60% (50.3031 => 32.8981, std.dev.: 0.1933) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.47% (26.0616 => 17.0771, std.dev.: 0.0745) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.62% (42.1466 => 28.8178, std.dev.: 0.2466) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1104) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0053) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.06% (0.3400 => 0.3160, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.09% (1.2481 => 1.1721, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.02% (5.1563 => 5.0523, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 09:38:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 11:38:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140422163842.B9B612A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24813?compare_to=24803&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24813, Order: 206884, Start Time: 2014-04-22 12:05:52, End Time: 2014-04-22 16:45:22 To: 24803, Order: 206867, Start Time: 2014-04-22 07:04:26, End Time: 2014-04-22 11:51:19 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Failures: 6 (6 on baseline) New Passes: 0 (11 on baseline) Performance Regressions: 11 (144 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0200 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0440 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.2005 => 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -98.96% (4.2243 => 0.0440, std.dev.: 0.0047) MultiSource/Applications/lua/lua: -100.00% (22.0494 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.52% (0.1680 => 0.1840, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.58% (0.2640 => 0.2840, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.65% (0.9040 => 0.9280, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 14.57% (1.2081 => 1.3841, std.dev.: 0.0459) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.12% (0.9361 => 1.0121, std.dev.: 0.0162) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.08% (2.1161 => 2.0721, std.dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.4846 => 0.0000, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0080 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0480 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1285 => 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -98.96% (4.2163 => 0.0440, std.dev.: 0.0047) MultiSource/Applications/lua/lua: -100.00% (21.8014 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.25% (17.6723 => 19.6604, std.dev.: 0.0589) MultiSource/Applications/sqlite3/sqlite3: 1421.89% (1.7001 => 25.8736, std.dev.: 0.0404) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.34% (50.1010 => 52.2770, std.dev.: 0.0894) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.02% (11.3920 => 12.4200, std.dev.: 0.0601) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0139) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0003, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0097) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0140) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0047) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 26.09% (0.0920 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.00% (0.1920 => 0.2400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 18.75% (0.0640 => 0.0760, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.79% (0.3040 => 0.3520, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.69% (1.8361 => 2.1241, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.01% (1.9721 => 2.2681, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.76% (1.9241 => 2.2081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.85% (1.8201 => 2.0721, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.75% (1.9761 => 2.2281, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.64% (2.0681 => 2.2881, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.14% (2.0521 => 2.2601, std.dev.: 0.0154) MultiSource/Applications/aha/aha: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0122) MultiSource/Applications/obsequi/Obsequi: 8.53% (1.8760 => 2.0360, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.4760 => 0.5080, std.dev.: 0.0091) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.60% (6.4800 => 6.9080, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.97% (0.2680 => 0.2840, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.7480 => 1.8520, std.dev.: 0.0227) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 5.24% (1.5280 => 1.6080, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9960 => 1.0480, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.6960 => 1.7840, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (1.6641 => 1.7481, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.02% (6.5320 => 6.8600, std.dev.: 0.0422) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (5.8281 => 6.1001, std.dev.: 0.0251) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.2283 => 10.6964, std.dev.: 0.0281) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.50% (9.6042 => 10.0362, std.dev.: 0.0604) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 4.40% (1.7280 => 1.8040, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0255) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0382) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.53% (3.0562 => 3.1642, std.dev.: 0.0104) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0092) MultiSource/Applications/treecc/treecc: 3.25% (2.5880 => 2.6720, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.24% (6.5360 => 6.7480, std.dev.: 0.0547) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (16.3003 => 16.8083, std.dev.: 0.0576) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (5.3960 => 5.5640, std.dev.: 0.0439) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 2.94% (22.2206 => 22.8728, std.dev.: 0.0606) MultiSource/Applications/SPASS/SPASS: 2.91% (18.5284 => 19.0685, std.dev.: 0.0570) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0310) MultiSource/Benchmarks/Bullet/bullet: 2.84% (38.6366 => 39.7326, std.dev.: 0.0821) MultiSource/Applications/kimwitu++/kc: 2.72% (19.8291 => 20.3691, std.dev.: 0.0416) MultiSource/Applications/d/make_dparser: 2.62% (3.9761 => 4.0801, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2243 => 4.3283, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 2.33% (2.7522 => 2.8162, std.dev.: 0.0163) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7842 => 2.8202, std.dev.: 0.0132) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (13.0363 => 13.1963, std.dev.: 0.0353) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.1484 => 6.2124, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.72% (2.1201 => 2.4322, std.dev.: 0.0669) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0202) MultiSource/Benchmarks/llubenchmark/llu: 6.88% (5.0603 => 5.4083, std.dev.: 0.1274) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 4.22% (1.9921 => 2.0761, std.dev.: 0.0324) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 3.15% (6.5964 => 6.8044, std.dev.: 0.0638) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.91% (3.7122 => 3.8202, std.dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.95% (11.4967 => 11.7207, std.dev.: 0.0185) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.50% (4.0003 => 4.0603, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.50% (4.8043 => 4.8763, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.42% (3.9442 => 4.0003, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.61% (2.9562 => 0.9280, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.96% (94.8339 => 49.3511, std.dev.: 10.3404) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.06% (49.9431 => 32.9341, std.dev.: 0.1847) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.82% (25.7136 => 17.0171, std.dev.: 0.1564) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.69% (37.0863 => 28.6698, std.dev.: 0.3877) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0157) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3521 => 2.3081, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 09:43:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 11:43:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422164309.A1ED82A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24814?compare_to=24804&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24814, Order: 206884, Start Time: 2014-04-22 12:09:50, End Time: 2014-04-22 16:49:50 To: 24804, Order: 206867, Start Time: 2014-04-22 07:08:02, End Time: 2014-04-22 11:55:27 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Failures: 6 (6 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 12 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (984 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0240 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0480 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1245 => 0.0000, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -98.88% (4.2843 => 0.0480, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -100.00% (21.6174 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 400.00% (0.0040 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 133.33% (0.0120 => 0.0280, std.dev.: 0.0028) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.00% (0.1000 => 0.1200, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 8.77% (0.2280 => 0.2480, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.02% (0.3320 => 0.3520, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.95% (0.3360 => 0.3560, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.42% (0.4960 => 0.5080, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 2.05% (4.0881 => 4.1721, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.08% (1.8561 => 1.8761, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.7006 => 0.0000, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0120) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 09:50:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 11:50:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140422165021.09B5F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24815?compare_to=24805&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24815, Order: 206884, Start Time: 2014-04-22 12:14:59, End Time: 2014-04-22 16:57:01 To: 24805, Order: 206867, Start Time: 2014-04-22 07:10:59, End Time: 2014-04-22 12:00:36 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Failures: 6 (6 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 11 (133 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0200 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0480 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1085 => 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -98.97% (4.2803 => 0.0440, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -100.00% (22.1094 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/UnitTests/2003-08-11-VaListArg: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 22.22% (0.0720 => 0.0880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.03% (0.7960 => 0.8440, std.dev.: 0.0184) MultiSource/Applications/sgefa/sgefa: 2.82% (0.5680 => 0.5840, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.7046 => 0.0000, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0160 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0440 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.3085 => 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -98.96% (4.2403 => 0.0440, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -100.00% (21.6534 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0035) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0102) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0060) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0043) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.94% (1.7321 => 2.1121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.48% (1.6761 => 2.0361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.39% (1.7201 => 2.0881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.11% (1.8001 => 2.1801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.95% (1.6801 => 2.0321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.93% (1.7201 => 2.0801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.55% (1.8881 => 2.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.52% (1.6961 => 2.0441, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.42% (1.7241 => 2.0761, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.69% (1.8281 => 2.1881, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.03% (1.9761 => 2.3521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.79% (1.9801 => 2.3521, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.55% (1.9601 => 2.3041, std.dev.: 0.0146) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.69% (0.6120 => 0.7080, std.dev.: 0.0192) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035) SingleSource/Benchmarks/SmallPT/smallpt: 11.11% (0.1440 => 0.1600, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.72% (11.7880 => 12.5800, std.dev.: 0.0574) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.55% (6.7200 => 7.1600, std.dev.: 0.0399) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.40% (3.5002 => 3.7242, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.79% (1.7280 => 1.8280, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (1.4160 => 1.4960, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 5.25% (3.9641 => 4.1721, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.24% (0.9920 => 1.0440, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.6120 => 0.6440, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0240) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (9.9842 => 10.4682, std.dev.: 0.0549) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0415) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.75% (1.3480 => 1.4120, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0136) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0113) MultiSource/Applications/treecc/treecc: 4.12% (2.6200 => 2.7280, std.dev.: 0.0277) MultiSource/Applications/oggenc/oggenc: 4.11% (6.9124 => 7.1964, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.92% (0.4080 => 0.4240, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (10.3203 => 10.7044, std.dev.: 0.0422) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (6.8321 => 7.0801, std.dev.: 0.0422) MultiSource/Applications/SPASS/SPASS: 3.61% (18.4924 => 19.1606, std.dev.: 0.0575) MultiSource/Applications/kimwitu++/kc: 3.51% (19.7371 => 20.4291, std.dev.: 0.0469) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.40% (51.1089 => 52.8489, std.dev.: 0.1443) MultiSource/Applications/JM/lencod/lencod: 3.34% (22.6287 => 23.3848, std.dev.: 0.0345) MultiSource/Applications/minisat/minisat: 3.27% (0.8560 => 0.8840, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (5.5480 => 5.7280, std.dev.: 0.0495) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0113) MultiSource/Applications/siod/siod: 2.76% (2.7562 => 2.8322, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 2.59% (20.2445 => 20.7685, std.dev.: 0.0548) MultiSource/Benchmarks/Bullet/bullet: 2.56% (38.9366 => 39.9326, std.dev.: 0.1078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (3.0122 => 3.0882, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (2.2721 => 2.3281, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (2.1560 => 2.2080, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (16.5963 => 16.9923, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0137) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.99% (6.0244 => 6.1444, std.dev.: 0.0208) MultiSource/Applications/sqlite3/sqlite3: 1.83% (25.1895 => 25.6496, std.dev.: 0.0464) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.18% (29.4578 => 29.8059, std.dev.: 0.0721) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.58% (6.8204 => 7.0644, std.dev.: 0.0398) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.21% (0.9961 => 1.0281, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (1.3681 => 1.3881, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.26% (6.2884 => 0.8640, std.dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -81.34% (10.9087 => 2.0361, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/nestedloop: -60.86% (2.9642 => 1.1601, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.45% (1.5881 => 1.1681, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -23.16% (0.7600 => 0.5840, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: -21.45% (2.6481 => 2.0800, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.51% (7.4801 => 6.3200, std.dev.: 0.0485) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -14.87% (7.5041 => 6.3880, std.dev.: 0.0349) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0070) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -2.54% (13.5243 => 13.1803, std.dev.: 0.0419) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.6646 => 0.0000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.64% (21.6534 => 17.8331, std.dev.: 0.0529) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0091) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.44% (2.6202 => 2.5562, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -1.75% (11.6527 => 11.4487, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.26% (4.1323 => 4.0803, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -1.10% (2.9122 => 2.8802, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 09:54:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 11:54:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140422165439.B6A3C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24816?compare_to=24806&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24816, Order: 206884, Start Time: 2014-04-22 12:21:36, End Time: 2014-04-22 17:01:19 To: 24806, Order: 206867, Start Time: 2014-04-22 07:17:48, End Time: 2014-04-22 12:07:10 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== New Failures: 6 (6 on baseline) Performance Regressions: 21 (170 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1084 (913 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0200 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0440 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1285 => 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -99.07% (4.2963 => 0.0400, std.dev.: 0.0073) MultiSource/Applications/lua/lua: -100.00% (22.0334 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-08-BitOpsTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 21.21% (0.1320 => 0.1600, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 17.39% (0.0920 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (1.4560 => 1.5400, std.dev.: 0.0247) MultiSource/Applications/hbd/hbd: 3.63% (1.7640 => 1.8280, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.59% (0.4640 => 0.4760, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.11% (0.2960 => 0.3200, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 4.13% (0.9681 => 1.0081, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.6726 => 0.0000, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: -100.00% (0.0120 => 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: -100.00% (0.0480 => 0.0000) MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1245 => 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -99.06% (4.2403 => 0.0400, std.dev.: 0.0073) MultiSource/Applications/lua/lua: -100.00% (21.7974 => 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2362.50% (0.0320 => 0.7880, std.dev.: 0.0092) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0123) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0086) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0137) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 195.24% (0.2520 => 0.7440, std.dev.: 0.0180) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0070) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0054) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0061) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 47.73% (0.7040 => 1.0400, std.dev.: 0.0246) SingleSource/Regression/C/bigstack: 46.15% (0.0520 => 0.0760, std.dev.: 0.0074) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0226) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 40.00% (0.0600 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 34.21% (0.1520 => 0.2040, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.68% (1.2481 => 1.5561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.13% (1.1761 => 1.4481, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.82% (1.1721 => 1.4161, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.77% (1.1361 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.45% (1.2521 => 1.5081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.20% (1.1881 => 1.4281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0131) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: 20.00% (0.0600 => 0.0720, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (1.3681 => 1.6361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 18.51% (8.5802 => 10.1683, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.21% (1.3841 => 1.6361, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 15.93% (19.5406 => 22.6527, std.dev.: 0.0459) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.59% (5.3360 => 6.1681, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0234) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0047) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0186) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 9.38% (11.3843 => 12.4523, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.10% (5.6680 => 6.1840, std.dev.: 0.0382) MultiSource/Applications/oggenc/oggenc: 9.10% (6.2844 => 6.8564, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.59% (5.7280 => 6.2200, std.dev.: 0.0424) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (11.4440 => 12.4120, std.dev.: 0.0802) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3480 => 0.3760, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.06% (9.5802 => 10.2562, std.dev.: 0.0461) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.79% (0.6480 => 0.6920, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.50% (1.4760 => 1.5720, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0098) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0097) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.22% (49.1529 => 51.2289, std.dev.: 0.0711) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.22% (6.8280 => 7.1160, std.dev.: 0.0505) MultiSource/Applications/lua/lua: 4.11% (4.7720 => 4.9680, std.dev.: 0.0348) MultiSource/Benchmarks/MallocBench/gs/gs: 4.09% (5.3840 => 5.6040, std.dev.: 0.0481) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0168) MultiSource/Applications/ClamAV/clamscan: 3.54% (19.2243 => 19.9044, std.dev.: 0.0344) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (2.2081 => 2.2841, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (0.3760 => 0.3880, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: 2.91% (24.7575 => 25.4775, std.dev.: 0.0374) MultiSource/Applications/kimwitu++/kc: 2.84% (19.7491 => 20.3091, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 1.97% (39.0726 => 39.8406, std.dev.: 0.0748) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.80% (6.0124 => 6.1204, std.dev.: 0.0252) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0126) MultiSource/Applications/SPASS/SPASS: 1.55% (18.7966 => 19.0886, std.dev.: 0.0534) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.50% (29.3298 => 29.7699, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (16.7083 => 16.9083, std.dev.: 0.0364) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.81% (1.2401 => 1.4361, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.23% (0.3320 => 0.3560, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 => 0.3200, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 4.56% (2.9842 => 3.1202, std.dev.: 0.0155) MultiSource/Applications/minisat/minisat: 3.93% (6.8204 => 7.0884, std.dev.: 0.0366) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0203 => 5.1643, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (5.0963 => 5.2283, std.dev.: 0.0255) MultiSource/Applications/sqlite3/sqlite3: 2.56% (4.0563 => 4.1603, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (25.4536 => 25.9136, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.63% (11.0207 => 2.0241, std.dev.: 0.0099) SingleSource/Regression/C/callargs: -80.00% (0.0200 => 0.0040, std.dev.: 0.0061) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (9.6806 => 0.0000, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -18.94% (8.9566 => 7.2605, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.29% (21.6534 => 17.9091, std.dev.: 0.0265) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.60% (5.2763 => 4.9283, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -1.07% (11.5567 => 11.4327, std.dev.: 0.0155) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 10:42:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 12:42:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422174256.992B62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24817?compare_to=24811&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24817, Order: 206885, Start Time: 2014-04-22 13:02:28, End Time: 2014-04-22 17:49:34 To: 24811, Order: 206883, Start Time: 2014-04-22 11:49:02, End Time: 2014-04-22 16:21:48 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Passes: 7 (0 on baseline) Performance Regressions: 10 (111 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0000 => 0.0200, std.dev.: 0.0035) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0000 => 0.0520, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: - (0.0000 => 7.2805, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 9437.05% (0.0440 => 4.1963, std.dev.: 0.0120) MultiSource/Applications/lua/lua: - (0.0000 => 22.1894, std.dev.: 0.1678) MultiSource/Benchmarks/BitBench/five11/five11: - (0.0000 => 2.3521, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/objinst: 44.44% (0.0360 => 0.0520, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/family/family: 37.50% (0.0320 => 0.0440, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.00% (0.1000 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 11.43% (0.1400 => 0.1560, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 6.52% (0.3680 => 0.3920, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 237215.00% (0.0040 => 9.4926, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 100.00% (0.0160 => 0.0320, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.2481 => 1.2681, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.47% (3.5402 => 3.4882, std.dev.: 0.0168) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (4.0003 => 3.9602, std.dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0062) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: 11.43% (0.1400 => 0.1560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.37% (1.1961 => 1.3201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.77% (1.3681 => 1.4881, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (6.0160 => 6.4480, std.dev.: 0.0441) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0822) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.3400 => 0.3600, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (8.1441 => 8.5761, std.dev.: 0.0319) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0341) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (5.8400 => 6.0520, std.dev.: 0.0293) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0506) MultiSource/Applications/JM/lencod/lencod: 3.32% (17.6165 => 18.2005, std.dev.: 0.0385) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0139) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.80% (48.1088 => 49.4570, std.dev.: 0.0808) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0391) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0389) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0127) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8965, std.dev.: 0.0773) MultiSource/Applications/kimwitu++/kc: 2.15% (18.8170 => 19.2211, std.dev.: 0.0456) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0457) MultiSource/Applications/SPASS/SPASS: 1.60% (17.5484 => 17.8284, std.dev.: 0.0523) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0168) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (15.2282 => 15.4322, std.dev.: 0.0387) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 166.67% (0.0120 => 0.0320, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 4.90% (21.1533 => 22.1894, std.dev.: 0.1678) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.24% (10.8967 => 2.0441, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: -1.80% (3.5522 => 3.4882, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 11:12:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 13:12:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422181215.BA03D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24818?compare_to=24817&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24818, Order: 206890, Start Time: 2014-04-22 13:35:28, End Time: 2014-04-22 18:18:52 To: 24817, Order: 206885, Start Time: 2014-04-22 13:02:28, End Time: 2014-04-22 17:49:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (108 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-02-04-DivRem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 37.50% (0.0640 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/Stanford/Oscar: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2240 => 0.2400, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.35% (5.9560 => 6.0960, std.dev.: 0.0235) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 1.49% (3.4882 => 3.5402, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.15% (1.2681 => 1.2281, std.dev.: 0.0147) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0049) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.75% (1.2281 => 1.3601, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.74% (10.6960 => 11.5240, std.dev.: 0.0560) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0333) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.39% (1.2521 => 1.3321, std.dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (8.1441 => 8.5761, std.dev.: 0.0469) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (5.8000 => 6.0960, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3800 => 1.4360, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (5.8400 => 6.0400, std.dev.: 0.0566) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (7.8562 => 8.1002, std.dev.: 0.0237) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0278) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0342) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.65% (48.1088 => 49.3850, std.dev.: 0.0848) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 2.00% (37.0925 => 37.8325, std.dev.: 0.0852) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0469) MultiSource/Applications/sqlite3/sqlite3: 1.80% (23.7574 => 24.1855, std.dev.: 0.0480) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (15.2282 => 15.4162, std.dev.: 0.0314) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0591) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 5.03% (21.1533 => 22.2174, std.dev.: 0.1239) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0414) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.26% (3.5322 => 3.6122, std.dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0130) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0267) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -3.43% (0.7000 => 0.6760, std.dev.: 0.0056) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 11:31:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 13:31:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422183128.6A8CA2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24819?compare_to=24818&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24819, Order: 206893, Start Time: 2014-04-22 13:53:25, End Time: 2014-04-22 18:37:53 To: 24818, Order: 206890, Start Time: 2014-04-22 13:35:28, End Time: 2014-04-22 18:18:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 22 (104 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/Vector/divides: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/Vector/build2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0038) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1560 => 0.1760, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 4.63% (0.4320 => 0.4520, std.dev.: 0.0068) MultiSource/Benchmarks/sim/sim: 3.49% (0.3440 => 0.3560, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 2.59% (1.2360 => 1.2680, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.40% (1.3321 => 1.3641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.08% (1.3481 => 1.3761, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.92% (1.2481 => 1.2721, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.87% (1.2841 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.82% (1.3161 => 1.3401, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.58% (1.2641 => 1.2841, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (2.1881 => 2.2161, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.61% (1.2281 => 1.2601, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: 1.93% (2.0681 => 2.1081, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/perlin: -27.78% (0.0720 => 0.0520, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0068) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 14.14% (0.3960 => 0.4520, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.58% (1.2081 => 1.3601, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.50% (1.1481 => 1.2801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.49% (1.1841 => 1.3201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.19% (1.1441 => 1.2721, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.07% (1.2281 => 1.3641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.07% (1.1561 => 1.2841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.00% (1.2361 => 1.3721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.56% (1.2121 => 1.3401, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.37% (1.1961 => 1.3201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.26% (1.2481 => 1.3761, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.07% (1.1921 => 1.3121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.06% (1.2321 => 1.3561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.75% (1.2721 => 1.3961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.77% (1.3681 => 1.4881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.6840 => 0.7400, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (6.0160 => 6.4640, std.dev.: 0.0507) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0803) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.60% (8.1441 => 8.6001, std.dev.: 0.0322) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0184) MultiSource/Applications/lua/lua: 4.96% (4.5200 => 4.7440, std.dev.: 0.0268) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.53% (2.1201 => 2.2161, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3800 => 1.4400, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0187) MultiSource/Benchmarks/mafft/pairlocalalign: 4.27% (10.4082 => 10.8522, std.dev.: 0.0319) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0522) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0164) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0500) MultiSource/Applications/JM/lencod/lencod: 3.50% (17.6165 => 18.2325, std.dev.: 0.0562) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.8322 => 2.9242, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0337) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.73% (48.1088 => 49.4208, std.dev.: 0.0945) MultiSource/Benchmarks/Bullet/bullet: 2.65% (37.0925 => 38.0766, std.dev.: 0.0719) MultiSource/Applications/kimwitu++/kc: 2.51% (18.8170 => 19.2891, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0421) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 1.73% (17.5484 => 17.8524, std.dev.: 0.0335) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (15.2282 => 15.4162, std.dev.: 0.0498) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (5.7564 => 5.8244, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0210) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 4.75% (21.1533 => 22.1574, std.dev.: 0.0987) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0330) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/obsequi/Obsequi: 1.93% (2.0681 => 2.1081, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/perlin: -27.78% (0.0720 => 0.0520, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 11:44:41 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 11:44:41 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422184459.8CEF04FD2FB5@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19152 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206905 Blamelist: dblaikie BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 12:13:45 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 12:13:45 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422191358.09CD34FD33A3@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19153 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206906 Blamelist: enderby Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 22 12:53:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 14:53:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422195319.EF88D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24820?compare_to=24819&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24820, Order: 206899, Start Time: 2014-04-22 15:18:19, End Time: 2014-04-22 19:59:57 To: 24819, Order: 206893, Start Time: 2014-04-22 13:53:25, End Time: 2014-04-22 18:37:53 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (104 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: 30.77% (0.0520 => 0.0680, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.52% (0.6520 => 0.6880, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.4280 => 1.4720, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.58% (0.6200 => 0.6360, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.82% (1.1841 => 1.3241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.94% (1.2481 => 1.3721, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.26% (1.2521 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.84% (1.5200 => 1.6240, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0614) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0402) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0234) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0393) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0457) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0491) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0485) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.8322 => 2.9162, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.69% (4.0122 => 4.1203, std.dev.: 0.0088) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.69% (48.1088 => 49.4010, std.dev.: 0.0775) MultiSource/Benchmarks/Bullet/bullet: 2.40% (37.0925 => 37.9845, std.dev.: 0.0618) MultiSource/Applications/kimwitu++/kc: 2.04% (18.8170 => 19.2011, std.dev.: 0.0429) MultiSource/Applications/sqlite3/sqlite3: 1.95% (23.7574 => 24.2215, std.dev.: 0.0404) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0430) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0162) MultiSource/Applications/lua/lua: 5.14% (21.1533 => 22.2414, std.dev.: 0.0973) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0306) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 14:10:24 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 14:10:24 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422211053.F045F4FD432D@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19157 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206919 Blamelist: ruiu BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 22 14:04:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 16:04:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422210444.267312A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24821?compare_to=24820&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24821, Order: 206901, Start Time: 2014-04-22 16:31:35, End Time: 2014-04-22 21:11:22 To: 24820, Order: 206899, Start Time: 2014-04-22 15:18:19, End Time: 2014-04-22 19:59:57 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (106 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 25.00% (0.0640 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.2880 => 0.3040, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.3240 => 0.3400, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.19% (0.9121 => 0.9321, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 1.65% (0.7280 => 0.7400, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 5.32% (0.3760 => 0.3960, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/five11/five11: 2.27% (2.2921 => 2.3441, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.13% (1.1881 => 1.3441, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.98% (0.3280 => 0.3640, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.2161 => 1.3481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.07% (1.1921 => 1.3121, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.26% (1.2521 => 1.3681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0094) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0119) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (6.0160 => 6.4600, std.dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0862) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.3200 => 0.3400, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (8.1441 => 8.5921, std.dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (1.7360 => 1.8280, std.dev.: 0.0236) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0264) MultiSource/Applications/lua/lua: 4.96% (4.5200 => 4.7440, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (5.8000 => 6.0760, std.dev.: 0.0362) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.6840 => 0.7160, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3800 => 1.4400, std.dev.: 0.0182) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (10.4082 => 10.8442, std.dev.: 0.0252) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0193) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0354) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0482) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.69% (48.1088 => 49.4049, std.dev.: 0.0613) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.0122 => 4.1123, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (4.9200 => 5.0400, std.dev.: 0.0445) MultiSource/Benchmarks/Bullet/bullet: 2.30% (37.0925 => 37.9446, std.dev.: 0.0797) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0420) MultiSource/Applications/kimwitu++/kc: 2.13% (18.8170 => 19.2171, std.dev.: 0.0426) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0197) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0416) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.5882 => 2.6362, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0259) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0239) MultiSource/Applications/lua/lua: 5.11% (21.1533 => 22.2334, std.dev.: 0.1005) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0050) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 1.14% (6.6564 => 6.7324, std.dev.: 0.0260) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0068) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 14:15:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 16:15:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422211501.973922A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24822?compare_to=24812&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24822, Order: 206901, Start Time: 2014-04-22 16:38:31, End Time: 2014-04-22 21:21:42 To: 24812, Order: 206883, Start Time: 2014-04-22 11:52:54, End Time: 2014-04-22 16:28:37 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 6 (2 on baseline) Performance Regressions: 16 (161 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0000 => 0.0160, std.dev.: 0.0039) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0000 => 0.0440, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: - (0.0000 => 8.2085, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 9446.14% (0.0440 => 4.2003, std.dev.: 0.0054) MultiSource/Applications/lua/lua: - (0.0000 => 22.0174, std.dev.: 0.1070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/2003-05-07-VarArgs: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.05% (0.0760 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 15.00% (0.0800 => 0.0920, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 8.33% (0.2880 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.69% (0.4680 => 0.5040, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.2600 => 0.2760, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: 3.49% (0.3440 => 0.3560, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.09% (0.1760 => 0.1920, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (1.2841 => 1.3201, std.dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/fldry: 2.04% (0.5880 => 0.6000, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (0.6840 => 0.6960, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0146) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0096) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 133.33% (0.0120 => 0.0280, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/sumarray2d: 66.67% (0.0240 => 0.0400, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 36.36% (0.0880 => 0.1200, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 27.78% (0.0720 => 0.0920, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 25.81% (0.1240 => 0.1560, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0054) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.02% (1.0240 => 1.1880, std.dev.: 0.0252) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.00% (0.0800 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1760 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.67% (1.4401 => 1.6081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.01% (1.8161 => 2.0161, std.dev.: 0.0113) SingleSource/Regression/C/bigstack: 10.87% (0.1840 => 0.2040, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.76% (1.5241 => 1.6881, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.59% (1.5481 => 1.7121, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.43% (1.4961 => 1.6521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.42% (1.6121 => 1.7801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0130) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.34% (0.3480 => 0.3840, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.23% (0.7040 => 0.7760, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.80% (0.2040 => 0.2240, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (1.5521 => 1.7041, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.68% (1.7361 => 1.9041, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: 9.42% (1.8680 => 2.0440, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.01% (1.4201 => 1.5481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.33% (0.2400 => 0.2600, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.19% (1.4161 => 1.5321, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.97% (1.4561 => 1.5721, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.61% (6.4680 => 6.9600, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.34% (1.5801 => 1.6961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (0.2200 => 0.2360, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0103) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.13% (1.7401 => 1.8641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0115) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (11.6440 => 12.4320, std.dev.: 0.0450) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.45% (0.3720 => 0.3960, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 6.37% (1.5080 => 1.6040, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.2600 => 0.2760, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (1.5480 => 1.6400, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (5.8121 => 6.1561, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (9.4842 => 10.0322, std.dev.: 0.0341) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.52% (0.7240 => 0.7640, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.16% (2.3281 => 2.4482, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 5.07% (5.3600 => 5.6320, std.dev.: 0.0260) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.06% (1.6601 => 1.7441, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/sieve: 4.71% (0.3400 => 0.3560, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.52% (0.7960 => 0.8320, std.dev.: 0.0133) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 4.46% (21.9606 => 22.9408, std.dev.: 0.0378) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.0443 => 10.4763, std.dev.: 0.0343) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (6.5440 => 6.8240, std.dev.: 0.0479) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.20% (50.0290 => 52.1290, std.dev.: 0.0679) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.7400 => 1.8120, std.dev.: 0.0218) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (6.5080 => 6.7680, std.dev.: 0.0443) MultiSource/Benchmarks/Bullet/bullet: 3.79% (38.4046 => 39.8606, std.dev.: 0.0763) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.77% (2.1240 => 2.2040, std.dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.63% (4.1843 => 4.3363, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 3.39% (2.7162 => 2.8082, std.dev.: 0.0143) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0437) MultiSource/Applications/treecc/treecc: 3.25% (2.5840 => 2.6680, std.dev.: 0.0255) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 3.15% (18.4404 => 19.0206, std.dev.: 0.0656) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.8440 => 0.8680, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 2.83% (19.0444 => 19.5843, std.dev.: 0.0649) MultiSource/Applications/kimwitu++/kc: 2.74% (19.6891 => 20.2291, std.dev.: 0.0555) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.3483 => 16.7003, std.dev.: 0.0548) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (6.1044 => 6.1964, std.dev.: 0.0288) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0291) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.02% (2.1401 => 2.4402, std.dev.: 0.0539) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (4.5603 => 4.7163, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: 3.24% (0.9881 => 1.0201, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 2.70% (6.6684 => 6.8484, std.dev.: 0.0352) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.5087 => 11.7167, std.dev.: 0.0158) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 1.50% (2.9322 => 2.9762, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 1.29% (21.7374 => 22.0174, std.dev.: 0.1070) MultiSource/Applications/SPASS/SPASS: 1.21% (9.2606 => 9.3726, std.dev.: 0.0344) MultiSource/Applications/JM/lencod/lencod: 1.03% (8.1245 => 8.2085, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.91% (10.6247 => 2.0281, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.75% (2.9442 => 0.9200, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.23% (91.8497 => 49.3831, std.dev.: 10.4007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.47% (26.0616 => 17.0771, std.dev.: 0.2026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.41% (50.3031 => 32.9941, std.dev.: 0.2763) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.37% (42.1466 => 28.5018, std.dev.: 0.6026) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.1083) SingleSource/UnitTests/Vector/multiplies: -19.81% (1.6961 => 1.3601, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -3.85% (0.6240 => 0.6000, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: -2.21% (2.3561 => 2.3041, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 14:34:05 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 14:34:05 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422213418.1D6EF4FD4603@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19158 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206920 Blamelist: dnovillo Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 22 14:34:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 16:34:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140422213426.6C5912A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24823?compare_to=24813&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24823, Order: 206901, Start Time: 2014-04-22 16:55:03, End Time: 2014-04-22 21:41:06 To: 24813, Order: 206884, Start Time: 2014-04-22 12:05:52, End Time: 2014-04-22 16:45:22 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 6 (11 on baseline) Performance Regressions: 15 (136 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0000 => 0.0200, std.dev.: 0.0028) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0000 => 0.0480, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: - (0.0000 => 8.2085, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 9509.77% (0.0440 => 4.2283, std.dev.: 0.0090) MultiSource/Applications/lua/lua: - (0.0000 => 22.0214, std.dev.: 0.1192) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/Vector/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.50% (0.1600 => 0.1800, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.95% (0.3040 => 0.3160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 3.60% (0.4440 => 0.4600, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.65% (2.1841 => 2.2201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.24% (2.2601 => 2.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.21% (1.9841 => 2.0081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.20% (2.0041 => 2.0281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.15% (2.4402 => 2.4682, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.16% (3.3362 => 3.5082, std.dev.: 0.0572) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.29% (17.6723 => 19.6683, std.dev.: 0.0534) MultiSource/Applications/sqlite3/sqlite3: 1418.59% (1.7001 => 25.8176, std.dev.: 0.0435) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.80% (50.1010 => 52.0050, std.dev.: 0.0825) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.08% (11.3920 => 12.3120, std.dev.: 0.0779) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0078) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0083, std.dev.: 0.0227) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0118) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 314.84% (0.4320 => 1.7921, std.dev.: 0.0131) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0048) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C/PR640: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0020) SingleSource/UnitTests/Vector/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.15% (1.8081 => 2.1001, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.97% (1.8281 => 2.1201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.90% (1.8361 => 2.1281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.87% (1.9161 => 2.2201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.70% (1.8601 => 2.1521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.58% (2.0281 => 2.3441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.55% (2.1361 => 2.4682, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.52% (1.8561 => 2.1441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 15.38% (1.9241 => 2.2201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.22% (1.8921 => 2.1801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.21% (1.9721 => 2.2721, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.83% (2.1121 => 2.4041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.92% (1.7961 => 2.0281, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.21% (1.9001 => 2.1321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.09% (1.8201 => 2.0401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.93% (1.8441 => 2.0641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.91% (1.8801 => 2.1041, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.60% (2.0681 => 2.3081, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.60% (2.1041 => 2.3481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0117) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.50% (2.0521 => 2.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.50% (1.9481 => 2.1721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0146) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2280 => 0.2520, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0119) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.8760 => 2.0560, std.dev.: 0.0169) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.14% (0.3360 => 0.3600, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (6.4800 => 6.9160, std.dev.: 0.0302) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.94% (1.2120 => 1.2840, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.65% (0.7080 => 0.7480, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.31% (0.9801 => 1.0321, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.81% (1.7480 => 1.8320, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (5.8281 => 6.1041, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.72% (6.5320 => 6.8400, std.dev.: 0.0315) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4400 => 0.4600, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.35% (6.5360 => 6.8200, std.dev.: 0.0283) MultiSource/Applications/JM/ldecod/ldecod: 4.34% (10.2283 => 10.6724, std.dev.: 0.0331) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.5760 => 1.6440, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.04% (9.6042 => 9.9922, std.dev.: 0.0681) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0335) MultiSource/Benchmarks/Bullet/bullet: 2.96% (38.6366 => 39.7806, std.dev.: 0.0737) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (5.3960 => 5.5480, std.dev.: 0.0547) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0118) MultiSource/Applications/SPASS/SPASS: 2.59% (18.5284 => 19.0085, std.dev.: 0.0549) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (16.3003 => 16.7123, std.dev.: 0.0576) MultiSource/Applications/JM/lencod/lencod: 2.39% (22.2206 => 22.7527, std.dev.: 0.0722) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2243 => 4.3243, std.dev.: 0.0170) MultiSource/Applications/d/make_dparser: 2.11% (3.9761 => 4.0601, std.dev.: 0.0266) MultiSource/Applications/kimwitu++/kc: 2.00% (19.8291 => 20.2251, std.dev.: 0.0165) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0159) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (13.0363 => 13.2043, std.dev.: 0.0263) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.85% (2.1201 => 2.4562, std.dev.: 0.0387) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 3.36% (7.3725 => 7.6205, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.27% (6.5964 => 6.8124, std.dev.: 0.0609) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.91% (3.7122 => 3.8202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 1.60% (11.4967 => 11.6807, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.58% (4.8043 => 4.8803, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.28% (2.9562 => 0.9080, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.92% (94.8339 => 49.3871, std.dev.: 10.2213) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.37% (25.7136 => 16.8771, std.dev.: 0.1579) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.04% (49.9431 => 32.9421, std.dev.: 0.2103) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.79% (37.0863 => 28.6338, std.dev.: 0.3902) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0050) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 14:40:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 16:40:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140422214019.4566E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24824?compare_to=24814&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24824, Order: 206902, Start Time: 2014-04-22 16:59:30, End Time: 2014-04-22 21:46:57 To: 24814, Order: 206884, Start Time: 2014-04-22 12:09:50, End Time: 2014-04-22 16:49:50 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 6 (1 on baseline) Performance Regressions: 13 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0000 => 0.0200, std.dev.: 0.0032) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0000 => 0.0480, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: - (0.0000 => 8.1045, std.dev.: 0.0433) MultiSource/Applications/SIBsim4/SIBsim4: 8858.96% (0.0480 => 4.3003, std.dev.: 0.0060) MultiSource/Applications/lua/lua: - (0.0000 => 21.6334, std.dev.: 0.1357) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-09-18-BitFieldTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/cast-bug: 200.00% (0.0080 => 0.0240, std.dev.: 0.0051) SingleSource/Regression/C++/EH/throw_rethrow_test: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.58% (0.0760 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 19.23% (0.1040 => 0.1240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2160 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (0.9161 => 0.9361, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.40% (1.7161 => 1.7401, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 1.20% (5.0000 => 5.0600, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.16% (1.7241 => 1.7441, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.30% (5.3923 => 5.5163, std.dev.: 0.0464) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 14:49:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 16:49:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140422214925.209432A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24825?compare_to=24815&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24825, Order: 206904, Start Time: 2014-04-22 17:06:56, End Time: 2014-04-22 21:56:03 To: 24815, Order: 206884, Start Time: 2014-04-22 12:14:59, End Time: 2014-04-22 16:57:01 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 6 (1 on baseline) Performance Regressions: 20 (146 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1086 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0000 => 0.0240, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0000 => 0.0440, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: - (0.0000 => 8.1165, std.dev.: 0.0166) MultiSource/Applications/SIBsim4/SIBsim4: 9646.14% (0.0440 => 4.2883, std.dev.: 0.0053) MultiSource/Applications/lua/lua: - (0.0000 => 22.0254, std.dev.: 0.0666) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.2480 => 0.2680, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 7.29% (0.3840 => 0.4120, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 6.82% (0.3520 => 0.3760, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2360 => 0.2520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.88% (0.2040 => 0.2160, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 3.70% (0.3240 => 0.3360, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.76% (2.0441 => 2.0801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.53% (2.3601 => 2.3961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.39% (2.3041 => 2.3361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.30% (2.1481 => 2.1761, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/strcat: 16.67% (0.1200 => 0.1400, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.39% (0.8641 => 0.8761, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0101) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/partialsums: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.64% (1.6961 => 2.0801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 22.30% (1.6681 => 2.0401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.96% (1.6761 => 2.0441, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.80% (1.6881 => 2.0561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.78% (1.8001 => 2.1921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.75% (1.6921 => 2.0601, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.71% (1.7321 => 2.1081, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.63% (1.7201 => 2.0921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.54% (1.7081 => 2.0761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.54% (1.7641 => 2.1441, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.43% (1.7921 => 2.1761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 21.39% (1.7201 => 2.0881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.33% (1.7441 => 2.1161, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.29% (1.6721 => 2.0281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.24% (1.8081 => 2.1921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.23% (1.6961 => 2.0561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 21.06% (1.8041 => 2.1841, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.84% (1.8041 => 2.1801, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.61% (1.9801 => 2.3881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.59% (1.7481 => 2.1081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.52% (1.9881 => 2.3961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.35% (1.8281 => 2.2001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.31% (1.7401 => 2.0761, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.29% (1.9081 => 2.2761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.18% (1.9601 => 2.3361, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.94% (1.9641 => 2.3361, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.82% (1.9761 => 2.3481, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.64% (0.2360 => 0.2800, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 18.18% (1.9801 => 2.3401, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/SmallPT/smallpt: 13.89% (0.1440 => 0.1640, std.dev.: 0.0035) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0072) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: 8.00% (0.3000 => 0.3240, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.02% (11.7880 => 12.6160, std.dev.: 0.0528) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.86% (3.5002 => 3.7402, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2360 => 0.2520, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.19% (6.7200 => 7.1360, std.dev.: 0.0468) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.7280 => 1.8320, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0118) MultiSource/Applications/lua/lua: 5.18% (4.7920 => 5.0400, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (1.2400 => 1.3000, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0153) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.45% (9.9842 => 10.4282, std.dev.: 0.0570) MultiSource/Applications/d/make_dparser: 4.34% (3.9641 => 4.1361, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0049) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.79% (1.3720 => 1.4240, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (2.0440 => 2.1160, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (6.8321 => 7.0681, std.dev.: 0.0340) MultiSource/Applications/JM/ldecod/ldecod: 3.26% (10.3203 => 10.6563, std.dev.: 0.0383) MultiSource/Applications/SPASS/SPASS: 3.16% (18.4924 => 19.0765, std.dev.: 0.0655) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.14% (51.1089 => 52.7129, std.dev.: 0.0538) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 2.94% (19.7371 => 20.3171, std.dev.: 0.0502) MultiSource/Applications/JM/lencod/lencod: 2.85% (22.6287 => 23.2727, std.dev.: 0.0658) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (3.0122 => 3.0922, std.dev.: 0.0145) MultiSource/Applications/siod/siod: 2.61% (2.7562 => 2.8282, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (5.5480 => 5.6920, std.dev.: 0.0451) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 2.34% (0.8560 => 0.8760, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (2.2721 => 2.3241, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 2.28% (38.9366 => 39.8246, std.dev.: 0.0787) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (2.1560 => 2.2040, std.dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: 2.21% (20.2445 => 20.6925, std.dev.: 0.0742) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0219) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (16.5963 => 16.8723, std.dev.: 0.0585) MultiSource/Applications/sqlite3/sqlite3: 1.41% (25.1895 => 25.5455, std.dev.: 0.0561) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.25% (1.2681 => 1.4361, std.dev.: 0.0552) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0157) SingleSource/Benchmarks/McGill/queens: 3.86% (2.1761 => 2.2601, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.21% (3.4842 => 3.5962, std.dev.: 0.0411) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 1.72% (21.6534 => 22.0254, std.dev.: 0.0666) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (4.4883 => 4.5563, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (1.3681 => 1.3881, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.39% (4.0203 => 4.0763, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (2.5322 => 2.5602, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0923 => 4.1363, std.dev.: 0.0165) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0151) SingleSource/UnitTests/Vector/constpool: -81.30% (10.9087 => 2.0401, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ConditionalExpr: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0038) MultiSource/Applications/obsequi/Obsequi: -21.00% (2.6481 => 2.0920, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.20% (7.4801 => 6.2680, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.05% (7.5041 => 6.3000, std.dev.: 0.0582) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0054) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: -2.75% (13.5243 => 13.1523, std.dev.: 0.0302) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.44% (21.6534 => 17.8771, std.dev.: 0.0420) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.19% (3.4682 => 3.1842, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.10% (0.3280 => 0.3080, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.60% (0.9281 => 0.8761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.52% (4.6083 => 4.4923, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.36% (4.1323 => 4.0763, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -1.24% (2.9122 => 2.8762, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 14:52:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 16:52:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140422215200.41E6E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24826?compare_to=24816&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24826, Order: 206904, Start Time: 2014-04-22 17:11:11, End Time: 2014-04-22 21:58:41 To: 24816, Order: 206884, Start Time: 2014-04-22 12:21:36, End Time: 2014-04-22 17:01:19 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== New Passes: 6 (0 on baseline) Performance Regressions: 11 (166 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lua/lua MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0000 => 0.0200, std.dev.: 0.0032) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0000 => 0.0480, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: - (0.0000 => 8.1285, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 10640.75% (0.0400 => 4.2963, std.dev.: 0.0077) MultiSource/Applications/lua/lua: - (0.0000 => 22.0414, std.dev.: 0.1312) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0000, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Treesort: 44.44% (0.0360 => 0.0520, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/hash: 30.77% (0.0520 => 0.0680, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Regression/C/bigstack: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.90% (0.2480 => 0.2800, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.00% (0.1200 => 0.1320, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.2480 => 0.2680, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.7480 => 0.7800, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.85% (1.0400 => 1.0800, std.dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0079) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0070) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0095) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 320.73% (0.2320 => 0.9761, std.dev.: 0.0095) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0151) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0083) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0042) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0038) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0057) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: 45.11% (1.3920 => 2.0200, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 37.50% (0.1600 => 0.2200, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.27% (1.2321 => 1.5681, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.13% (1.2401 => 1.5641, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.68% (1.2481 => 1.5561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.33% (1.2001 => 1.4801, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 22.46% (1.3001 => 1.5921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.30% (1.1841 => 1.4481, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.50% (1.1721 => 1.4241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.18% (1.1521 => 1.3961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.13% (1.2321 => 1.4801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.94% (1.2841 => 1.5401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.86% (1.1881 => 1.4241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (1.3681 => 1.6361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 18.46% (8.5802 => 10.1643, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.21% (1.3841 => 1.6361, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0117) SingleSource/Benchmarks/SmallPT/smallpt: 17.65% (0.1360 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.39% (1.2881 => 1.5121, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 16.07% (0.4480 => 0.5200, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 15.89% (19.5406 => 22.6447, std.dev.: 0.0405) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.52% (5.3360 => 6.1641, std.dev.: 0.0292) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.56% (1.7400 => 1.9760, std.dev.: 0.0181) MultiSource/Benchmarks/nbench/nbench: 12.72% (1.3521 => 1.5241, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.71% (0.3360 => 0.3720, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 9.31% (11.3843 => 12.4443, std.dev.: 0.0440) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.10% (5.6680 => 6.1840, std.dev.: 0.0274) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.14% (11.4440 => 12.3760, std.dev.: 0.0529) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.03% (5.7280 => 6.1880, std.dev.: 0.0490) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (9.5802 => 10.2642, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.98% (0.7360 => 0.7800, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0189) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.69% (1.1240 => 1.1880, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (1.4760 => 1.5600, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0051) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0217) MultiSource/Benchmarks/MallocBench/gs/gs: 4.83% (5.3840 => 5.6440, std.dev.: 0.0361) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.69% (6.8280 => 7.1480, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 4.02% (4.7720 => 4.9640, std.dev.: 0.0484) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0166) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.74% (49.1529 => 50.9889, std.dev.: 0.1193) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0170) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0154) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: 2.77% (19.2243 => 19.7563, std.dev.: 0.0737) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.65% (0.4520 => 0.4640, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 2.62% (24.7575 => 25.4055, std.dev.: 0.0567) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (2.2081 => 2.2521, std.dev.: 0.0145) MultiSource/Applications/kimwitu++/kc: 1.92% (19.7491 => 20.1291, std.dev.: 0.0626) MultiSource/Benchmarks/Bullet/bullet: 1.61% (39.0726 => 39.7006, std.dev.: 0.0578) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.52% (1.0521 => 1.0681, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (6.0124 => 6.0844, std.dev.: 0.0236) MultiSource/Applications/SPASS/SPASS: 1.19% (18.7966 => 19.0206, std.dev.: 0.0513) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 42.86% (0.0280 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0191) MultiSource/Applications/minisat/minisat: 4.52% (6.8204 => 7.1284, std.dev.: 0.0365) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0204) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bisort/bisort: 3.85% (0.7280 => 0.7560, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.91% (1.1001 => 1.1321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0203 => 5.1643, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 2.83% (5.0963 => 5.2403, std.dev.: 0.0304) MultiSource/Applications/sqlite3/sqlite3: 2.76% (4.0563 => 4.1683, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/salsa20: 2.68% (7.3085 => 7.5045, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (25.4536 => 25.8936, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.45% (4.1243 => 4.1843, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.52% (11.0207 => 2.0361, std.dev.: 0.0270) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/methcall: -36.36% (0.0440 => 0.0280, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.09% (21.6534 => 17.9531, std.dev.: 0.0420) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -8.64% (3.4722 => 3.1722, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0886) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.66% (0.3280 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9242 => 2.8362, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.5602 => 3.5162, std.dev.: 0.0114) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 15:31:54 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 15:31:54 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422223214.D42D34FD4E7D@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19161 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206924 Blamelist: silvas BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 22 15:40:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 17:40:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422224013.E41CE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24827?compare_to=24821&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24827, Order: 206908, Start Time: 2014-04-22 18:00:02, End Time: 2014-04-22 22:46:52 To: 24821, Order: 206901, Start Time: 2014-04-22 16:31:35, End Time: 2014-04-22 21:11:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (108 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/global_ctor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/objinst: 44.44% (0.0360 => 0.0520, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 15.00% (0.0800 => 0.0920, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.17% (0.2360 => 0.2600, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.52% (0.3680 => 0.3920, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.97% (0.4040 => 0.4160, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -18.18% (0.0880 => 0.0720, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.5482 => 3.5082, std.dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0175) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.94% (1.2481 => 1.3721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0466) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (6.0160 => 6.4600, std.dev.: 0.0440) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (8.1441 => 8.6121, std.dev.: 0.0224) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.7080 => 1.7840, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0316) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (10.4082 => 10.8402, std.dev.: 0.0258) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0498) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 3.25% (17.6165 => 18.1885, std.dev.: 0.0509) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (7.8562 => 8.1002, std.dev.: 0.0283) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0487) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.50% (48.1088 => 49.3129, std.dev.: 0.0939) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: 2.25% (37.0925 => 37.9286, std.dev.: 0.0965) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0395) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0410) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1290, std.dev.: 0.0455) MultiSource/Applications/SPASS/SPASS: 1.60% (17.5484 => 17.8284, std.dev.: 0.0392) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (5.7564 => 5.8164, std.dev.: 0.0188) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1560 => 0.1680, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 4.84% (21.1533 => 22.1774, std.dev.: 0.0864) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0204) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.5522 => 3.5082, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 16:08:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 16:08:20 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422230832.11D884FD5352@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19162 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206925 Blamelist: dblaikie Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 22 16:07:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 18:07:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422230723.884BD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24828?compare_to=24827&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24828, Order: 206913, Start Time: 2014-04-22 18:30:03, End Time: 2014-04-22 23:14:01 To: 24827, Order: 206908, Start Time: 2014-04-22 18:00:02, End Time: 2014-04-22 22:46:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (112 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.98% (0.2120 => 0.2480, std.dev.: 0.0117) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.33% (0.1440 => 0.1560, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.33% (0.3160 => 0.3360, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.71% (0.3400 => 0.3560, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 3.98% (2.0081 => 2.0881, std.dev.: 0.0231) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.11% (1.0801 => 1.0921, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -1.32% (0.9081 => 0.8961, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.81% (0.1240 => 0.1560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.52% (1.1241 => 1.2761, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.2161 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (6.0160 => 6.4600, std.dev.: 0.0312) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0715) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (8.1441 => 8.5761, std.dev.: 0.0221) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0161) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0223) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (5.8000 => 6.0560, std.dev.: 0.0370) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0548) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0344) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0262) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.77% (48.1088 => 49.4410, std.dev.: 0.0642) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0436) MultiSource/Applications/treecc/treecc: 2.61% (2.4480 => 2.5120, std.dev.: 0.0223) MultiSource/Benchmarks/Bullet/bullet: 2.31% (37.0925 => 37.9486, std.dev.: 0.0616) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 2.17% (18.8170 => 19.2251, std.dev.: 0.0377) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 1.73% (23.7574 => 24.1695, std.dev.: 0.0377) MultiSource/Applications/SPASS/SPASS: 1.57% (17.5484 => 17.8244, std.dev.: 0.0315) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 4.95% (21.1533 => 22.2014, std.dev.: 0.1532) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0249) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.63% (1.0641 => 1.0921, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0345) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 1.44% (6.6564 => 6.7524, std.dev.: 0.0298) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.4080 => 0.3720, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0067) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 16:27:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 18:27:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140422232735.057182A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24829?compare_to=24828&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24829, Order: 206914, Start Time: 2014-04-22 18:50:11, End Time: 2014-04-22 23:34:12 To: 24828, Order: 206913, Start Time: 2014-04-22 18:30:03, End Time: 2014-04-22 23:14:01 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (112 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0560 => 0.0680, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.17% (0.2360 => 0.2600, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.2800 => 0.3000, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.81% (0.3440 => 0.3640, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 1.49% (0.8040 => 0.8160, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 6.45% (0.3720 => 0.3960, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: -4.42% (0.4520 => 0.4320, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: -23.53% (0.0680 => 0.0520, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0094) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.98% (0.3280 => 0.3640, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.39% (1.2321 => 1.3601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.37% (1.1961 => 1.3201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0461) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0700) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.29% (1.2721 => 1.3521, std.dev.: 0.0200) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.3400 => 0.3600, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (8.1441 => 8.6081, std.dev.: 0.0391) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0180) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: 5.06% (0.3160 => 0.3320, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (10.4082 => 10.8482, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0236) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 3.25% (17.6165 => 18.1885, std.dev.: 0.0251) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0548) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0468) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.73% (48.1088 => 49.4209, std.dev.: 0.0971) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0363) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.23% (37.0925 => 37.9206, std.dev.: 0.0791) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0484) MultiSource/Applications/sqlite3/sqlite3: 1.79% (23.7574 => 24.1815, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.9561 => 0.9721, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0371) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.26% (15.2282 => 15.4202, std.dev.: 0.0445) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0153) MultiSource/Applications/lua/lua: 5.05% (21.1533 => 22.2214, std.dev.: 0.1439) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0332) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0066) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 16:43:12 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 16:43:12 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140422234330.D2E3C4FD5875@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19163 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206927 Blamelist: dblaikie BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 16:57:09 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 16:57:09 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140422235721.934594FD5A6B@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19164 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206930 Blamelist: rsmith,tfiala Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 17:48:21 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 17:48:21 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423004946.E89904FD61CA@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14728 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206934 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17800 of 17801) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17801 of 17801) 1 warning(s) in tests. Testing Time: 382.63s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17651 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:4:11: error: expected string not found in input // CHECK: "-internal-isystem" "my_system_headers" ^ :4:155: note: scanning from here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "x86_64-apple-macosx10.7.0" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "windows-include-env.c" "-mrelocation-model" "pic" "-pic-level" "2" "-mdisable-fp-elim" "-masm-verbose" "-munwind-tables" "-target-cpu" "core2" "-target-linker-version" "136" "-coverage-file" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver/windows-include-env.o" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-stack-protector" "1" "-mstackrealign" "-fblocks" "-fobjc-runtime=macosx-10.7.0" "-fencode-extended-block-signature" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "windows-include-env.o" "-x" "c" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c" ^ :4:1000: note: possible intended match here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "x86_64-apple-macosx10.7.0" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "windows-include-env.c" "-mrelocation-model" "pic" "-pic-level" "2" "-mdisable-fp-elim" "-masm-verbose" "-munwind-tables" "-target-cpu" "core2" "-target-linker-version" "136" "-coverage-file" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver/windows-include-env.o" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-stack-protector" "1" "-mstackrealign" "-fblocks" "-fobjc-runtime=macosx-10.7.0" "-fencode-extended-block-signature" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "windows-include-env.o" "-x" "c" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c" ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 17:48:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 17:48:20 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423004946.C26DE4FD61C9@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14728 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206934 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17800 of 17801) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17801 of 17801) 1 warning(s) in tests. Testing Time: 382.63s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17651 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:4:11: error: expected string not found in input // CHECK: "-internal-isystem" "my_system_headers" ^ :4:155: note: scanning from here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "x86_64-apple-macosx10.7.0" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "windows-include-env.c" "-mrelocation-model" "pic" "-pic-level" "2" "-mdisable-fp-elim" "-masm-verbose" "-munwind-tables" "-target-cpu" "core2" "-target-linker-version" "136" "-coverage-file" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver/windows-include-env.o" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-stack-protector" "1" "-mstackrealign" "-fblocks" "-fobjc-runtime=macosx-10.7.0" "-fencode-extended-block-signature" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "windows-include-env.o" "-x" "c" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c" ^ :4:1000: note: possible intended match here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "x86_64-apple-macosx10.7.0" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "windows-include-env.c" "-mrelocation-model" "pic" "-pic-level" "2" "-mdisable-fp-elim" "-masm-verbose" "-munwind-tables" "-target-cpu" "core2" "-target-linker-version" "136" "-coverage-file" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver/windows-include-env.o" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-stack-protector" "1" "-mstackrealign" "-fblocks" "-fobjc-runtime=macosx-10.7.0" "-fencode-extended-block-signature" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "windows-include-env.o" "-x" "c" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c" ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 17:49:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 17:49:52 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140423005011.CA6254FD61DA@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19166 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206934 Blamelist: rnk BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: lib/Driver/WindowsToolChain.cpp On: http://10.1.1.2/svn/llvm-project For: cfe At: Tue 22 Apr 2014 17:26:42 Changed By: rnk Comments: Driver: Avoid a duplicate path separator and clean up codeProperties: Files: lib/Driver/WindowsToolChain.cpp test/Driver/windows-include-env.c On: http://10.1.1.2/svn/llvm-project For: cfe At: Tue 22 Apr 2014 17:26:42 Changed By: rnk Comments: Driver: Honor %INCLUDE% when built with MinGW Users are expected to pass system includes through the INCLUDE environment variable on Windows. There's no reason to change behavior based on the toolchain used to build Clang. I didn't change the registry searching code because I'm not sure it builds with mingw and I'm not set up to test it.Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 17:49:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 17:49:52 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140423005011.CA5EB4FD61D9@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19166 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206934 Blamelist: rnk BUILD FAILED: failed sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 22 17:56:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 19:56:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423005659.3D4B62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24830?compare_to=24829&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24830, Order: 206918, Start Time: 2014-04-22 20:22:12, End Time: 2014-04-23 01:03:37 To: 24829, Order: 206914, Start Time: 2014-04-22 18:50:11, End Time: 2014-04-22 23:34:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (119 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (973 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/family/family: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.33% (0.0480 => 0.0640, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.25% (0.0640 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 26.67% (0.0600 => 0.0760, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.43% (1.4000 => 1.4480, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.96% (1.3521 => 1.3921, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.19% (1.2801 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.77% (4.9840 => 5.0720, std.dev.: 0.0194) MultiSource/Applications/lemon/lemon: 1.76% (1.3641 => 1.3881, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.25% (4.4483 => 4.5483, std.dev.: 0.0371) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.41% (1.1921 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.37% (1.1961 => 1.3201, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.94% (1.2481 => 1.3721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/18-imp/imp: 7.77% (0.4120 => 0.4440, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0659) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.90% (0.3480 => 0.3720, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0383) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (1.3800 => 1.4480, std.dev.: 0.0150) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0164) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0609) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0212) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (10.4082 => 10.8402, std.dev.: 0.0347) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0451) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (4.9000 => 5.0720, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0541) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 3.27% (17.6165 => 18.1925, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0138) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (7.8562 => 8.0962, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0525) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0104) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.62% (48.1088 => 49.3690, std.dev.: 0.0863) MultiSource/Applications/sqlite3/sqlite3: 2.51% (23.7574 => 24.3535, std.dev.: 0.0620) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0154) MultiSource/Applications/treecc/treecc: 2.45% (2.4480 => 2.5080, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0153) MultiSource/Applications/oggenc/oggenc: 2.28% (5.7964 => 5.9284, std.dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8886, std.dev.: 0.0416) MultiSource/Applications/kimwitu++/kc: 1.96% (18.8170 => 19.1851, std.dev.: 0.0766) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 1.66% (17.5484 => 17.8404, std.dev.: 0.0443) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (15.2282 => 15.4802, std.dev.: 0.0334) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (5.7564 => 5.8204, std.dev.: 0.0161) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.09% (28.1538 => 28.4618, std.dev.: 0.0529) MultiSource/Applications/ClamAV/clamscan: 1.03% (17.4082 => 17.5882, std.dev.: 0.0557) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 4.90% (21.1533 => 22.1894, std.dev.: 0.1795) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0220) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (25.8896 => 26.7377, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (0.9601 => 0.9841, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0056) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0109) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0548) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/pi: -50.00% (0.0240 => 0.0120, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -9.80% (0.4080 => 0.3680, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.0643 => 4.0122, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 18:54:34 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 18:54:34 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423015507.876A24FD698B@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14729 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206935 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17800 of 17801) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17801 of 17801) 1 warning(s) in tests. Testing Time: 388.33s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17651 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Tue Apr 22 19:06:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 21:06:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423020641.F0EF92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24831?compare_to=24830&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24831, Order: 206920, Start Time: 2014-04-22 21:33:37, End Time: 2014-04-23 02:13:20 To: 24830, Order: 206918, Start Time: 2014-04-22 20:22:12, End Time: 2014-04-23 01:03:37 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (112 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.76% (0.1360 => 0.1520, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/distray/distray: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.59% (1.2361 => 1.2681, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.18% (1.2841 => 1.3121, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 1.74% (5.0640 => 5.1520, std.dev.: 0.0226) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.52% (2.3921 => 2.5002, std.dev.: 0.0388) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.25% (3.3922 => 3.5362, std.dev.: 0.0536) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 36.36% (0.0440 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0102) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 11.39% (0.3160 => 0.3520, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.07% (1.2281 => 1.3641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (10.6960 => 11.5200, std.dev.: 0.0478) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (6.0160 => 6.4520, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.05% (1.1921 => 1.2761, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.7040 => 0.7400, std.dev.: 0.0134) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0231) MultiSource/Benchmarks/MallocBench/gs/gs: 4.72% (4.9200 => 5.1520, std.dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0586) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (5.8400 => 6.0520, std.dev.: 0.0364) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (4.9000 => 5.0720, std.dev.: 0.0273) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0525) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0399) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0514) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0318) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9085, std.dev.: 0.0763) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0115) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.08% (48.1088 => 49.1089, std.dev.: 0.1240) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0299) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0437) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 1.46% (17.5484 => 17.8044, std.dev.: 0.0343) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0511) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: 40.00% (0.0400 => 0.0560, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 5.01% (21.1533 => 22.2134, std.dev.: 0.2068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.62% (3.3802 => 3.5362, std.dev.: 0.0536) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0205) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0220) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 19:19:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 21:19:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423021950.1EDF22A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24832?compare_to=24822&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24832, Order: 206920, Start Time: 2014-04-22 21:43:47, End Time: 2014-04-23 02:26:29 To: 24822, Order: 206901, Start Time: 2014-04-22 16:38:31, End Time: 2014-04-22 21:21:42 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 7 (149 on baseline) Performance Improvements: 4 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/short_circuit_dtor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (1.1040 => 1.1280, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.72% (0.9521 => 1.0161, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -21.74% (0.0920 => 0.0720, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.87% (1.7121 => 1.6801, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.14% (2.4482 => 2.4202, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.64% (0.2120 => 0.1640, std.dev.: 0.0161) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.36% (11.3687 => 3.0282, std.dev.: 0.0239) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0123) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0053) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 17.24% (0.1160 => 0.1360, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.1080 => 0.1240, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.90% (0.6200 => 0.7000, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.08% (1.4241 => 1.5961, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.11% (1.4401 => 1.6001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.76% (1.5241 => 1.6881, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.68% (1.7361 => 1.9041, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0191) MultiSource/Applications/obsequi/Obsequi: 9.21% (1.8680 => 2.0400, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0061) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.53% (1.5481 => 1.6801, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (1.1640 => 1.2520, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (1.1160 => 1.1960, std.dev.: 0.0276) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.04% (0.2840 => 0.3040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.82% (1.5841 => 1.6921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0181) MultiSource/Applications/Burg/burg: 6.37% (1.5080 => 1.6040, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.4680 => 6.8760, std.dev.: 0.0509) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (11.6440 => 12.3200, std.dev.: 0.0876) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.57% (9.4842 => 10.0122, std.dev.: 0.0465) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.2960 => 0.3120, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.26% (0.2280 => 0.2400, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/09-vor/vor: 5.05% (0.3960 => 0.4160, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0428) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.89% (6.5440 => 6.8640, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0228) MultiSource/Benchmarks/MallocBench/gs/gs: 4.78% (5.3600 => 5.6160, std.dev.: 0.0384) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.30% (6.5080 => 6.7880, std.dev.: 0.0377) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.0443 => 10.4763, std.dev.: 0.0420) MultiSource/Applications/JM/lencod/lencod: 4.28% (21.9606 => 22.9008, std.dev.: 0.0541) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0174) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0042) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.81% (50.0290 => 51.9330, std.dev.: 0.1283) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.66% (1.3120 => 1.3600, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (2.1240 => 2.2000, std.dev.: 0.0161) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0214) MultiSource/Benchmarks/Bullet/bullet: 3.28% (38.4046 => 39.6646, std.dev.: 0.0727) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0456) MultiSource/Applications/SPASS/SPASS: 3.15% (18.4404 => 19.0206, std.dev.: 0.0548) MultiSource/Applications/treecc/treecc: 3.10% (2.5840 => 2.6640, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0147) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: 2.75% (19.0444 => 19.5684, std.dev.: 0.0580) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (16.3483 => 16.7723, std.dev.: 0.0581) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 2.34% (19.6891 => 20.1491, std.dev.: 0.0556) MultiSource/Applications/d/make_dparser: 2.22% (3.9681 => 4.0561, std.dev.: 0.0282) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.21% (2.1401 => 2.4442, std.dev.: 0.0597) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0380) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.87% (1.6521 => 1.7161, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0657) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0462) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (3.9922 => 4.0763, std.dev.: 0.0238) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.77% (11.5087 => 11.7127, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0097) MultiSource/Applications/lua/lua: 1.25% (21.7374 => 22.0094, std.dev.: 0.0771) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.91% (10.6247 => 2.0281, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.75% (2.9442 => 0.9200, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.21% (91.8497 => 49.4031, std.dev.: 10.6205) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.55% (26.0616 => 17.0571, std.dev.: 0.0918) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.31% (50.3031 => 33.0461, std.dev.: 0.2564) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.26% (42.1466 => 28.9698, std.dev.: 0.3670) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1040) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.26% (2.7002 => 2.5042, std.dev.: 0.0727) SingleSource/Benchmarks/Dhrystone/fldry: -7.05% (0.6240 => 0.5800, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.02% (5.1563 => 5.0523, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3561 => 2.3161, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 19:29:11 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 19:29:11 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423022942.A6F134FD6E03@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14730 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206936 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17800 of 17801) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17801 of 17801) 1 warning(s) in tests. Testing Time: 354.07s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17651 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Tue Apr 22 19:42:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 21:42:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140423024252.446092A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24833?compare_to=24823&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24833, Order: 206921, Start Time: 2014-04-22 22:03:15, End Time: 2014-04-23 02:49:31 To: 24823, Order: 206901, Start Time: 2014-04-22 16:55:03, End Time: 2014-04-22 21:41:06 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (148 on baseline) Performance Improvements: 5 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (930 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C/PR491: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 40.00% (0.0400 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 20.00% (0.0600 => 0.0720, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.67% (0.0960 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 6.67% (0.2400 => 0.2560, std.dev.: 0.0045) MultiSource/Applications/hbd/hbd: 3.19% (1.7560 => 1.8120, std.dev.: 0.0166) SingleSource/Benchmarks/Stanford/Puzzle: 1.34% (1.7921 => 1.8161, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.33% (12.3120 => 12.4760, std.dev.: 0.0528) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.94% (0.9721 => 1.0201, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.22% (5.4123 => 5.5323, std.dev.: 0.0343) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.94% (1.0321 => 1.0121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.86% (2.1521 => 2.1121, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.38% (2.0281 => 2.0001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.32% (2.1281 => 2.1001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.26% (2.2201 => 2.1921, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.27% (17.6723 => 19.6643, std.dev.: 0.0864) MultiSource/Applications/sqlite3/sqlite3: 1419.30% (1.7001 => 25.8296, std.dev.: 0.0282) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.61% (50.1010 => 51.9090, std.dev.: 0.0517) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (1.0520 => 1.0680, std.dev.: 0.0408) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.52% (11.3920 => 12.4760, std.dev.: 0.0528) SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3407 => 3.0242, std.dev.: 0.0159) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0083, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7164, std.dev.: 0.0144) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0043) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/cast-bug: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0057) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 20.00% (0.0600 => 0.0720, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 14.29% (0.1400 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.55% (1.8601 => 2.1121, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.32% (1.9521 => 2.2121, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.50% (0.4160 => 0.4680, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.94% (2.1441 => 2.4001, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.93% (2.1121 => 2.3641, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.54% (1.9761 => 2.2041, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.55% (1.8201 => 2.0121, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.53% (1.9001 => 2.1001, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.27% (2.1041 => 2.3201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.19% (1.8441 => 2.0321, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0145) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0038) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.8760 => 2.0560, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0183) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.11% (0.7400 => 0.8000, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.6960 => 1.8120, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.78% (0.7080 => 0.7560, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (6.4800 => 6.9040, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.8440 => 1.9640, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 5.42% (1.7721 => 1.8681, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.4480 => 0.4720, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9960 => 1.0480, std.dev.: 0.0198) MultiSource/Applications/hbd/hbd: 4.86% (1.7280 => 1.8120, std.dev.: 0.0166) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (2.9721 => 3.1162, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.81% (1.7480 => 1.8320, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.58% (9.6042 => 10.0442, std.dev.: 0.0610) MultiSource/Applications/sgefa/sgefa: 4.55% (0.6160 => 0.6440, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.47% (6.5320 => 6.8240, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.39% (5.8281 => 6.0841, std.dev.: 0.0286) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.2283 => 10.6484, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.09% (1.5640 => 1.6280, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (6.5360 => 6.7640, std.dev.: 0.0400) MultiSource/Applications/lua/lua: 3.42% (4.7920 => 4.9560, std.dev.: 0.0298) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (5.3960 => 5.5800, std.dev.: 0.0356) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (16.3003 => 16.8203, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 2.90% (0.8280 => 0.8520, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 2.77% (22.2206 => 22.8367, std.dev.: 0.0668) MultiSource/Benchmarks/Bullet/bullet: 2.68% (38.6366 => 39.6726, std.dev.: 0.0508) MultiSource/Applications/SPASS/SPASS: 2.66% (18.5284 => 19.0204, std.dev.: 0.0356) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (2.1600 => 2.2160, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.39% (1.5040 => 1.5400, std.dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 2.38% (7.0524 => 7.2205, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.34% (1.0241 => 1.0481, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0158) MultiSource/Applications/kimwitu++/kc: 1.49% (19.8291 => 20.1251, std.dev.: 0.0361) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (13.0363 => 13.1803, std.dev.: 0.0270) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.91% (2.1201 => 2.4362, std.dev.: 0.0547) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 3.09% (6.5964 => 6.8004, std.dev.: 0.0601) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.14% (5.4163 => 5.5323, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.96% (4.4803 => 4.5683, std.dev.: 0.0330) MultiSource/Applications/hexxagon/hexxagon: 1.95% (11.4967 => 11.7207, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.58% (4.8043 => 4.8803, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (3.9442 => 3.9962, std.dev.: 0.0105) MultiSource/Applications/SPASS/SPASS: 1.12% (9.2446 => 9.3486, std.dev.: 0.0310) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.02% (94.8339 => 49.2951, std.dev.: 10.7020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.04% (49.9431 => 32.9421, std.dev.: 0.1659) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.62% (25.7136 => 17.0691, std.dev.: 0.1150) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.92% (3.0722 => 2.3681, std.dev.: 0.1141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.66% (37.0863 => 28.6818, std.dev.: 0.4916) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0053) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.89% (1.2681 => 1.1681, std.dev.: 0.0158) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 19:49:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 21:49:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423024936.039F12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24834?compare_to=24824&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24834, Order: 206922, Start Time: 2014-04-22 22:09:08, End Time: 2014-04-23 02:56:14 To: 24824, Order: 206902, Start Time: 2014-04-22 16:59:30, End Time: 2014-04-22 21:46:57 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/stmtexpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Treesort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Oscar: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: 2.74% (0.5840 => 0.6000, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.70% (2.0720 => 2.1280, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (2.1400 => 2.1840, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.89% (1.0601 => 1.0801, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 27.27% (0.0440 => 0.0560, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.35% (0.8521 => 0.8721, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -20.88% (0.7280 => 0.5760, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 20:00:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 22:00:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140423030044.994592A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24835?compare_to=24825&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24835, Order: 206923, Start Time: 2014-04-22 22:18:20, End Time: 2014-04-23 03:07:24 To: 24825, Order: 206904, Start Time: 2014-04-22 17:06:56, End Time: 2014-04-22 21:56:03 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (147 on baseline) Performance Improvements: 4 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (927 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/TestLoop: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C/2003-05-22-VarSizeArray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.29% (0.0840 => 0.0960, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 9.09% (0.2200 => 0.2400, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.35% (0.2520 => 0.2680, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.15% (0.2600 => 0.2760, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.33% (0.3600 => 0.3720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (1.7800 => 1.8200, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.96% (2.0401 => 2.0001, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.83% (2.1841 => 2.1441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.64% (2.1921 => 2.1561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.34% (2.0921 => 2.0641, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Puzzle: 301.78% (0.4560 => 1.8321, std.dev.: 0.0073) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0135) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.90% (1.6681 => 2.0001, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.86% (1.6721 => 2.0041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.46% (1.7681 => 2.1121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.30% (1.8361 => 2.1721, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/15-trie/trie: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.29% (0.0840 => 0.0960, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0303) MultiSource/Applications/viterbi/viterbi: 13.21% (0.2120 => 0.2400, std.dev.: 0.0074) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 9.02% (1.0200 => 1.1120, std.dev.: 0.0187) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0075) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.06% (0.2480 => 0.2680, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0483) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (6.7200 => 7.1880, std.dev.: 0.0430) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.77% (1.2400 => 1.3240, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.45% (11.7880 => 12.5480, std.dev.: 0.0502) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.15% (0.2600 => 0.2760, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.7200 => 0.7640, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.7280 => 1.8320, std.dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (1.4160 => 1.5000, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0219) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.59% (0.6440 => 0.6800, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.7400 => 0.7800, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 5.26% (4.7920 => 5.0440, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (9.9842 => 10.4762, std.dev.: 0.0321) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0147) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0245) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.1440 => 1.1920, std.dev.: 0.0155) MultiSource/Applications/oggenc/oggenc: 4.11% (6.9124 => 7.1964, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (6.8321 => 7.1041, std.dev.: 0.0422) MultiSource/Applications/JM/ldecod/ldecod: 3.88% (10.3203 => 10.7204, std.dev.: 0.0449) MultiSource/Applications/SPASS/SPASS: 3.31% (18.4924 => 19.1045, std.dev.: 0.0502) MultiSource/Applications/JM/lencod/lencod: 3.27% (22.6287 => 23.3688, std.dev.: 0.0564) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0215) MultiSource/Applications/treecc/treecc: 3.05% (2.6200 => 2.7000, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (3.0122 => 3.1002, std.dev.: 0.0118) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.91% (51.1089 => 52.5969, std.dev.: 0.0617) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.8440 => 0.8680, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 2.70% (38.9366 => 39.9886, std.dev.: 0.0835) MultiSource/Applications/ClamAV/clamscan: 2.53% (20.2445 => 20.7565, std.dev.: 0.0735) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.5480 => 5.6880, std.dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0119) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: 2.33% (19.7371 => 20.1971, std.dev.: 0.0570) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.12% (16.5963 => 16.9483, std.dev.: 0.0505) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (2.2721 => 2.3201, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 1.99% (25.1895 => 25.6896, std.dev.: 0.0363) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.79% (6.0244 => 6.1324, std.dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 17.67% (0.9281 => 1.0921, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0220) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0146) SingleSource/Benchmarks/McGill/queens: 3.86% (2.1761 => 2.2601, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0519) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.21% (0.9961 => 1.0281, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 2.01% (21.6534 => 22.0894, std.dev.: 0.1665) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.60% (4.4883 => 4.5603, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (1.3681 => 1.3881, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (2.5322 => 2.5602, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.83% (6.2884 => 0.8280, std.dev.: 0.0181) SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: -23.68% (0.7600 => 0.5800, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: -21.91% (2.6481 => 2.0680, std.dev.: 0.0281) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.04% (7.4801 => 6.2800, std.dev.: 0.0572) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.62% (7.5041 => 6.3320, std.dev.: 0.0418) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: -2.40% (13.5243 => 13.2003, std.dev.: 0.0291) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.77% (21.6534 => 17.8051, std.dev.: 0.0626) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -8.19% (3.4682 => 3.1842, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0055) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -2.36% (8.3085 => 8.1125, std.dev.: 0.0462) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.14% (2.6202 => 2.5642, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -1.24% (2.9122 => 2.8762, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.06% (4.1323 => 4.0883, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 20:01:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 22:01:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140423030139.561772A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24836?compare_to=24826&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24836, Order: 206924, Start Time: 2014-04-22 22:20:36, End Time: 2014-04-23 03:08:18 To: 24826, Order: 206904, Start Time: 2014-04-22 17:11:11, End Time: 2014-04-22 21:58:41 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 18 (159 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/recursive-throw: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 45.45% (0.0440 => 0.0640, std.dev.: 0.0061) SingleSource/Regression/C/casts: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.05% (0.0840 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.06% (0.2880 => 0.3400, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 10.34% (0.1160 => 0.1280, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.71% (0.6560 => 0.7000, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 2.56% (2.6560 => 2.7240, std.dev.: 0.0217) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.54% (1.5601 => 1.5841, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.32% (1.5121 => 1.5321, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.46% (0.2960 => 0.3240, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.8601 => 0.8801, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.97% (0.6080 => 0.6200, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0066) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0076) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 979.08% (0.0760 => 0.8201, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0120) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 203.17% (0.2520 => 0.7640, std.dev.: 0.0106) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0067) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0057) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0054) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 60.00% (0.0800 => 0.1280, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 45.45% (0.0440 => 0.0640, std.dev.: 0.0044) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: 42.53% (1.3920 => 1.9840, std.dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0064) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 30.27% (1.2160 => 1.5841, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.95% (1.2321 => 1.5641, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.13% (1.2401 => 1.5641, std.dev.: 0.0107) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.75% (1.2481 => 1.5321, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.45% (1.1401 => 1.3961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.30% (1.1841 => 1.4481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.84% (1.3001 => 1.5841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.45% (1.2321 => 1.4841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 19.21% (8.5802 => 10.2283, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.94% (1.2881 => 1.5321, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.53% (1.1441 => 1.3561, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.50% (1.3841 => 1.6401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0116) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0148) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 15.70% (19.5406 => 22.6087, std.dev.: 0.0585) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.77% (5.3360 => 6.1241, std.dev.: 0.0277) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0206) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 11.61% (0.4480 => 0.5000, std.dev.: 0.0150) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.11% (0.1800 => 0.2000, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 9.38% (11.3843 => 12.4523, std.dev.: 0.0374) SingleSource/Benchmarks/Misc/oourafft: 9.33% (0.3000 => 0.3280, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.32% (5.6680 => 6.1960, std.dev.: 0.0326) MultiSource/Applications/oggenc/oggenc: 9.29% (6.2844 => 6.8684, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.94% (5.7280 => 6.2400, std.dev.: 0.0504) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.07% (11.4440 => 12.3680, std.dev.: 0.0719) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.02% (0.6480 => 0.7000, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (9.5802 => 10.2282, std.dev.: 0.0441) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.98% (0.7360 => 0.7800, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.4760 => 1.5520, std.dev.: 0.0275) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.14% (1.3240 => 1.3920, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0462) MultiSource/Applications/lua/lua: 3.94% (4.7720 => 4.9600, std.dev.: 0.0355) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.6961 => 1.7601, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (5.3840 => 5.5800, std.dev.: 0.0440) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.29% (49.1529 => 50.7689, std.dev.: 0.1194) MultiSource/Applications/ClamAV/clamscan: 3.27% (19.2243 => 19.8524, std.dev.: 0.0467) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.4320 => 1.4760, std.dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 3.01% (24.7575 => 25.5015, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0127) MultiSource/Applications/treecc/treecc: 2.87% (2.6480 => 2.7240, std.dev.: 0.0217) MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (2.7282 => 2.8042, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 2.17% (19.7491 => 20.1771, std.dev.: 0.0257) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0174) MultiSource/Benchmarks/Bullet/bullet: 1.53% (39.0726 => 39.6686, std.dev.: 0.0918) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.40% (6.0124 => 6.0964, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (16.7083 => 16.9323, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 1.28% (18.7966 => 19.0366, std.dev.: 0.0443) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.20% (29.3298 => 29.6819, std.dev.: 0.0440) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.18% (0.9241 => 1.0921, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.84% (1.2401 => 1.4241, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.63% (3.9842 => 4.2883, std.dev.: 0.0202) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.28% (0.8281 => 0.8801, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0272) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0319) MultiSource/Applications/minisat/minisat: 4.11% (6.8204 => 7.1004, std.dev.: 0.0325) SingleSource/Benchmarks/McGill/queens: 3.30% (2.1801 => 2.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 2.56% (4.0563 => 4.1603, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0390) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (25.4536 => 25.9056, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0150) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-10-13-BadLoad: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.63% (11.0207 => 2.0241, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.75% (21.6534 => 17.8091, std.dev.: 0.0587) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -8.76% (3.4722 => 3.1682, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0770) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 20:08:01 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 20:08:01 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423031025.6D3A94FD72AA@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14731 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206937 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.ModuleIsIn (17800 of 17801) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17801 of 17801) 1 warning(s) in tests. Testing Time: 365.62s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17651 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Tue Apr 22 20:48:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 22:48:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423034859.D26D42A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24837?compare_to=24831&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24837, Order: 206924, Start Time: 2014-04-22 23:08:44, End Time: 2014-04-23 03:55:39 To: 24831, Order: 206920, Start Time: 2014-04-22 21:33:37, End Time: 2014-04-23 02:13:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 20 (113 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Perm: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_shift: 44.44% (0.0360 => 0.0520, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 11.76% (0.2040 => 0.2280, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2160 => 0.2320, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.3240 => 0.3400, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.12% (0.6800 => 0.7080, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (1.7600 => 1.8280, std.dev.: 0.0168) MultiSource/Applications/obsequi/Obsequi: 3.49% (1.2600 => 1.3040, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash2: 2.46% (0.4880 => 0.5000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.19% (1.2761 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.49% (1.3441 => 1.3641, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (5.9880 => 6.0680, std.dev.: 0.0263) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (10.7322 => 10.8402, std.dev.: 0.0333) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.65% (3.9442 => 4.0883, std.dev.: 0.0527) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.87% (4.7003 => 4.7883, std.dev.: 0.0340) MultiSource/Benchmarks/BitBench/five11/five11: 1.04% (2.3121 => 2.3361, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -1.16% (3.4602 => 3.4202, std.dev.: 0.0119) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C/callargs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/em3d/em3d: 14.00% (0.2000 => 0.2280, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.39% (1.2321 => 1.3601, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2160 => 0.2320, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0534) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0454) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (1.5200 => 1.6160, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.3200 => 0.3400, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (1.7360 => 1.8280, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (5.8000 => 6.0680, std.dev.: 0.0263) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.19% (0.7640 => 0.7960, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0320) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (10.4082 => 10.8402, std.dev.: 0.0333) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 3.26% (7.8562 => 8.1122, std.dev.: 0.0355) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0591) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0122) MultiSource/Applications/obsequi/Obsequi: 3.16% (1.2640 => 1.3040, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0332) MultiSource/Benchmarks/Bullet/bullet: 2.61% (37.0925 => 38.0605, std.dev.: 0.0566) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0088) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.28% (48.1088 => 49.2050, std.dev.: 0.1034) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (2.5882 => 2.6402, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0477) MultiSource/Benchmarks/nbench/nbench: 1.92% (1.2480 => 1.2720, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1451, std.dev.: 0.0379) MultiSource/Applications/SPASS/SPASS: 1.48% (17.5484 => 17.8084, std.dev.: 0.0396) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (15.2282 => 15.3922, std.dev.: 0.0572) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0102) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.76% (1.0881 => 1.2161, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.84% (21.1533 => 22.1774, std.dev.: 0.1916) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (25.8896 => 26.7897, std.dev.: 0.0445) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0162) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0250) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 21:13:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 23:13:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423041326.152272A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24838?compare_to=24837&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24838, Order: 206925, Start Time: 2014-04-22 23:35:59, End Time: 2014-04-23 04:20:03 To: 24837, Order: 206924, Start Time: 2014-04-22 23:08:44, End Time: 2014-04-23 03:55:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (104 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 10.00% (0.2000 => 0.2200, std.dev.: 0.0061) MultiSource/Applications/viterbi/viterbi: 8.33% (0.1920 => 0.2080, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.20% (0.2440 => 0.2640, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 5.36% (0.2240 => 0.2360, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.5240 => 0.5360, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.35% (0.9561 => 0.9881, std.dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (2.6402 => 2.6082, std.dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0066) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.55% (0.2200 => 0.2520, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.00% (10.6960 => 11.5520, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0451) MultiSource/Applications/lua/lua: 5.40% (4.5200 => 4.7640, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0448) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0505) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0473) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0321) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0161) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0597) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0472) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.37% (48.1088 => 49.2490, std.dev.: 0.0743) MultiSource/Benchmarks/Bullet/bullet: 2.35% (37.0925 => 37.9645, std.dev.: 0.0670) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0082) MultiSource/Applications/kimwitu++/kc: 1.91% (18.8170 => 19.1770, std.dev.: 0.0277) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0464) MultiSource/Applications/SPASS/SPASS: 1.62% (17.5484 => 17.8324, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (15.2282 => 15.4522, std.dev.: 0.0359) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 1.01% (17.4082 => 17.5842, std.dev.: 0.0443) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0157) MultiSource/Applications/lua/lua: 4.99% (21.1533 => 22.2094, std.dev.: 0.0709) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (5.0123 => 5.0963, std.dev.: 0.0157) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0106) MultiSource/Applications/minisat/minisat: 1.08% (6.6564 => 6.7284, std.dev.: 0.0260) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0067) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.35% (2.0681 => 2.0401, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 21:33:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Apr 2014 23:33:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423043325.6CAFF2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24839?compare_to=24838&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24839, Order: 206929, Start Time: 2014-04-22 23:56:25, End Time: 2014-04-23 04:40:04 To: 24838, Order: 206925, Start Time: 2014-04-22 23:35:59, End Time: 2014-04-23 04:20:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (106 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-08-BitOpsTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.34% (1.0720 => 1.1400, std.dev.: 0.0251) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.64% (1.2120 => 1.2440, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0107) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0442) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0741) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0442) MultiSource/Applications/lua/lua: 4.96% (4.5200 => 4.7440, std.dev.: 0.0277) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (4.9200 => 5.1240, std.dev.: 0.0363) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0470) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0379) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0160) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0521) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0626) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.5480 => 1.5920, std.dev.: 0.0158) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0460) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: 2.30% (37.0925 => 37.9446, std.dev.: 0.0557) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.30% (48.1088 => 49.2129, std.dev.: 0.0820) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.9480 => 0.9680, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0321) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0197) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1490, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.31% (15.2282 => 15.4282, std.dev.: 0.0417) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0542) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 5.16% (21.1533 => 22.2454, std.dev.: 0.1168) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0579) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -21.05% (0.0760 => 0.0600, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0068) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0093) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -1.10% (2.9082 => 2.8762, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 21:41:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 21:41:35 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140423044217.2648F4FD7C7D@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19170 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206938 Blamelist: chandlerc BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 21:49:39 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 21:49:39 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423045008.DEE724FD7D82@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14732 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206938 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17800 of 17801) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17801 of 17801) 1 warning(s) in tests. Testing Time: 412.30s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17651 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Tue Apr 22 23:04:02 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 22 Apr 2014 23:04:02 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423060421.0209D4FD8739@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14733 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206946 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17800 of 17801) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17801 of 17801) 1 warning(s) in tests. Testing Time: 377.92s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17651 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Tue Apr 22 23:00:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 01:00:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423060001.78DAC2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24840?compare_to=24839&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24840, Order: 206934, Start Time: 2014-04-23 01:25:38, End Time: 2014-04-23 06:06:39 To: 24839, Order: 206929, Start Time: 2014-04-22 23:56:25, End Time: 2014-04-23 04:40:04 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (110 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-4: 66.67% (0.0240 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: 13.79% (0.1160 => 0.1320, std.dev.: 0.0027) MultiSource/Applications/obsequi/Obsequi: 2.19% (1.2800 => 1.3080, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (5.0000 => 5.0520, std.dev.: 0.0195) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (6.0160 => 6.4600, std.dev.: 0.0357) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.3200 => 0.3400, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0226) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0298) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0206) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0391) MultiSource/Applications/obsequi/Obsequi: 3.48% (1.2640 => 1.3080, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0456) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (7.8562 => 8.1002, std.dev.: 0.0277) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0519) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0315) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0458) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0067) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.02% (48.1088 => 49.0809, std.dev.: 0.1248) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8165, std.dev.: 0.0731) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0145) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0850, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (15.2282 => 15.4322, std.dev.: 0.0542) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0154) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0534) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 1.01% (17.4082 => 17.5842, std.dev.: 0.0580) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0209) MultiSource/Applications/lua/lua: 4.95% (21.1533 => 22.2014, std.dev.: 0.0580) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0167) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0310) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (0.9601 => 0.9841, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0242) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0022) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 22 23:51:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 01:51:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423065151.BC9E12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24841?compare_to=24840&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24841, Order: 206937, Start Time: 2014-04-23 02:18:34, End Time: 2014-04-23 06:58:29 To: 24840, Order: 206934, Start Time: 2014-04-23 01:25:38, End Time: 2014-04-23 06:06:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (111 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/div: 80.00% (0.0200 => 0.0360, std.dev.: 0.0020) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 13.33% (0.1200 => 0.1360, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.6560 => 0.6880, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.4240 => 0.4400, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4440 => 0.4560, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.87% (5.9800 => 6.0920, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.61% (1.2401 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.55% (1.2881 => 1.3081, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.69% (0.1160 => 0.1400, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.45% (3.9562 => 4.1323, std.dev.: 0.0576) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.26% (1.1041 => 1.1401, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0107) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0568) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0380) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (5.8000 => 6.0920, std.dev.: 0.0194) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0465) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0238) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (4.9000 => 5.0720, std.dev.: 0.0231) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0388) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0572) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0564) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0311) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0503) MultiSource/Benchmarks/Bullet/bullet: 2.28% (37.0925 => 37.9366, std.dev.: 0.0809) MultiSource/Applications/sqlite3/sqlite3: 2.27% (23.7574 => 24.2975, std.dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.6321 => 1.6641, std.dev.: 0.0101) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.87% (48.1088 => 49.0089, std.dev.: 0.1041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (15.2282 => 15.4922, std.dev.: 0.0437) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1130, std.dev.: 0.0302) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0255) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 400.00% (0.0040 => 0.0200, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 4.90% (21.1533 => 22.1894, std.dev.: 0.0909) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.40% (1.0921 => 1.1401, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (25.8896 => 26.7977, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0091) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0615) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 00:07:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 02:07:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423070736.1754F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24842?compare_to=24832&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24842, Order: 206937, Start Time: 2014-04-23 02:31:24, End Time: 2014-04-23 07:14:16 To: 24832, Order: 206920, Start Time: 2014-04-22 21:43:47, End Time: 2014-04-23 02:26:29 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 14 (159 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (926 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/tls: 133.33% (0.0120 => 0.0280, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 31.25% (0.0640 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.47% (0.2360 => 0.2560, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 4.58% (0.6120 => 0.6400, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0102) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0131) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 294.80% (0.4600 => 1.8161, std.dev.: 0.0104) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0059) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.36% (1.0240 => 1.2120, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0064) SingleSource/Regression/C/test_indvars: 17.39% (0.0920 => 0.1080, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.13% (0.1240 => 0.1440, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.87% (0.2520 => 0.2920, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.2360 => 0.2640, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.80% (1.4241 => 1.5921, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.36% (0.1760 => 0.1960, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.76% (1.5241 => 1.6881, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0140) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: 9.64% (1.8680 => 2.0480, std.dev.: 0.0157) MultiSource/Applications/sgefa/sgefa: 9.59% (0.5840 => 0.6400, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.44% (1.4401 => 1.5761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 9.09% (0.2200 => 0.2400, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (1.1640 => 1.2520, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.99% (6.4680 => 6.9200, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.95% (1.6121 => 1.7241, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.94% (11.6440 => 12.4520, std.dev.: 0.0567) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.82% (1.5841 => 1.6921, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.78% (0.2360 => 0.2520, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.41% (9.4842 => 10.0922, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: 5.95% (1.0080 => 1.0680, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0130) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.52% (1.7401 => 1.8361, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (5.8121 => 6.1321, std.dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0187) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.7400 => 1.8280, std.dev.: 0.0218) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.86% (6.5080 => 6.8240, std.dev.: 0.0355) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.65% (6.5440 => 6.8480, std.dev.: 0.0468) MultiSource/Applications/JM/lencod/lencod: 4.63% (21.9606 => 22.9768, std.dev.: 0.0317) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (5.3600 => 5.6080, std.dev.: 0.0350) MultiSource/Applications/JM/ldecod/ldecod: 4.54% (10.0443 => 10.5003, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 4.26% (4.7880 => 4.9920, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0296) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0104) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.77% (50.0290 => 51.9130, std.dev.: 0.0853) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 3.69% (38.4046 => 39.8206, std.dev.: 0.0586) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (16.3483 => 16.8923, std.dev.: 0.0485) MultiSource/Applications/treecc/treecc: 3.25% (2.5840 => 2.6680, std.dev.: 0.0208) MultiSource/Applications/siod/siod: 3.24% (2.7162 => 2.8042, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 3.13% (19.0444 => 19.6404, std.dev.: 0.0515) MultiSource/Applications/SPASS/SPASS: 3.12% (18.4404 => 19.0166, std.dev.: 0.0699) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0148) MultiSource/Applications/d/make_dparser: 2.72% (3.9681 => 4.0761, std.dev.: 0.0261) MultiSource/Applications/kimwitu++/kc: 2.52% (19.6891 => 20.1851, std.dev.: 0.0285) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (6.1044 => 6.1804, std.dev.: 0.0196) MultiSource/Applications/sqlite3/sqlite3: 1.18% (25.6856 => 25.9896, std.dev.: 0.0375) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0563 => 13.1963, std.dev.: 0.0285) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.96% (2.1401 => 2.4602, std.dev.: 0.0443) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0145) MultiSource/Benchmarks/llubenchmark/llu: 3.91% (5.1123 => 5.3123, std.dev.: 0.0513) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (4.5603 => 4.7163, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 3.13% (7.4205 => 7.6525, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0205) MultiSource/Applications/minisat/minisat: 2.28% (6.6684 => 6.8204, std.dev.: 0.0253) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.5087 => 11.7207, std.dev.: 0.0199) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 1.38% (21.7374 => 22.0374, std.dev.: 0.1064) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 1.13% (8.1245 => 8.2165, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.99% (10.6247 => 2.0201, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.43% (2.9442 => 0.9000, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.43% (91.8497 => 49.2031, std.dev.: 10.1625) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.26% (26.0616 => 17.1331, std.dev.: 0.0640) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.17% (50.3031 => 33.1141, std.dev.: 0.1393) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -33.17% (42.1466 => 28.1658, std.dev.: 0.6956) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1124) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0162) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0066) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0340) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.83% (4.8083 => 4.6723, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0165) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.45% (4.1243 => 4.0643, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 00:34:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 02:34:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140423073401.CCF2B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24843?compare_to=24833&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24843, Order: 206937, Start Time: 2014-04-23 02:54:24, End Time: 2014-04-23 07:40:34 To: 24833, Order: 206921, Start Time: 2014-04-22 22:03:15, End Time: 2014-04-23 02:49:31 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 7 (136 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3520 => 0.3760, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 3.15% (0.5080 => 0.5240, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 1.59% (4.0281 => 4.0921, std.dev.: 0.0232) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 4.48% (0.2680 => 0.2800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.73% (3.5122 => 3.6082, std.dev.: 0.0348) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.43% (17.6723 => 19.6924, std.dev.: 0.0686) MultiSource/Applications/sqlite3/sqlite3: 1422.59% (1.7001 => 25.8856, std.dev.: 0.0459) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.37% (50.1010 => 51.7890, std.dev.: 0.0776) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (1.0520 => 1.1080, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (11.3920 => 12.3560, std.dev.: 0.0762) SingleSource/Benchmarks/Misc/oourafft: -73.19% (11.3407 => 3.0402, std.dev.: 0.0061) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9962, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0112) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0080) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.66% (1.8281 => 2.0961, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.58% (0.1920 => 0.2200, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.16% (1.8361 => 2.0961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.16% (1.8081 => 2.0641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.07% (1.8201 => 2.0761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.86% (2.1361 => 2.4322, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.76% (1.8601 => 2.1161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.30% (1.9241 => 2.1801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.01% (1.8761 => 2.1201, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.50% (0.0960 => 0.1080, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.94% (2.1441 => 2.4001, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.50% (1.8081 => 2.0161, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.21% (1.9201 => 2.1161, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.19% (1.8441 => 2.0321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.00% (1.8801 => 2.0681, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.89% (1.8201 => 2.0001, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0107) MultiSource/Applications/obsequi/Obsequi: 9.81% (1.8760 => 2.0600, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.8361 => 2.0161, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.68% (1.8601 => 2.0401, std.dev.: 0.0154) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.62% (0.4160 => 0.4560, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.48% (2.0681 => 2.2641, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 7.09% (1.0160 => 1.0880, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (6.4800 => 6.9120, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (1.6960 => 1.8080, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.4480 => 0.4720, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 5.32% (1.7280 => 1.8200, std.dev.: 0.0199) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0063) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (6.5320 => 6.8480, std.dev.: 0.0347) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (5.8281 => 6.1001, std.dev.: 0.0249) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.2283 => 10.6964, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0537) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (1.2120 => 1.2600, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (5.3960 => 5.5800, std.dev.: 0.0454) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0093) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.25% (0.6160 => 0.6360, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.7480 => 1.8040, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (6.5360 => 6.7440, std.dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (16.3003 => 16.7923, std.dev.: 0.0817) MultiSource/Applications/JM/lencod/lencod: 2.95% (22.2206 => 22.8767, std.dev.: 0.0719) MultiSource/Applications/d/make_dparser: 2.92% (3.9761 => 4.0921, std.dev.: 0.0232) MultiSource/Applications/treecc/treecc: 2.78% (2.5880 => 2.6600, std.dev.: 0.0233) MultiSource/Applications/SPASS/SPASS: 2.76% (18.5284 => 19.0405, std.dev.: 0.0473) MultiSource/Applications/lua/lua: 2.75% (4.7920 => 4.9240, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0213) MultiSource/Benchmarks/Bullet/bullet: 2.60% (38.6366 => 39.6406, std.dev.: 0.0496) MultiSource/Applications/oggenc/oggenc: 2.55% (7.0524 => 7.2325, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0132) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0141) MultiSource/Applications/kimwitu++/kc: 1.37% (19.8291 => 20.1011, std.dev.: 0.0842) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.97% (2.1201 => 2.4162, std.dev.: 0.0510) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.15% (6.5964 => 6.8044, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.80% (3.7122 => 3.8162, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.70% (11.4967 => 11.6927, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (4.0003 => 4.0683, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.50% (4.8043 => 4.8763, std.dev.: 0.0108) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9684 => 6.0484, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9442 => 3.9842, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.75% (1.5881 => 1.0521, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.84% (94.8339 => 49.4631, std.dev.: 10.3604) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.71% (49.9431 => 33.1061, std.dev.: 0.1701) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.37% (25.7136 => 17.1331, std.dev.: 0.0921) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.01% (37.0863 => 28.5538, std.dev.: 0.5801) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.25% (1.2681 => 1.1761, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0280) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 00:41:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 02:41:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423074125.3C84B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24844?compare_to=24834&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24844, Order: 206937, Start Time: 2014-04-23 03:01:09, End Time: 2014-04-23 07:48:02 To: 24834, Order: 206922, Start Time: 2014-04-22 22:09:08, End Time: 2014-04-23 02:56:14 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/UnitTests/Vector/sumarray-dbl: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.29% (0.0840 => 0.0960, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3000 => 0.3120, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (0.3240 => 0.3360, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 1.19% (2.7000 => 2.7320, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 7.06% (1.0761 => 1.1521, std.dev.: 0.0207) MultiSource/Applications/sgefa/sgefa: 2.31% (0.5200 => 0.5320) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -14.81% (0.1080 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.22% (1.0801 => 1.0561, std.dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.33% (0.2280 => 0.5320) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 00:52:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 02:52:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140423075238.7675F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24845?compare_to=24836&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24845, Order: 206937, Start Time: 2014-04-23 03:11:53, End Time: 2014-04-23 07:59:10 To: 24836, Order: 206924, Start Time: 2014-04-22 22:20:36, End Time: 2014-04-23 03:08:18 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 12 (161 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 12.50% (0.1280 => 0.1440, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 4.11% (0.2920 => 0.3040, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.80% (0.7360 => 0.7640, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (0.5680 => 0.5880, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (1.0240 => 1.0520, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.31% (1.5321 => 1.5521, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0323 => 4.0843, std.dev.: 0.0183) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/garage/garage: -15.79% (0.0760 => 0.0640, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0102) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0095) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 979.08% (0.0760 => 0.8201, std.dev.: 0.0090) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0118) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 188.89% (0.2520 => 0.7280, std.dev.: 0.0169) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0049) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 92.31% (0.1040 => 0.2000, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0051) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0054) SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0057) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0184) MultiSource/Applications/obsequi/Obsequi: 45.69% (1.3920 => 2.0280, std.dev.: 0.0226) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/treeadd/treeadd: 33.33% (0.0480 => 0.0640, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.00% (1.2321 => 1.5401, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.00% (1.2001 => 1.4761, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.07% (1.1761 => 1.4121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.86% (1.1881 => 1.4241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.81% (1.2521 => 1.5001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.79% (1.1321 => 1.3561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 18.93% (8.5802 => 10.2043, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.21% (1.3841 => 1.6361, std.dev.: 0.0111) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/distray/distray: 16.67% (0.1200 => 0.1400, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 15.50% (19.5406 => 22.5687, std.dev.: 0.0631) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.62% (5.3360 => 6.1161, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.6800 => 0.7640, std.dev.: 0.0086) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0271) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 10.71% (0.4480 => 0.4960, std.dev.: 0.0149) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 9.43% (0.2120 => 0.2320, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 9.03% (11.3843 => 12.4123, std.dev.: 0.0574) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.66% (5.7280 => 6.2240, std.dev.: 0.0454) MultiSource/Applications/oggenc/oggenc: 8.59% (6.2844 => 6.8244, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.33% (0.4320 => 0.4680, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.04% (11.4440 => 12.3640, std.dev.: 0.0672) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.7640 => 0.8240, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.27% (5.6680 => 6.0800, std.dev.: 0.0616) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.18% (9.5802 => 10.2682, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.4760 => 1.5760, std.dev.: 0.0255) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 4.69% (4.7720 => 4.9960, std.dev.: 0.0256) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0066) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0448) MultiSource/Benchmarks/MallocBench/gs/gs: 3.79% (5.3840 => 5.5880, std.dev.: 0.0474) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.7440 => 0.7720, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0119) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (49.1529 => 50.8329, std.dev.: 0.1076) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.6961 => 1.7521, std.dev.: 0.0122) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (1.3400 => 1.3840, std.dev.: 0.0169) MultiSource/Applications/sqlite3/sqlite3: 3.26% (24.7575 => 25.5656, std.dev.: 0.0224) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0111) MultiSource/Applications/ClamAV/clamscan: 3.00% (19.2243 => 19.8004, std.dev.: 0.0486) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: 2.87% (0.8360 => 0.8600, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (2.0920 => 2.1480, std.dev.: 0.0158) MultiSource/Benchmarks/Bullet/bullet: 1.89% (39.0726 => 39.8126, std.dev.: 0.0887) MultiSource/Applications/kimwitu++/kc: 1.84% (19.7491 => 20.1131, std.dev.: 0.0440) MultiSource/Benchmarks/PAQ8p/paq8p: 1.76% (2.7282 => 2.7762, std.dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 1.47% (18.7966 => 19.0726, std.dev.: 0.0397) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0124 => 6.1004, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.27% (16.7083 => 16.9203, std.dev.: 0.0510) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (29.3298 => 29.6379, std.dev.: 0.0515) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0090) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.33% (3.9842 => 4.2763, std.dev.: 0.0262) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 4.42% (2.9842 => 3.1162, std.dev.: 0.0187) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.00% (1.1001 => 1.1441, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 3.75% (6.8204 => 7.0764, std.dev.: 0.0454) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (5.0963 => 5.2283, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.0563 => 4.1483, std.dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (25.4536 => 25.9136, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.78% (1.3521 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0200 => 0.0000, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -81.78% (11.0207 => 2.0081, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -18.94% (8.9566 => 7.2605, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.86% (0.1120 => 0.0920, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.27% (21.6534 => 17.9131, std.dev.: 0.0279) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -8.64% (3.4722 => 3.1722, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0990) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.05% (4.5123 => 4.2843, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9242 => 2.8362, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0189) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0250) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 00:53:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 02:53:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140423075329.75B5F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24846?compare_to=24835&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24846, Order: 206937, Start Time: 2014-04-23 03:11:00, End Time: 2014-04-23 08:00:03 To: 24835, Order: 206923, Start Time: 2014-04-22 22:18:20, End Time: 2014-04-23 03:07:24 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (144 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 80.00% (0.0200 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/EH/inlined_cleanup: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 26.67% (0.1200 => 0.1520, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.38% (0.1280 => 0.1400, std.dev.: 0.0037) SingleSource/Regression/C/bigstack: 6.98% (0.1720 => 0.1840, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.12% (0.1960 => 0.2080, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.96% (0.4840 => 0.5080, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: 2.13% (2.0680 => 2.1120, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (0.6840 => 0.6960, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (2.0721 => 2.0441, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0047) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0053) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 125.00% (0.0160 => 0.0360, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/heapsort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 26.09% (0.0920 => 0.1160, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.93% (1.7201 => 2.0801, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.81% (1.6961 => 2.0321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.50% (1.7641 => 2.1081, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.18% (1.6681 => 1.9881, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 18.96% (1.6881 => 2.0081, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.84% (1.7201 => 2.0441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.64% (1.8881 => 2.2401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.51% (1.9881 => 2.3561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.8281 => 2.1641, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.30% (1.8361 => 2.1721, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.24% (1.8201 => 2.1521, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.67% (0.1200 => 0.1400, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.36% (1.9801 => 2.3041, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0062) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.42% (0.6120 => 0.6880, std.dev.: 0.0227) MultiSource/Benchmarks/Olden/tsp/tsp: 11.76% (0.1360 => 0.1520, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.09% (11.7880 => 12.6240, std.dev.: 0.0581) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (6.7200 => 7.1760, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.67% (0.7200 => 0.7680, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.45% (1.2400 => 1.3200, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0074) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.83% (0.4800 => 0.5080, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.80% (2.0680 => 2.1880, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.7800 => 0.8240, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.58% (0.8601 => 0.9081, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0149) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.04% (1.3480 => 1.4160, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 5.01% (4.7920 => 5.0320, std.dev.: 0.0319) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (9.9842 => 10.4682, std.dev.: 0.0391) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 4.44% (3.9641 => 4.1401, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0220) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 4.28% (6.9124 => 7.2085, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (2.0440 => 2.1240, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (10.3203 => 10.7044, std.dev.: 0.0315) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 3.55% (18.4924 => 19.1485, std.dev.: 0.0412) MultiSource/Applications/JM/lencod/lencod: 3.48% (22.6287 => 23.4167, std.dev.: 0.0481) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0086) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.98% (51.1089 => 52.6329, std.dev.: 0.1365) MultiSource/Applications/kimwitu++/kc: 2.92% (19.7371 => 20.3131, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (6.8321 => 7.0281, std.dev.: 0.0398) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (16.5963 => 17.0363, std.dev.: 0.0642) MultiSource/Benchmarks/Bullet/bullet: 2.55% (38.9366 => 39.9286, std.dev.: 0.1104) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.5480 => 5.6880, std.dev.: 0.0479) MultiSource/Applications/siod/siod: 2.47% (2.7562 => 2.8242, std.dev.: 0.0124) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 2.22% (25.1895 => 25.7496, std.dev.: 0.0350) MultiSource/Applications/ClamAV/clamscan: 2.13% (20.2445 => 20.6765, std.dev.: 0.0555) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (4.2203 => 4.3083, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 10.18% (2.8282 => 3.1162, std.dev.: 0.0110) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.61% (5.5363 => 5.7364, std.dev.: 0.0772) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 2.76% (6.8204 => 7.0084, std.dev.: 0.0456) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (4.0203 => 4.0923, std.dev.: 0.0170) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0184) SingleSource/Benchmarks/Dhrystone/dry: 1.75% (0.6840 => 0.6960, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 1.75% (7.5485 => 7.6805, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (4.4883 => 4.5563, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 1.47% (5.1603 => 5.2363, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0164) SingleSource/UnitTests/Vector/constpool: -81.37% (10.9087 => 2.0321, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/matrix: -28.12% (0.1280 => 0.0920, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: -27.37% (0.7600 => 0.5520, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.44% (1.5881 => 1.1841, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: -20.24% (2.6481 => 2.1120, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.69% (7.4801 => 6.2320, std.dev.: 0.0400) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.73% (7.5041 => 6.3240, std.dev.: 0.0557) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0040) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -3.16% (13.5243 => 13.0963, std.dev.: 0.0466) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -28.57% (0.0560 => 0.0400, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.31% (21.6534 => 17.9051, std.dev.: 0.0344) SingleSource/Benchmarks/Linpack/linpack-pc: -15.80% (7.8005 => 6.5684, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -8.42% (3.4682 => 3.1762, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -1.75% (11.6527 => 11.4487, std.dev.: 0.0551) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: -1.08% (2.9722 => 2.9402, std.dev.: 0.0123) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 01:03:57 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 01:03:57 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423080433.885434FD9643@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14735 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206949 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17803 of 17804) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17804 of 17804) 1 warning(s) in tests. Testing Time: 424.72s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17654 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 01:46:27 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 01:46:27 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423084647.10BBE4FD9BDB@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14736 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206953 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17806 of 17807) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17807 of 17807) 1 warning(s) in tests. Testing Time: 332.62s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17657 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 01:56:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 03:56:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423085613.EB78C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24847?compare_to=24841&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24847, Order: 206938, Start Time: 2014-04-23 04:16:28, End Time: 2014-04-23 09:02:51 To: 24841, Order: 206937, Start Time: 2014-04-23 02:18:34, End Time: 2014-04-23 06:58:29 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (100 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/conditional-gnu-ext: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Regression/C/test_indvars: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.29% (0.0840 => 0.0960, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.12% (0.2640 => 0.2960, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.47% (0.2360 => 0.2560, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 3.89% (1.6440 => 1.7080, std.dev.: 0.0190) MultiSource/Applications/hexxagon/hexxagon: 3.18% (1.1320 => 1.1680, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.93% (0.1720 => 0.2080, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.64% (1.2121 => 1.2441, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0645) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.16% (1.3641 => 1.4481, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0488) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0463) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0512) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.05% (0.9880 => 1.0280, std.dev.: 0.0145) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0147) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0410) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 3.13% (17.6165 => 18.1685, std.dev.: 0.0537) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0573) MultiSource/Benchmarks/Bullet/bullet: 2.46% (37.0925 => 38.0046, std.dev.: 0.0524) MultiSource/Applications/treecc/treecc: 2.45% (2.4480 => 2.5080, std.dev.: 0.0177) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0700) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0320) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.88% (48.1088 => 49.0128, std.dev.: 0.1118) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0147) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: 1.25% (18.8170 => 19.0530, std.dev.: 0.0661) MultiSource/Applications/SPASS/SPASS: 1.19% (17.5484 => 17.7564, std.dev.: 0.0478) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.56% (0.1800 => 0.2080, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 4.71% (21.1533 => 22.1494, std.dev.: 0.1327) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0331) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0210) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0454) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2403 => 4.1963, std.dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 02:19:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 02:19:35 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423091951.70E934FDA03F@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14737 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206954 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17807 of 17808) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17808 of 17808) 1 warning(s) in tests. Testing Time: 361.14s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17658 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 03:09:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 05:09:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423100917.1D97D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24848?compare_to=24847&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24848, Order: 206946, Start Time: 2014-04-23 05:31:55, End Time: 2014-04-23 10:15:55 To: 24847, Order: 206938, Start Time: 2014-04-23 04:16:28, End Time: 2014-04-23 09:02:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (104 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 50.00% (0.0400 => 0.0600, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bisort/bisort: 25.00% (0.0640 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1560 => 0.1760, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 4.23% (0.2840 => 0.2960, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.49% (1.3441 => 1.3641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.49% (1.3441 => 1.3641, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.16% (1.3761 => 1.3921, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5962 => 2.6242, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.15% (1.3881 => 1.4041, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/conditional-gnu-ext: -75.00% (0.0160 => 0.0040, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0074) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.90% (1.1761 => 1.3161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.87% (0.1840 => 0.2040, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (10.6960 => 11.4960, std.dev.: 0.0809) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0299) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.27% (0.2200 => 0.2360, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0142) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (8.1441 => 8.6041, std.dev.: 0.0367) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0203) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0237) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (10.4082 => 10.8282, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0397) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0354) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0508) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (5.8400 => 6.0400, std.dev.: 0.0475) MultiSource/Applications/JM/lencod/lencod: 3.41% (17.6165 => 18.2165, std.dev.: 0.0356) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0388) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (7.8562 => 8.0802, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.37% (37.0925 => 37.9726, std.dev.: 0.0502) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2330, std.dev.: 0.0988) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0740) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0141) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1490, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (15.2282 => 15.4642, std.dev.: 0.0486) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0717) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 5.18% (21.1533 => 22.2494, std.dev.: 0.1325) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0310) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0136) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0225) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0066) SingleSource/Benchmarks/Stanford/Puzzle: -13.33% (0.1200 => 0.1040, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 04:03:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 06:03:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423110335.4CFE02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24849?compare_to=24848&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24849, Order: 206948, Start Time: 2014-04-23 06:26:33, End Time: 2014-04-23 11:10:14 To: 24848, Order: 206946, Start Time: 2014-04-23 05:31:55, End Time: 2014-04-23 10:15:55 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (114 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 44.44% (0.0360 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.17% (0.6480 => 0.6880, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 2.45% (1.1440 => 1.1720, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.95% (0.6160 => 0.6280, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.55% (1.2881 => 1.3081, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.31% (2.4122 => 2.5162, std.dev.: 0.0371) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.04% (1.1881 => 1.2361, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/whetstone: 1.13% (1.4121 => 1.4281, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.04% (0.1840 => 0.2080, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.84% (0.3040 => 0.3400, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.55% (1.2721 => 1.3681, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (10.6960 => 11.4920, std.dev.: 0.0585) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0332) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.84% (1.5200 => 1.6240, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0451) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (4.9200 => 5.1360, std.dev.: 0.0371) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0215) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0435) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (4.9000 => 5.0720, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (5.8400 => 6.0400, std.dev.: 0.0505) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 3.11% (17.6165 => 18.1645, std.dev.: 0.0683) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (7.8562 => 8.1002, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0229) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.51% (48.1088 => 49.3169, std.dev.: 0.0551) MultiSource/Applications/sqlite3/sqlite3: 2.29% (23.7574 => 24.3015, std.dev.: 0.0327) MultiSource/Benchmarks/Bullet/bullet: 2.23% (37.0925 => 37.9206, std.dev.: 0.0724) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.4400 => 1.4720, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (15.2282 => 15.5162, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0139) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0150) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0125) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0412) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0393) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0205) MultiSource/Applications/lua/lua: 5.09% (21.1533 => 22.2294, std.dev.: 0.0803) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.56% (6.6564 => 6.7604, std.dev.: 0.0401) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 04:11:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 06:11:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423111112.EFF012A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24850?compare_to=24849&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24850, Order: 206949, Start Time: 2014-04-23 06:36:29, End Time: 2014-04-23 11:17:50 To: 24849, Order: 206948, Start Time: 2014-04-23 06:26:33, End Time: 2014-04-23 11:10:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (110 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 100.00% (0.0160 => 0.0320, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 28.57% (0.0560 => 0.0720, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 8.43% (0.3320 => 0.3600, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.08% (1.3441 => 1.3721, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.05% (1.3681 => 1.3961, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (0.9721 => 0.9961, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0171) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.64% (1.2401 => 1.3721, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0727) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.3400 => 0.3600, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.40% (8.1441 => 8.5841, std.dev.: 0.0353) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0240) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0345) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0479) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0265) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.35% (4.9000 => 5.0640, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0523) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0431) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0489) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.24% (48.1088 => 49.1848, std.dev.: 0.0708) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 2.02% (37.0925 => 37.8406, std.dev.: 0.0530) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0444) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0217) MultiSource/Applications/kimwitu++/kc: 1.59% (18.8170 => 19.1170, std.dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0363) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.02% (0.9321 => 1.1001, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.11% (0.1800 => 0.2000, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 4.77% (21.1533 => 22.1614, std.dev.: 0.0908) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0334) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0022) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0209) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0043) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: -1.34% (2.3841 => 2.3521, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 04:19:26 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 04:19:26 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423111949.CB19A4FDAFC2@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building compiler-rt. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14738 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206955 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17807 of 17808) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17808 of 17808) 1 warning(s) in tests. Testing Time: 430.19s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17658 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 04:45:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 06:45:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423114505.A81C82A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24851?compare_to=24850&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24851, Order: 206951, Start Time: 2014-04-23 07:12:28, End Time: 2014-04-23 11:51:45 To: 24850, Order: 206949, Start Time: 2014-04-23 06:36:29, End Time: 2014-04-23 11:17:50 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (109 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.00% (0.1000 => 0.1120, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 4.20% (0.4760 => 0.4960, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (0.9521 => 0.9641, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 12.12% (0.1320 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.08% (0.5880 => 0.6120, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0053) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.15% (1.1841 => 1.3161, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.74% (10.6960 => 11.5240, std.dev.: 0.0611) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.58% (6.0160 => 6.4720, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0076) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2360 => 0.2520, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0198) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0488) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0311) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0332) MultiSource/Applications/JM/lencod/lencod: 3.45% (17.6165 => 18.2245, std.dev.: 0.0530) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0393) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0534) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0310) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0328) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0075) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (48.1088 => 49.2969, std.dev.: 0.0533) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8725, std.dev.: 0.0970) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 2.05% (23.7574 => 24.2455, std.dev.: 0.0344) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.5882 => 2.6322, std.dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1250, std.dev.: 0.0381) MultiSource/Applications/SPASS/SPASS: 1.48% (17.5484 => 17.8084, std.dev.: 0.0696) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (15.2282 => 15.4002, std.dev.: 0.0620) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0208) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0195) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.00% (0.1600 => 0.1760, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 4.97% (21.1533 => 22.2054, std.dev.: 0.1030) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0351) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.12% (5.0123 => 5.0683, std.dev.: 0.0217) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/perlin: -22.22% (0.0720 => 0.0560, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.13% (1.2601 => 1.2081, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 04:52:14 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 04:52:14 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423115235.CE4DD4FDB48A@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14739 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206956 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.ModuleIsIn (17808 of 17809) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17809 of 17809) 1 warning(s) in tests. Testing Time: 341.43s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17659 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 04:54:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 06:54:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423115431.915192A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24852?compare_to=24842&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24852, Order: 206951, Start Time: 2014-04-23 07:17:53, End Time: 2014-04-23 12:01:06 To: 24842, Order: 206937, Start Time: 2014-04-23 02:31:24, End Time: 2014-04-23 07:14:16 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 15 (163 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (920 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_member: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.00% (0.0800 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 9.09% (0.1760 => 0.1920, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 5.95% (0.3360 => 0.3560, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.26% (0.2280 => 0.2400, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (1.5840 => 1.6600, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.86% (1.7241 => 1.7561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.78% (1.5761 => 1.6041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.49% (1.6081 => 1.6321, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.30% (1.5401 => 1.5601, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.13% (1.7641 => 1.7841, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 2.79% (1.2921 => 1.3281, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.42% (0.8441 => 0.8561, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0107) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0112) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0042) SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0082) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0022) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 133.33% (0.0120 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Bubblesort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0031) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 27.78% (0.0720 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.92% (0.2920 => 0.3560, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.53% (1.0240 => 1.2240, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.58% (0.3240 => 0.3680, std.dev.: 0.0116) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 12.73% (0.6600 => 0.7440, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.80% (1.4241 => 1.5921, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.4401 => 1.6041, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.34% (1.1640 => 1.2960, std.dev.: 0.0314) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.26% (1.4561 => 1.6201, std.dev.: 0.0127) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.01% (1.8161 => 2.0161, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.67% (1.6121 => 1.7841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.43% (1.4961 => 1.6521, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.08% (1.5481 => 1.7041, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.00% (0.1200 => 0.1320, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.95% (1.6081 => 1.7681, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0197) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0202) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0116) MultiSource/Applications/obsequi/Obsequi: 9.21% (1.8680 => 2.0400, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.93% (1.6121 => 1.7561, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.63% (1.4361 => 1.5601, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (1.0240 => 1.1120, std.dev.: 0.0251) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8881 => 0.9601, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.97% (1.4561 => 1.5721, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.5801 => 1.7001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.39% (11.6440 => 12.5040, std.dev.: 0.0557) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/matrix: 7.25% (0.2760 => 0.2960, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.24% (1.5480 => 1.6600, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (0.2240 => 0.2400, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.90% (1.7401 => 1.8601, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.86% (6.4680 => 6.9120, std.dev.: 0.0408) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.13% (5.8121 => 6.1681, std.dev.: 0.0383) MultiSource/Applications/Burg/burg: 6.10% (1.5080 => 1.6000, std.dev.: 0.0224) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.99% (9.4842 => 10.0522, std.dev.: 0.0480) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.68% (2.0440 => 2.1600, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (6.5080 => 6.8440, std.dev.: 0.0430) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (1.7921 => 1.8801, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/sieve: 4.71% (0.3400 => 0.3560, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (10.0443 => 10.5083, std.dev.: 0.0449) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: 4.61% (21.9606 => 22.9728, std.dev.: 0.0558) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0241) MultiSource/Benchmarks/MallocBench/gs/gs: 4.55% (5.3600 => 5.6040, std.dev.: 0.0429) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.5600 => 1.6280, std.dev.: 0.0246) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.7480 => 0.7800, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 4.26% (4.7880 => 4.9920, std.dev.: 0.0242) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.19% (50.0290 => 52.1250, std.dev.: 0.1159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.05% (0.2960 => 0.3080, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (6.5440 => 6.7920, std.dev.: 0.0705) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0183) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0195) MultiSource/Applications/SPASS/SPASS: 3.65% (18.4404 => 19.1126, std.dev.: 0.0414) MultiSource/Benchmarks/Bullet/bullet: 3.51% (38.4046 => 39.7526, std.dev.: 0.0653) MultiSource/Applications/siod/siod: 3.39% (2.7162 => 2.8082, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 3.28% (19.0444 => 19.6684, std.dev.: 0.0588) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (16.3483 => 16.8763, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0160) MultiSource/Applications/kimwitu++/kc: 2.82% (19.6891 => 20.2451, std.dev.: 0.0642) MultiSource/Applications/d/make_dparser: 2.82% (3.9681 => 4.0801, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (6.1044 => 6.1964, std.dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (13.0563 => 13.2363, std.dev.: 0.0494) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0282) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0200) MultiSource/Applications/siod/siod: 10.21% (2.8602 => 3.1522, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.51% (4.5603 => 4.7203, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 2.46% (6.6684 => 6.8324, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0033) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.67% (11.5087 => 11.7007, std.dev.: 0.0193) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 1.03% (8.1245 => 8.2085, std.dev.: 0.0287) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.16% (2.9442 => 0.9080, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.30% (91.8497 => 49.3191, std.dev.: 10.7005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.46% (50.3031 => 32.9701, std.dev.: 0.1906) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.20% (26.0616 => 17.1491, std.dev.: 0.1077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.16% (42.1466 => 28.5938, std.dev.: 0.2638) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1115) SingleSource/UnitTests/Vector/multiplies: -19.81% (1.6961 => 1.3601, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.87% (0.6200 => 0.5960, std.dev.: 0.0089) MultiSource/Applications/aha/aha: -3.78% (2.7522 => 2.6482, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/five11/five11: -2.38% (2.3561 => 2.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 6.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 05:28:18 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 05:28:18 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423122913.E69604FDB89B@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14740 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206957 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17808 of 17809) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17809 of 17809) 1 warning(s) in tests. Testing Time: 330.98s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17659 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 05:24:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 07:24:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140423122409.80BC92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24853?compare_to=24843&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24853, Order: 206953, Start Time: 2014-04-23 07:44:58, End Time: 2014-04-23 12:30:49 To: 24843, Order: 206937, Start Time: 2014-04-23 02:54:24, End Time: 2014-04-23 07:40:34 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 21 (153 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/fixups: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Regression/C++/EH/class_hierarchy: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.77% (0.2600 => 0.2880, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.09% (0.2200 => 0.2400, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.94% (0.2520 => 0.2720, std.dev.: 0.0058) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.31% (1.3000 => 1.3560, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash: 4.24% (0.4720 => 0.4920, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (1.8040 => 1.8640, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.70% (2.1201 => 2.1561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.59% (2.2641 => 2.3001, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.32% (2.1161 => 2.1441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.21% (2.3081 => 2.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.14% (2.0961 => 2.1201, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.08% (2.2321 => 2.2561, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/obsequi/Obsequi: 1.97% (2.0281 => 2.0681, std.dev.: 0.0136) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.86% (17.6723 => 19.7684, std.dev.: 0.0274) MultiSource/Applications/sqlite3/sqlite3: 1420.48% (1.7001 => 25.8496, std.dev.: 0.0357) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.87% (50.1010 => 52.0410, std.dev.: 0.0878) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (1.0520 => 1.1240, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.16% (11.3920 => 12.4360, std.dev.: 0.0665) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0082) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0003, std.dev.: 0.0230) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0137) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0074) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Regression/C++/fixups: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/ary3: 31.25% (0.0640 => 0.0840, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.00% (0.1920 => 0.2400, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.47% (1.8361 => 2.1201, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.19% (2.0281 => 2.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.92% (1.8761 => 2.1561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.61% (1.9161 => 2.1961, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.02% (1.9121 => 2.1801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.94% (0.3400 => 0.3840, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0054) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.71% (0.3360 => 0.3720, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0136) MultiSource/Applications/spiff/spiff: 9.45% (1.0160 => 1.1120, std.dev.: 0.0163) MultiSource/Applications/obsequi/Obsequi: 9.38% (1.8760 => 2.0520, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.81% (0.6360 => 0.6920, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 8.62% (0.2320 => 0.2520, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.46% (0.2680 => 0.2880, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.8440 => 1.9720, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.64% (1.7480 => 1.8640, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.62% (1.0880 => 1.1600, std.dev.: 0.0279) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (6.4800 => 6.8840, std.dev.: 0.0432) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.09% (0.7880 => 0.8360, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.4760 => 0.5040, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.7280 => 0.7680, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.27% (6.5320 => 6.8760, std.dev.: 0.0467) MultiSource/Applications/SIBsim4/SIBsim4: 5.16% (1.7841 => 1.8761, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0136) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.08% (9.6042 => 10.0922, std.dev.: 0.0337) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.5640 => 1.6360, std.dev.: 0.0153) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.2283 => 10.6964, std.dev.: 0.0408) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (5.8281 => 6.0801, std.dev.: 0.0383) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (6.5360 => 6.8040, std.dev.: 0.0577) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 3.85% (5.3960 => 5.6040, std.dev.: 0.0392) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (2.1240 => 2.2000, std.dev.: 0.0151) MultiSource/Applications/treecc/treecc: 3.55% (2.5880 => 2.6800, std.dev.: 0.0305) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (16.3003 => 16.8203, std.dev.: 0.0612) MultiSource/Applications/SPASS/SPASS: 3.15% (18.5284 => 19.1125, std.dev.: 0.0446) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (2.1600 => 2.2280, std.dev.: 0.0182) MultiSource/Applications/oggenc/oggenc: 3.06% (7.0524 => 7.2685, std.dev.: 0.0172) MultiSource/Applications/lua/lua: 3.01% (4.7920 => 4.9360, std.dev.: 0.0368) MultiSource/Applications/JM/lencod/lencod: 2.97% (22.2206 => 22.8808, std.dev.: 0.0642) MultiSource/Applications/d/make_dparser: 2.92% (3.9761 => 4.0921, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 2.71% (38.6366 => 39.6846, std.dev.: 0.0624) MultiSource/Applications/siod/siod: 2.18% (2.7522 => 2.8122, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 1.90% (19.8291 => 20.2051, std.dev.: 0.0726) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.56% (1.0241 => 1.0401, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (13.0363 => 13.2123, std.dev.: 0.0293) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.72% (2.1201 => 2.4322, std.dev.: 0.0399) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 3.46% (6.5964 => 6.8244, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.91% (11.4967 => 11.7167, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.67% (4.8043 => 4.8843, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9442 => 3.9842, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.00% (94.8339 => 49.3151, std.dev.: 9.9926) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.81% (49.9431 => 33.0581, std.dev.: 0.1214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.37% (25.7136 => 17.1331, std.dev.: 0.1201) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.91% (37.0863 => 28.5898, std.dev.: 0.4890) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.86% (5.1563 => 5.0603, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.64% (5.6124 => 5.5203, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0121) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 05:31:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 07:31:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423123156.5552F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24854?compare_to=24844&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24854, Order: 206953, Start Time: 2014-04-23 07:51:41, End Time: 2014-04-23 12:38:33 To: 24844, Order: 206937, Start Time: 2014-04-23 03:01:09, End Time: 2014-04-23 07:48:02 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 20 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1092 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 13.21% (0.2120 => 0.2400, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 4.14% (0.5800 => 0.6040, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.53% (0.3400 => 0.3520, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.45% (0.4640 => 0.4800, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.75% (1.8281 => 1.8601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.71% (1.8721 => 1.9041, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.61% (1.7441 => 1.7721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.28% (1.8681 => 1.8921, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (1.7201 => 1.7401, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.58% (2.3441 => 2.5922, std.dev.: 0.0706) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.8601 => 0.8761, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.66% (6.2564 => 6.3604, std.dev.: 0.0383) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.11% (1.0801 => 1.0921, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0119) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 05:43:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 07:43:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140423124336.3FAA52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24855?compare_to=24845&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24855, Order: 206953, Start Time: 2014-04-23 08:02:57, End Time: 2014-04-23 12:50:17 To: 24845, Order: 206937, Start Time: 2014-04-23 03:11:53, End Time: 2014-04-23 07:59:10 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 18 (177 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (916 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 5.65% (0.4960 => 0.5240, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.21% (1.4240 => 1.4840, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.4840 => 0.5040, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 3.00% (0.4000 => 0.4120, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.77% (1.3561 => 1.3801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.32% (1.5161 => 1.5361, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.16% (1.3841 => 1.4001, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.41% (3.8722 => 4.0042, std.dev.: 0.0376) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0087) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0099) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0096) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 196.83% (0.2520 => 0.7480, std.dev.: 0.0171) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0059) SingleSource/Regression/C/sumarraymalloc: 77.78% (0.0360 => 0.0640, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0074) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0057) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0040) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0185) MultiSource/Applications/obsequi/Obsequi: 43.10% (1.3920 => 1.9920, std.dev.: 0.0322) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0056) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.00% (1.2481 => 1.5601, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.14% (0.1160 => 0.1440, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.81% (1.1401 => 1.4001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.91% (1.1321 => 1.3801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.53% (1.1521 => 1.4001, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.78% (1.2321 => 1.4881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.45% (1.2321 => 1.4841, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.42% (1.1361 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (1.3681 => 1.6361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 19.25% (8.5802 => 10.2323, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.25% (1.2881 => 1.5361, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 18.18% (0.1320 => 0.1560, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0157) MultiSource/Applications/sgefa/sgefa: 16.96% (0.4480 => 0.5240, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 16.03% (19.5406 => 22.6727, std.dev.: 0.0521) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.14% (5.3360 => 6.1441, std.dev.: 0.0331) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.56% (1.7400 => 1.9760, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0103) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0053) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.11% (0.1440 => 0.1600, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 9.45% (11.3843 => 12.4603, std.dev.: 0.0494) MultiSource/Applications/oggenc/oggenc: 9.23% (6.2844 => 6.8644, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.17% (5.6680 => 6.1880, std.dev.: 0.0483) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.15% (5.7280 => 6.2520, std.dev.: 0.0470) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.11% (11.4440 => 12.3720, std.dev.: 0.0654) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.7640 => 0.8240, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (9.5802 => 10.2482, std.dev.: 0.0440) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.40% (1.6240 => 1.7280, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.17% (0.3240 => 0.3440, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0176) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.74% (1.3240 => 1.4000, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 5.45% (4.7720 => 5.0320, std.dev.: 0.0234) MultiSource/Applications/spiff/spiff: 5.34% (1.0480 => 1.1040, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.4800 => 0.5040, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.98% (6.8280 => 7.1680, std.dev.: 0.0422) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (5.3840 => 5.6160, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.13% (0.8721 => 0.9081, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0123) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.08% (49.1529 => 51.1569, std.dev.: 0.0823) MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (1.6961 => 1.7641, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0137) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.63% (1.4320 => 1.4840, std.dev.: 0.0136) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0178) MultiSource/Applications/ClamAV/clamscan: 3.35% (19.2243 => 19.8684, std.dev.: 0.0583) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.26% (2.2081 => 2.2801, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 2.94% (24.7575 => 25.4855, std.dev.: 0.0505) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 2.21% (19.7491 => 20.1851, std.dev.: 0.0573) MultiSource/Applications/SPASS/SPASS: 1.96% (18.7966 => 19.1646, std.dev.: 0.0254) MultiSource/Benchmarks/Bullet/bullet: 1.77% (39.0726 => 39.7646, std.dev.: 0.0749) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.60% (6.0124 => 6.1084, std.dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.27% (29.3298 => 29.7019, std.dev.: 0.0421) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.15% (16.7083 => 16.9003, std.dev.: 0.0691) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.44% (6.6644 => 17.1571, std.dev.: 0.0043) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0241) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0274) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 4.05% (6.8204 => 7.0964, std.dev.: 0.0438) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0158) MultiSource/Applications/lambda-0_1_3/lambda: 2.98% (5.0963 => 5.2483, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0203 => 5.1643, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.56% (4.0563 => 4.1603, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (25.4536 => 25.8936, std.dev.: 0.0538) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0209) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.35% (1.4761 => 1.4961, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.12% (21.7974 => 22.0414, std.dev.: 0.0843) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.63% (11.0207 => 2.0241, std.dev.: 0.0098) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -18.94% (8.9566 => 7.2605, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -18.05% (21.6534 => 17.7451, std.dev.: 0.0813) SingleSource/Benchmarks/Linpack/linpack-pc: -15.98% (7.8605 => 6.6044, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0601) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.05% (4.5123 => 4.2843, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.66% (0.3280 => 0.3160, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0151) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 05:46:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 07:46:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140423124622.51F3E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24856?compare_to=24846&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24856, Order: 206953, Start Time: 2014-04-23 08:03:48, End Time: 2014-04-23 12:52:55 To: 24846, Order: 206937, Start Time: 2014-04-23 03:11:00, End Time: 2014-04-23 08:00:03 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (137 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-ManyArguments: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2003-05-14-AtExit: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/FloatPrecision: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/misr: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Oscar: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.00% (0.1200 => 0.1320, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.21% (1.5360 => 1.6160, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.43% (0.8120 => 0.8480, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.13% (0.4840 => 0.5040, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4800 => 0.4960, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.08% (0.9081 => 0.9361, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.79% (2.0081 => 2.0441, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.67% (6.2320 => 6.3360, std.dev.: 0.0370) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (7.0281 => 7.1401, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.48% (2.1641 => 2.1961, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (13.0963 => 13.2323, std.dev.: 0.0381) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 9.68% (0.2480 => 0.2720, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0122) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/FloatPrecision: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 26.92% (0.1040 => 0.1320, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.94% (1.7321 => 2.1121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.80% (1.6921 => 2.0441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.71% (1.6801 => 2.0281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.61% (1.9801 => 2.3881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.13% (1.8081 => 2.1721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.13% (1.8281 => 2.1961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.86% (1.6721 => 2.0041, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0099) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.44% (0.1440 => 0.1720, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 12.28% (0.2280 => 0.2560, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 10.53% (0.1520 => 0.1680, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 10.53% (0.1520 => 0.1680, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.16% (0.7840 => 0.8480, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.11% (0.1480 => 0.1600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4600 => 0.4960, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0242) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (3.5002 => 3.7562, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (11.7880 => 12.6480, std.dev.: 0.0464) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.27% (0.4400 => 0.4720, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (6.7200 => 7.2000, std.dev.: 0.0379) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (2.0680 => 2.1960, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.81% (1.2400 => 1.3120, std.dev.: 0.0274) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.5240 => 1.6080, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists: 5.26% (0.3040 => 0.3200, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0151) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (9.9842 => 10.4722, std.dev.: 0.0505) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.51% (6.8321 => 7.1401, std.dev.: 0.0237) MultiSource/Applications/d/make_dparser: 4.44% (3.9641 => 4.1401, std.dev.: 0.0267) MultiSource/Applications/lua/lua: 4.26% (4.7920 => 4.9960, std.dev.: 0.0515) MultiSource/Applications/oggenc/oggenc: 4.17% (6.9124 => 7.2005, std.dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.7280 => 1.8000, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ary: 4.00% (0.3000 => 0.3120, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 3.85% (18.4924 => 19.2046, std.dev.: 0.0468) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 3.76% (10.3203 => 10.7084, std.dev.: 0.0464) MultiSource/Applications/minisat/minisat: 3.74% (0.8560 => 0.8880, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0233) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.40% (51.1089 => 52.8449, std.dev.: 0.0911) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (16.5963 => 17.1123, std.dev.: 0.0278) MultiSource/Applications/JM/lencod/lencod: 3.04% (22.6287 => 23.3168, std.dev.: 0.0881) MultiSource/Applications/lemon/lemon: 2.95% (1.4921 => 1.5361, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 2.90% (2.6200 => 2.6960, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (4.2203 => 4.3363, std.dev.: 0.0114) MultiSource/Applications/ClamAV/clamscan: 2.75% (20.2445 => 20.8005, std.dev.: 0.0645) MultiSource/Benchmarks/Bullet/bullet: 2.61% (38.9366 => 39.9526, std.dev.: 0.1126) MultiSource/Applications/kimwitu++/kc: 2.45% (19.7371 => 20.2211, std.dev.: 0.0643) MultiSource/Applications/siod/siod: 2.32% (2.7562 => 2.8202, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.76% (25.1895 => 25.6336, std.dev.: 0.0612) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0269) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (29.4578 => 29.8019, std.dev.: 0.0588) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.93% (1.2681 => 1.4321, std.dev.: 0.0155) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0220) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 2.18% (21.6534 => 22.1254, std.dev.: 0.0439) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.0923 => 4.1563, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (4.4883 => 4.5563, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 1.48% (5.9604 => 6.0484, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (1.3681 => 1.3881, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.20% (6.2884 => 0.8680, std.dev.: 0.0095) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/nestedloop: -60.86% (2.9642 => 1.1601, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0112) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.30% (7.4801 => 6.3360, std.dev.: 0.0370) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -14.82% (7.5041 => 6.3920, std.dev.: 0.0367) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0065) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: -2.16% (13.5243 => 13.2323, std.dev.: 0.0381) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -40.00% (0.0600 => 0.0360, std.dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.62% (21.6534 => 17.8371, std.dev.: 0.0815) SingleSource/Benchmarks/Linpack/linpack-pc: -15.69% (7.8005 => 6.5764, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0100) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.26% (4.1323 => 4.0803, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 05:52:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 07:52:25 -0500 (CDT) Subject: [llvm-testresults] SHIP.BuildSlave.MacOS.01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20140423125225.963C92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24857?baseline=24857 Nickname: SHIP.BuildSlave.MacOS.01__O3-plain__clang_DEV__x86_64:40 Comparing: Run: 24857, Order: affcec88d2022e3d30b38c548e3a781ae72d66f0,2e5f39ee0fb4b5d6303e4342b17146952b9bb79c, Start Time: 2014-04-23 11:51:05, End Time: 2014-04-23 12:59:51 To: (none) Baseline: 24857, Order: affcec88d2022e3d30b38c548e3a781ae72d66f0,2e5f39ee0fb4b5d6303e4342b17146952b9bb79c, Start Time: 2014-04-23 11:51:05, End Time: 2014-04-23 12:59:51 =============== Tests Summary =============== New Failures: 122 (0 on baseline) Added Tests: 910 (0 on baseline) Existing Failures: 0 (122 on baseline) Unchanged Tests: 80 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: - (1.2296 => 1.2296, std.dev.: 0.0265) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (1.2538 => 1.2538, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: - (0.3005 => 0.3005, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: - (3.2433 => 3.2433, std.dev.: 0.2035) MultiSource/Applications/minisat/minisat: - (0.0853 => 0.0853, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: - (14.0597 => 14.0597, std.dev.: 0.0537) MultiSource/Benchmarks/Prolangs-C++/NP/np: - (0.0095 => 0.0095, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.1195 => 0.1195, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: - (0.0170 => 0.0170, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: - (0.0199 => 0.0199, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/employ/employ: - (0.0322 => 0.0322, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0161 => 0.0161, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: - (0.0117 => 0.0117, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: - (0.0142 => 0.0142, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (1.1128 => 1.1128, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: - (0.0414 => 0.0414, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: - (0.1371 => 0.1371, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: - (0.1038 => 0.1038, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: - (0.0630 => 0.0630, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: - (0.0434 => 0.0434, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0121 => 0.0121, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3555 => 0.3555, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0122 => 0.0122, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0176 => 0.0176, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0109 => 0.0109, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0305 => 0.0305, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/EH/except: - (0.0091 => 0.0091, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: - (0.0231 => 0.0231, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: - (0.0088 => 0.0088, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0089 => 0.0089, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: - (0.0102 => 0.0102, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: - (0.0216 => 0.0216, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: - (0.0160 => 0.0160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: - (0.0155 => 0.0155, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: - (0.0300 => 0.0300, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: - (0.0083 => 0.0083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: - (0.0089 => 0.0089, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: - (0.0085 => 0.0085, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: - (0.0224 => 0.0224, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: - (0.0244 => 0.0244, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: - (0.0095 => 0.0095, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: - (0.0229 => 0.0229, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0227 => 0.0227, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: - (0.0279 => 0.0279, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0088 => 0.0088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: - (0.0097 => 0.0097, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0094 => 0.0094, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0087 => 0.0087, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0258 => 0.0258, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: - (0.0090 => 0.0090, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: - (0.0099 => 0.0099, std.dev.: 0.0007) SingleSource/Regression/C++/BuiltinTypeInfo: - (0.0094 => 0.0094, std.dev.: 0.0003) SingleSource/Regression/C++/EH/class_hierarchy: - (0.0099 => 0.0099, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0261 => 0.0261, std.dev.: 0.0014) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0103 => 0.0103, std.dev.: 0.0002) SingleSource/Regression/C++/EH/recursive-throw: - (0.0090 => 0.0090, std.dev.: 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0092 => 0.0092, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: - (0.0087 => 0.0087, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: - (0.7144 => 0.7144, std.dev.: 0.0114) SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0391 => 0.0391, std.dev.: 0.0005) SingleSource/UnitTests/member-function-pointers: - (0.0101 => 0.0101, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0001 => 0.0001) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0001 => 0.0001) MultiSource/Applications/hexxagon/hexxagon: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/minisat/minisat: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/NP/np: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: - (0.0001 => 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/EH/except: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/random: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: - (0.0001 => 0.0001) SingleSource/Regression/C++/BuiltinTypeInfo: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/class_hierarchy: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/recursive-throw: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/ofstream_ctor: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: - (0.0001 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0001 => 0.0001) SingleSource/UnitTests/member-function-pointers: - (0.0001 => 0.0001) Report Time: 0.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 06:08:17 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 06:08:17 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423130850.E38984FDBE74@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14741 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206958 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17808 of 17809) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17809 of 17809) 1 warning(s) in tests. Testing Time: 372.55s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17659 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 06:46:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 08:46:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423134647.CB8F42A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24858?compare_to=24851&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24858, Order: 206956, Start Time: 2014-04-23 09:06:41, End Time: 2014-04-23 13:53:21 To: 24851, Order: 206951, Start Time: 2014-04-23 07:12:28, End Time: 2014-04-23 11:51:45 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (108 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.94% (0.2680 => 0.3000, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.57% (0.1400 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.06% (0.2480 => 0.2680, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.88% (0.3400 => 0.3600, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 16.00% (0.1000 => 0.1160, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.10% (1.1361 => 1.2281, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.56% (4.1083 => 4.0443, std.dev.: 0.0231) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0446) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.9200 => 0.9760, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.40% (8.1441 => 8.5841, std.dev.: 0.0345) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.69% (5.8000 => 6.0720, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0219) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0403) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0188) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0511) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0428) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (7.8562 => 8.0962, std.dev.: 0.0286) MultiSource/Applications/JM/lencod/lencod: 2.88% (17.6165 => 18.1245, std.dev.: 0.0572) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0091) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.52% (48.1088 => 49.3209, std.dev.: 0.0789) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0138) MultiSource/Benchmarks/Bullet/bullet: 2.08% (37.0925 => 37.8646, std.dev.: 0.0574) MultiSource/Applications/sqlite3/sqlite3: 2.05% (23.7574 => 24.2455, std.dev.: 0.0320) MultiSource/Applications/kimwitu++/kc: 1.96% (18.8170 => 19.1851, std.dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 1.76% (17.5484 => 17.8564, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.42% (15.2282 => 15.4442, std.dev.: 0.0548) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.10% (1.1361 => 1.2281, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 4.88% (21.1533 => 22.1854, std.dev.: 0.1115) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout/lists: 3.71% (5.8164 => 6.0324, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0250) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.20% (10.8967 => 2.0481, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.08% (1.2601 => 1.1961, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: -1.97% (0.6080 => 0.5960, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 07:22:13 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 07:22:13 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423142245.D73474FDC815@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14743 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206971 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17812 of 17813) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17813 of 17813) 1 warning(s) in tests. Testing Time: 356.16s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17663 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 07:34:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 09:34:21 -0500 (CDT) Subject: [llvm-testresults] SHIP.BuildSlave.MacOS.01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20140423143421.202A42A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24859?baseline=24859 Nickname: SHIP.BuildSlave.MacOS.01__O3-plain__clang_DEV__x86_64:40 Comparing: Run: 24859, Order: affcec88d2022e3d30b38c548e3a781ae72d66f0,2e5f39ee0fb4b5d6303e4342b17146952b9bb79c, Start Time: 2014-04-23 14:18:53, End Time: 2014-04-23 14:41:50 To: (none) Baseline: 24859, Order: affcec88d2022e3d30b38c548e3a781ae72d66f0,2e5f39ee0fb4b5d6303e4342b17146952b9bb79c, Start Time: 2014-04-23 14:18:53, End Time: 2014-04-23 14:41:50 =============== Tests Summary =============== New Failures: 122 (0 on baseline) Added Tests: 910 (0 on baseline) Existing Failures: 0 (122 on baseline) Unchanged Tests: 80 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: - (1.2408 => 1.2408) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (1.2405 => 1.2405) MultiSource/Applications/hexxagon/hexxagon: - (0.3164 => 0.3164) MultiSource/Applications/kimwitu++/kc: - (3.3002 => 3.3002) MultiSource/Applications/minisat/minisat: - (0.0842 => 0.0842) MultiSource/Benchmarks/Bullet/bullet: - (15.5084 => 15.5084) MultiSource/Benchmarks/Prolangs-C++/NP/np: - (0.0093 => 0.0093) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.1216 => 0.1216) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: - (0.0172 => 0.0172) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: - (0.0339 => 0.0339) MultiSource/Benchmarks/Prolangs-C++/employ/employ: - (0.0393 => 0.0393) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0162 => 0.0162) MultiSource/Benchmarks/Prolangs-C++/office/office: - (0.0112 => 0.0112) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: - (0.0142 => 0.0142) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (1.2899 => 1.2899) SingleSource/Benchmarks/Adobe-C++/functionobjects: - (0.0428 => 0.0428) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: - (0.1494 => 0.1494) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: - (0.1101 => 0.1101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: - (0.0688 => 0.0688) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: - (0.0406 => 0.0406) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0140 => 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3635 => 0.3635) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0122 => 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0184 => 0.0184) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0126 => 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0321 => 0.0321) SingleSource/Benchmarks/Shootout-C++/EH/except: - (0.0120 => 0.0120) SingleSource/Benchmarks/Shootout-C++/ackermann: - (0.0242 => 0.0242) SingleSource/Benchmarks/Shootout-C++/ary: - (0.0088 => 0.0088) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0092 => 0.0092) SingleSource/Benchmarks/Shootout-C++/ary3: - (0.0101 => 0.0101) SingleSource/Benchmarks/Shootout-C++/fibo: - (0.0222 => 0.0222) SingleSource/Benchmarks/Shootout-C++/hash: - (0.0169 => 0.0169) SingleSource/Benchmarks/Shootout-C++/hash2: - (0.0156 => 0.0156) SingleSource/Benchmarks/Shootout-C++/heapsort: - (0.0302 => 0.0302) SingleSource/Benchmarks/Shootout-C++/hello: - (0.0084 => 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: - (0.0101 => 0.0101) SingleSource/Benchmarks/Shootout-C++/lists1: - (0.0104 => 0.0104) SingleSource/Benchmarks/Shootout-C++/matrix: - (0.0229 => 0.0229) SingleSource/Benchmarks/Shootout-C++/methcall: - (0.0236 => 0.0236) SingleSource/Benchmarks/Shootout-C++/moments: - (0.0095 => 0.0095) SingleSource/Benchmarks/Shootout-C++/nestedloop: - (0.0217 => 0.0217) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0229 => 0.0229) SingleSource/Benchmarks/Shootout-C++/random: - (0.0297 => 0.0297) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0098 => 0.0098) SingleSource/Benchmarks/Shootout-C++/sieve: - (0.0083 => 0.0083) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0091 => 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0089 => 0.0089) SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0264 => 0.0264) SingleSource/Benchmarks/Shootout-C++/wc: - (0.0090 => 0.0090) SingleSource/Benchmarks/Shootout-C++/wordfreq: - (0.0116 => 0.0116) SingleSource/Regression/C++/BuiltinTypeInfo: - (0.0094 => 0.0094) SingleSource/Regression/C++/EH/class_hierarchy: - (0.0111 => 0.0111) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0263 => 0.0263) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0104 => 0.0104) SingleSource/Regression/C++/EH/recursive-throw: - (0.0094 => 0.0094) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0089 => 0.0089) SingleSource/Regression/C++/ofstream_ctor: - (0.0093 => 0.0093) SingleSource/UnitTests/ObjC++/property-reference: - (0.7011 => 0.7011) SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0381 => 0.0381) SingleSource/UnitTests/member-function-pointers: - (0.0089 => 0.0089) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0001 => 0.0001) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0001 => 0.0001) MultiSource/Applications/hexxagon/hexxagon: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/minisat/minisat: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/NP/np: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: - (0.0001 => 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/EH/except: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/random: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: - (0.0001 => 0.0001) SingleSource/Regression/C++/BuiltinTypeInfo: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/class_hierarchy: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/recursive-throw: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/ofstream_ctor: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: - (0.0001 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0001 => 0.0001) SingleSource/UnitTests/member-function-pointers: - (0.0001 => 0.0001) Report Time: 0.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 07:55:58 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 07:55:58 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423145633.134FC4FDCCF7@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14744 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206972 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17812 of 17813) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17813 of 17813) 1 warning(s) in tests. Testing Time: 372.37s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17663 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang: error: unknown argument: '--target=i686-windows' ^ :1:33: note: possible intended match here clang: error: unknown argument: '--target=i686-windows' ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 07:57:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 09:57:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423145719.A21C32A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24860?compare_to=24858&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24860, Order: 206959, Start Time: 2014-04-23 10:20:02, End Time: 2014-04-23 15:03:59 To: 24858, Order: 206956, Start Time: 2014-04-23 09:06:41, End Time: 2014-04-23 13:53:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (103 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/global_ctor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/UnitTests/2002-05-02-CastTest2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Towers: 27.27% (0.0440 => 0.0560, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 6.86% (0.4080 => 0.4360, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: 5.17% (0.2320 => 0.2440, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.53% (1.3081 => 1.3281, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.38% (1.2281 => 1.0761, std.dev.: 0.0402) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.51% (5.5603 => 5.4763, std.dev.: 0.0320) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.58% (1.2521 => 1.3721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.82% (1.2281 => 1.3241, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0469) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0360) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0506) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.69% (5.8000 => 6.0720, std.dev.: 0.0396) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0143) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (5.8400 => 6.0600, std.dev.: 0.0315) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.9200 => 5.1040, std.dev.: 0.0419) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 3.11% (17.6165 => 18.1645, std.dev.: 0.0527) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.84% (48.1088 => 49.4730, std.dev.: 0.0596) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0371) MultiSource/Benchmarks/Bullet/bullet: 2.32% (37.0925 => 37.9525, std.dev.: 0.0911) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0473) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0184) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7964 => 5.9084, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 1.85% (18.8170 => 19.1651, std.dev.: 0.0548) MultiSource/Applications/SPASS/SPASS: 1.76% (17.5484 => 17.8564, std.dev.: 0.0409) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.29% (15.2282 => 15.4242, std.dev.: 0.0472) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 4.73% (21.1533 => 22.1534, std.dev.: 0.0970) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0088) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.12% (5.0123 => 5.0683, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0104) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0417) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.28% (10.8967 => 2.0401, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 08:51:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 10:51:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423155118.E3EF12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24861?compare_to=24860&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24861, Order: 206967, Start Time: 2014-04-23 11:14:32, End Time: 2014-04-23 15:57:58 To: 24860, Order: 206959, Start Time: 2014-04-23 10:20:02, End Time: 2014-04-23 15:03:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (110 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/testtrace: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/UnitTests/2003-07-09-SignedArgs: 80.00% (0.0200 => 0.0360, std.dev.: 0.0031) SingleSource/Regression/C++/EH/class_hierarchy: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 16.67% (0.0720 => 0.0840, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 13.64% (0.0880 => 0.1000, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.2880 => 0.3040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.25% (1.2441 => 1.2721, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.11% (1.3241 => 1.3521, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.32% (0.9081 => 0.9201, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.28% (1.2481 => 1.2641, std.dev.: 0.0062) MultiSource/Applications/d/make_dparser: 1.05% (3.8241 => 3.8641, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 16.00% (0.1000 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.45% (3.3282 => 3.4762, std.dev.: 0.0418) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0030) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0164) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (1.1241 => 1.2721, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.07% (1.1601 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.97% (1.1361 => 1.2721, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.2161 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (6.0160 => 6.4600, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0678) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0137) MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.06% (1.1880 => 1.2600, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.55% (8.1441 => 8.5961, std.dev.: 0.0279) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2480 => 0.2600, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (4.9200 => 5.1360, std.dev.: 0.0371) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0400) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (5.8400 => 6.0640, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0155) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.68% (0.5440 => 0.5640, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0379) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0517) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0185) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.79% (48.1088 => 49.4530, std.dev.: 0.0475) MultiSource/Applications/siod/siod: 2.64% (2.5721 => 2.6401, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.59% (4.0122 => 4.1163, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0422) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9125, std.dev.: 0.0631) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0474) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0651) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0769) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (15.2282 => 15.4602, std.dev.: 0.0528) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0149) MultiSource/Applications/d/make_dparser: 1.05% (3.8240 => 3.8641, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 1.03% (17.4082 => 17.5882, std.dev.: 0.0437) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.68% (0.2480 => 0.2720, std.dev.: 0.0085) MultiSource/Applications/lua/lua: 4.84% (21.1533 => 22.1774, std.dev.: 0.1726) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0309) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0074) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0455) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 08:57:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 10:57:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423155734.EE5B62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24862?compare_to=24861&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24862, Order: 206968, Start Time: 2014-04-23 11:22:04, End Time: 2014-04-23 16:04:14 To: 24861, Order: 206967, Start Time: 2014-04-23 11:14:32, End Time: 2014-04-23 15:57:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (111 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.76% (1.3601 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.25% (1.2801 => 1.2961, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 5.26% (3.8802 => 4.0843, std.dev.: 0.0591) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.15% (5.3923 => 5.5083, std.dev.: 0.0386) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.00% (1.2361 => 1.3721, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.96% (1.1681 => 1.2961, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0140) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (10.6960 => 11.4920, std.dev.: 0.0599) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.36% (0.6520 => 0.7000, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0424) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.26% (8.1441 => 8.5721, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (5.8000 => 6.0840, std.dev.: 0.0395) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.9640 => 2.0600, std.dev.: 0.0120) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.1201 => 2.2041, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.9200 => 5.1040, std.dev.: 0.0373) MultiSource/Applications/Burg/burg: 3.56% (1.4600 => 1.5120, std.dev.: 0.0200) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0369) MultiSource/Applications/JM/lencod/lencod: 3.45% (17.6165 => 18.2245, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0325) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0102) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.49% (48.1088 => 49.3090, std.dev.: 0.0849) MultiSource/Applications/kimwitu++/kc: 2.42% (18.8170 => 19.2731, std.dev.: 0.0444) MultiSource/Benchmarks/Bullet/bullet: 2.42% (37.0925 => 37.9885, std.dev.: 0.0830) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: 2.17% (23.7574 => 24.2735, std.dev.: 0.0364) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0572) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.26% (15.2282 => 15.4202, std.dev.: 0.0589) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1560 => 0.1680, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 4.88% (21.1533 => 22.1854, std.dev.: 0.0652) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 1.20% (6.6564 => 6.7364, std.dev.: 0.0305) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0108) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -21.43% (0.0560 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -11.36% (0.1760 => 0.1560, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 09:23:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 09:23:52 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423162426.8A1A24FDD8BE@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14747 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206985 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17812 of 17813) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17813 of 17813) 1 warning(s) in tests. Testing Time: 326.50s ******************** Failing Tests (1): Clang :: Driver/android-standalone.cpp Expected Passes : 17663 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::android-standalone.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp:25:19: error: expected string not found in input // CHECK-AARCH64: "-internal-isystem" "{{.*}}/aarch64-linux-android/include/c++/4.8" ^ :4:155: note: scanning from here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-bbea4b.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ :4:828: note: possible intended match here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-bbea4b.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 09:23:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 09:23:52 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423162426.9C1824FDD8BF@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14747 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206985 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17812 of 17813) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17813 of 17813) 1 warning(s) in tests. Testing Time: 326.50s ******************** Failing Tests (1): Clang :: Driver/android-standalone.cpp Expected Passes : 17663 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::android-standalone.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp:25:19: error: expected string not found in input // CHECK-AARCH64: "-internal-isystem" "{{.*}}/aarch64-linux-android/include/c++/4.8" ^ :4:155: note: scanning from here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-bbea4b.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ :4:828: note: possible intended match here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-bbea4b.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 09:32:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 11:32:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423163256.652462A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24863?compare_to=24862&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24863, Order: 206971, Start Time: 2014-04-23 11:59:07, End Time: 2014-04-23 16:39:35 To: 24862, Order: 206968, Start Time: 2014-04-23 11:22:04, End Time: 2014-04-23 16:04:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (111 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-02-04-DivRem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C/matrixTranspose: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.05% (0.0760 => 0.0920, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: 15.62% (0.1280 => 0.1480, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.69% (0.2080 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.14% (0.2800 => 0.3000, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 2.00% (2.6001 => 2.6521, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: 1.72% (5.1040 => 5.1920, std.dev.: 0.0314) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 29.03% (0.1240 => 0.1600, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.06% (1.2321 => 1.3561, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.38% (1.3641 => 1.4921, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.82% (10.6960 => 11.5320, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0527) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0144) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (8.1441 => 8.6121, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 5.53% (4.9200 => 5.1920, std.dev.: 0.0314) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 5.22% (4.5200 => 4.7560, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (10.4082 => 10.8402, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (5.8400 => 6.0680, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0133) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.51% (48.1088 => 49.7969, std.dev.: 0.0376) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (4.9000 => 5.0680, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.39% (2.8322 => 2.9282, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 3.38% (18.8170 => 19.4531, std.dev.: 0.0465) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0637) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (7.8562 => 8.1042, std.dev.: 0.0223) MultiSource/Applications/siod/siod: 3.11% (2.5721 => 2.6521, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0134) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 2.85% (37.0925 => 38.1486, std.dev.: 0.0583) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (4.0122 => 4.1243, std.dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.2480 => 1.2760, std.dev.: 0.0100) MultiSource/Applications/SPASS/SPASS: 2.21% (17.5484 => 17.9364, std.dev.: 0.0453) MultiSource/Applications/sqlite3/sqlite3: 2.11% (23.7574 => 24.2575, std.dev.: 0.0457) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.74% (5.7564 => 5.8564, std.dev.: 0.0159) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.58% (15.2282 => 15.4682, std.dev.: 0.0378) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (28.1538 => 28.5418, std.dev.: 0.0630) MultiSource/Applications/ClamAV/clamscan: 1.24% (17.4082 => 17.6242, std.dev.: 0.0579) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 4.94% (21.1533 => 22.1974, std.dev.: 0.0790) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.79% (3.3802 => 3.5082, std.dev.: 0.0421) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (25.8896 => 26.7897, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (0.9601 => 0.9841, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0324) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 1.52% (5.0123 => 5.0883, std.dev.: 0.0142) MultiSource/Applications/minisat/minisat: 1.26% (6.6564 => 6.7404, std.dev.: 0.0304) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0458) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0074) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 09:44:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 11:44:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423164446.89F212A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24864?compare_to=24852&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24864, Order: 206971, Start Time: 2014-04-23 12:08:33, End Time: 2014-04-23 16:51:28 To: 24852, Order: 206951, Start Time: 2014-04-23 07:17:53, End Time: 2014-04-23 12:01:06 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (167 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (917 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C++/EH/function_try_block: 80.00% (0.0200 => 0.0360, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/15-trie/trie: 25.00% (0.0640 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 11.11% (0.1080 => 0.1200, std.dev.: 0.0038) MultiSource/Applications/aha/aha: 9.38% (0.1280 => 0.1400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.41% (0.2720 => 0.2840, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 2.43% (2.6360 => 2.7000, std.dev.: 0.0247) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.98% (1.0081 => 1.0281, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (6.7920 => 6.9120, std.dev.: 0.0293) MultiSource/Applications/kimwitu++/kc: 1.34% (20.2451 => 20.5171, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.20% (1.6641 => 1.6841, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.50% (11.3687 => 3.0122, std.dev.: 0.0164) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0110) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0086) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0062) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 133.33% (0.0120 => 0.0280, std.dev.: 0.0016) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/UnitTests/2002-05-02-CastTest2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Bubblesort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 42.86% (0.0560 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 36.36% (0.0880 => 0.1200, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.52% (0.1080 => 0.1280, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.86% (0.1120 => 0.1320, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.56% (0.1800 => 0.2080, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.25% (0.2360 => 0.2720, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.00% (0.0800 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.6600 => 0.7480, std.dev.: 0.0139) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.16% (0.1520 => 0.1720, std.dev.: 0.0068) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: 10.49% (1.8680 => 2.0640, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.92% (1.6121 => 1.7721, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.68% (1.7361 => 1.9041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: 9.13% (1.0080 => 1.1000, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.93% (1.6121 => 1.7561, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0045) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0107) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.88% (1.7761 => 1.9161, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.80% (1.6921 => 1.8241, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.63% (0.5240 => 0.5640, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3440 => 0.3680, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0147) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (6.4680 => 6.9040, std.dev.: 0.0489) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.49% (11.6440 => 12.4000, std.dev.: 0.0585) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.20% (9.4842 => 10.0722, std.dev.: 0.0307) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.20% (0.9681 => 1.0281, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.97% (0.2680 => 0.2840, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.62% (6.5440 => 6.9120, std.dev.: 0.0293) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.38% (1.5600 => 1.6440, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0397) MultiSource/Benchmarks/MallocBench/gs/gs: 5.22% (5.3600 => 5.6400, std.dev.: 0.0535) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (6.5080 => 6.8440, std.dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.99% (2.3281 => 2.4442, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.95% (0.8881 => 0.9321, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (1.7921 => 1.8801, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: 4.86% (10.0443 => 10.5323, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0304) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.82% (1.6601 => 1.7401, std.dev.: 0.0085) MultiSource/Applications/siod/siod: 4.71% (2.7162 => 2.8442, std.dev.: 0.0164) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.66% (50.0290 => 52.3610, std.dev.: 0.0969) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0107) MultiSource/Applications/treecc/treecc: 4.49% (2.5840 => 2.7000, std.dev.: 0.0247) MultiSource/Applications/lua/lua: 4.43% (4.7880 => 5.0000, std.dev.: 0.0403) MultiSource/Applications/JM/lencod/lencod: 4.41% (21.9606 => 22.9288, std.dev.: 0.0489) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.36% (3.0282 => 3.1602, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.33% (2.1240 => 2.2160, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 4.21% (19.6891 => 20.5171, std.dev.: 0.0413) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.82% (4.1843 => 4.3443, std.dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: 3.80% (18.4404 => 19.1406, std.dev.: 0.0526) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 3.69% (38.4046 => 39.8206, std.dev.: 0.0523) MultiSource/Applications/oggenc/oggenc: 3.49% (6.9844 => 7.2285, std.dev.: 0.0229) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0181) MultiSource/Applications/d/make_dparser: 3.12% (3.9681 => 4.0921, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (16.3483 => 16.8523, std.dev.: 0.0551) MultiSource/Applications/ClamAV/clamscan: 2.60% (19.0444 => 19.5404, std.dev.: 0.0827) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.29% (6.1044 => 6.2444, std.dev.: 0.0286) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (29.3338 => 29.8019, std.dev.: 0.0396) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (13.0563 => 13.2603, std.dev.: 0.0168) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.71% (2.1401 => 2.4122, std.dev.: 0.0557) MultiSource/Applications/siod/siod: 10.35% (2.8602 => 3.1562, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (4.5603 => 4.7163, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0264) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (3.9922 => 4.0923, std.dev.: 0.0214) MultiSource/Applications/minisat/minisat: 2.40% (6.6684 => 6.8284, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.26% (3.7122 => 3.7962, std.dev.: 0.0067) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.5087 => 11.7207, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: 1.22% (0.9801 => 0.9921, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 1.18% (8.1245 => 8.2205, std.dev.: 0.0216) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.75% (2.9442 => 0.9200, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.25% (91.8497 => 49.3711, std.dev.: 9.8770) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.66% (26.0616 => 17.0291, std.dev.: 0.1341) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.08% (50.3031 => 33.1581, std.dev.: 0.1346) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.93% (42.1466 => 28.2658, std.dev.: 0.3800) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1120) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0163) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0037) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.83% (4.8083 => 4.6723, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.02% (5.1563 => 5.0523, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.45% (4.1243 => 4.0643, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 10:03:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 10:03:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423170402.87C0C4FDDDBE@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building compiler-rt. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14748 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206983 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17812 of 17813) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17813 of 17813) 1 warning(s) in tests. Testing Time: 374.00s ******************** Failing Tests (1): Clang :: Driver/android-standalone.cpp Expected Passes : 17663 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::android-standalone.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp:25:19: error: expected string not found in input // CHECK-AARCH64: "-internal-isystem" "{{.*}}/aarch64-linux-android/include/c++/4.8" ^ :4:155: note: scanning from here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-3dcb96.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ :4:828: note: possible intended match here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-3dcb96.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 10:18:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 12:18:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140423171800.434B42A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24865?compare_to=24853&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24865, Order: 206971, Start Time: 2014-04-23 12:38:06, End Time: 2014-04-23 17:24:41 To: 24853, Order: 206953, Start Time: 2014-04-23 07:44:58, End Time: 2014-04-23 12:30:49 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 17 (158 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (920 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.67% (0.0600 => 0.0760, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.51% (0.1880 => 0.2040, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 4.42% (0.4520 => 0.4720, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.41% (0.3520 => 0.3640, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (1.1000 => 1.1240, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 1.60% (1.4961 => 1.5201, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 1.56% (2.8122 => 2.8562, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.49% (6.1684 => 6.2604, std.dev.: 0.0245) MultiSource/Applications/kimwitu++/kc: 1.41% (20.2051 => 20.4891, std.dev.: 0.0739) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (3.1442 => 3.1762, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.3841 => 1.4041, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.41% (17.6723 => 19.6883, std.dev.: 0.0482) MultiSource/Applications/sqlite3/sqlite3: 1420.24% (1.7001 => 25.8456, std.dev.: 0.0597) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.57% (50.1010 => 52.3890, std.dev.: 0.0807) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.02% (11.3920 => 12.4200, std.dev.: 0.0649) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0107) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0122, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 315.76% (0.4320 => 1.7961, std.dev.: 0.0124) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 30.00% (0.0800 => 0.1040, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.14% (0.1160 => 0.1440, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.08% (0.1560 => 0.1920, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.00% (0.1000 => 0.1200, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 19.23% (0.1040 => 0.1240, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 15.85% (0.3280 => 0.3800, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.38% (0.4160 => 0.4800, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.24% (1.9161 => 2.2081, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.90% (1.9601 => 2.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.95% (0.1720 => 0.1960, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.64% (2.1121 => 2.4001, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.33% (0.1800 => 0.2040, std.dev.: 0.0031) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.25% (1.7961 => 2.0161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.32% (0.6360 => 0.7080, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0113) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.16% (0.1960 => 0.2120, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4920 => 0.5280, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.4400 => 0.4720, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.14% (0.7280 => 0.7800, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.11% (0.7880 => 0.8440, std.dev.: 0.0164) MultiSource/Applications/spiff/spiff: 7.09% (1.0160 => 1.0880, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.4800 => 6.9240, std.dev.: 0.0454) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (2.9721 => 3.1602, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0204) MultiSource/Applications/hexxagon/hexxagon: 5.65% (1.1320 => 1.1960, std.dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: 5.61% (1.7841 => 1.8841, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.49% (1.7480 => 1.8440, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0217) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.4480 => 0.4720, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 4.97% (1.5280 => 1.6040, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (5.8281 => 6.1161, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 4.82% (5.3960 => 5.6560, std.dev.: 0.0440) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0121) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0328) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.62% (1.3000 => 1.3600, std.dev.: 0.0146) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.47% (6.5320 => 6.8240, std.dev.: 0.0428) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (9.6042 => 10.0242, std.dev.: 0.0698) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.5640 => 1.6320, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.28% (2.3401 => 2.4402, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (6.5360 => 6.8040, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.93% (3.0562 => 3.1762, std.dev.: 0.0078) MultiSource/Applications/treecc/treecc: 3.86% (2.5880 => 2.6880, std.dev.: 0.0255) MultiSource/Applications/SPASS/SPASS: 3.78% (18.5284 => 19.2286, std.dev.: 0.0333) MultiSource/Applications/siod/siod: 3.78% (2.7522 => 2.8562, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (16.3003 => 16.9043, std.dev.: 0.0487) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.2283 => 10.6044, std.dev.: 0.0660) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 3.33% (19.8291 => 20.4891, std.dev.: 0.0739) MultiSource/Benchmarks/Bullet/bullet: 3.18% (38.6366 => 39.8646, std.dev.: 0.0765) MultiSource/Applications/JM/lencod/lencod: 3.04% (22.2206 => 22.8967, std.dev.: 0.0405) MultiSource/Applications/oggenc/oggenc: 2.95% (7.0524 => 7.2605, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1600 => 2.2200, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (4.2243 => 4.3403, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: 2.15% (1.4881 => 1.5201, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 2.11% (3.9761 => 4.0601, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.82% (6.1484 => 6.2604, std.dev.: 0.0245) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.7842 => 2.8202, std.dev.: 0.0129) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.18% (29.4178 => 29.7659, std.dev.: 0.0523) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 44.44% (0.0360 => 0.0520, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0383) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.15% (6.5964 => 6.8044, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.91% (3.7122 => 3.8202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 1.74% (1.3801 => 1.4041, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.67% (4.8043 => 4.8843, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.36% (11.4967 => 11.6527, std.dev.: 0.0425) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.73% (10.4007 => 2.0041, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.98% (94.8339 => 49.3351, std.dev.: 10.1352) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.95% (25.7136 => 16.9851, std.dev.: 0.1306) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.66% (49.9431 => 33.1301, std.dev.: 0.1692) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.38% (37.0863 => 28.4138, std.dev.: 0.3997) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1136) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -1.86% (5.1563 => 5.0603, std.dev.: 0.0272) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 10:29:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 12:29:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423172939.7A84E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24866?compare_to=24854&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24866, Order: 206972, Start Time: 2014-04-23 12:48:40, End Time: 2014-04-23 17:36:18 To: 24854, Order: 206953, Start Time: 2014-04-23 07:51:41, End Time: 2014-04-23 12:38:33 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1095 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C++/BuiltinTypeInfo: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C/globalrefs: 200.00% (0.0080 => 0.0240, std.dev.: 0.0042) SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Treesort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) SingleSource/Regression/C/sumarray: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.90% (0.1680 => 0.1880, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.55% (0.2640 => 0.2760, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: 3.57% (0.3360 => 0.3480, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.42% (0.8280 => 0.8480, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.91% (0.6280 => 0.6400, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (6.3000 => 6.3960, std.dev.: 0.0353) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/BenchmarkGame/n-body: -9.68% (0.1240 => 0.1120, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0125) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 10:38:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 12:38:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140423173851.EAF552A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24867?compare_to=24855&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24867, Order: 206973, Start Time: 2014-04-23 13:00:25, End Time: 2014-04-23 17:45:32 To: 24855, Order: 206953, Start Time: 2014-04-23 08:02:57, End Time: 2014-04-23 12:50:17 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (172 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (918 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/objinst: 27.27% (0.0440 => 0.0560, std.dev.: 0.0028) SingleSource/Regression/C/sumarraymalloc: 25.00% (0.0640 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 1.14% (5.6160 => 5.6800, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.11% (1.4361 => 1.4521, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.69% (0.1560 => 0.1680, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bisort/bisort: 2.17% (0.7360 => 0.7520, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0060) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0068) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0066) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0138) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0161) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0059) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 96.15% (0.1040 => 0.2040, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0056) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.98% (0.7040 => 1.0840, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0048) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: 45.11% (1.3920 => 2.0200, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/salsa20: 40.00% (0.0600 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.95% (1.2321 => 1.5641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.00% (1.2481 => 1.5601, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.63% (1.1841 => 1.4521, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.11% (1.1761 => 1.4361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.91% (1.1321 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.84% (1.3001 => 1.5841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.12% (1.1361 => 1.3761, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.13% (1.2321 => 1.4801, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.13% (1.2521 => 1.5041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: 19.07% (8.5802 => 10.2163, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.00% (1.2841 => 1.5281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.94% (1.2881 => 1.5321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0104) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 17.86% (0.4480 => 0.5280, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 15.89% (19.5406 => 22.6447, std.dev.: 0.0569) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.29% (5.3360 => 6.1521, std.dev.: 0.0345) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 14.79% (1.3521 => 1.5521, std.dev.: 0.0103) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.63% (0.1720 => 0.1920, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.26% (1.7400 => 1.9360, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0192) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 9.77% (11.3843 => 12.4963, std.dev.: 0.0294) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 9.55% (6.2844 => 6.8844, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.22% (5.7280 => 6.2560, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.89% (5.6680 => 6.1720, std.dev.: 0.0400) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.84% (11.4440 => 12.4560, std.dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.38% (0.7640 => 0.8280, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.41% (0.6480 => 0.6960, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.14% (1.6240 => 1.7400, std.dev.: 0.0205) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.01% (9.5802 => 10.2522, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 5.71% (0.2800 => 0.2960, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 5.62% (4.7720 => 5.0400, std.dev.: 0.0310) MultiSource/Benchmarks/MallocBench/gs/gs: 5.50% (5.3840 => 5.6800, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/random: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0063) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.78% (1.3400 => 1.4040, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.39% (0.4560 => 0.4760, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.1480 => 1.1960, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0479) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0147) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.70% (49.1529 => 50.9729, std.dev.: 0.1146) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.63% (1.4320 => 1.4840, std.dev.: 0.0156) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.6961 => 1.7561, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.26% (2.2081 => 2.2801, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0241) MultiSource/Applications/ClamAV/clamscan: 3.20% (19.2243 => 19.8404, std.dev.: 0.0439) MultiSource/Applications/sqlite3/sqlite3: 3.12% (24.7575 => 25.5296, std.dev.: 0.0418) MultiSource/Applications/kimwitu++/kc: 2.84% (19.7491 => 20.3091, std.dev.: 0.0380) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0151) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 1.86% (39.0726 => 39.8006, std.dev.: 0.0657) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (3.0402 => 3.0922, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.53% (16.7083 => 16.9643, std.dev.: 0.0591) MultiSource/Applications/SPASS/SPASS: 1.51% (18.7966 => 19.0805, std.dev.: 0.0492) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.43% (29.3298 => 29.7499, std.dev.: 0.0446) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.2401 => 1.4521, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0276) MultiSource/Applications/siod/siod: 4.56% (2.9842 => 3.1202, std.dev.: 0.0207) MultiSource/Applications/minisat/minisat: 3.99% (6.8204 => 7.0924, std.dev.: 0.0398) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.1001 => 1.1401, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.0563 => 4.1643, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0552) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (25.4536 => 25.9056, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.56% (11.0207 => 2.0321, std.dev.: 0.0116) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -19.12% (8.9566 => 7.2445, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.79% (21.6534 => 17.8011, std.dev.: 0.0883) SingleSource/Benchmarks/Linpack/linpack-pc: -16.08% (7.8605 => 6.5964, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -9.10% (3.4722 => 3.1562, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0012) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0808) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.5602 => 3.5202, std.dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: -1.07% (11.5567 => 11.4327, std.dev.: 0.0174) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 10:48:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 10:48:42 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423174912.08AE54FDE374@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14749 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206984 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.InvalidSpecialCaseList (17812 of 17813) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17813 of 17813) 1 warning(s) in tests. Testing Time: 377.30s ******************** Failing Tests (1): Clang :: Driver/android-standalone.cpp Expected Passes : 17663 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::android-standalone.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp:25:19: error: expected string not found in input // CHECK-AARCH64: "-internal-isystem" "{{.*}}/aarch64-linux-android/include/c++/4.8" ^ :4:155: note: scanning from here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-d30237.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ :4:828: note: possible intended match here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-d30237.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 10:45:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 12:45:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140423174541.B67182A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24868?compare_to=24856&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24868, Order: 206973, Start Time: 2014-04-23 13:03:10, End Time: 2014-04-23 17:52:24 To: 24856, Order: 206953, Start Time: 2014-04-23 08:03:48, End Time: 2014-04-23 12:52:55 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (142 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 80.00% (0.0200 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C++/pointer_method2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.20% (0.1640 => 0.1840, std.dev.: 0.0056) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.57% (0.1400 => 0.1520, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.4480 => 0.4640, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.45% (0.4640 => 0.4800, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 1.19% (5.6920 => 5.7600, std.dev.: 0.0239) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 500.00% (0.0040 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0093) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/pointer_method2: 100.00% (0.0160 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.34% (1.6681 => 2.0241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.13% (1.8881 => 2.2681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.30% (1.7201 => 2.0521, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.02% (1.7241 => 2.0521, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.30% (1.8361 => 2.1721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.61% (1.9761 => 2.3241, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.67% (0.1200 => 0.1400, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.11% (0.1080 => 0.1200, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0049) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.20% (6.7200 => 7.2040, std.dev.: 0.0333) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.10% (1.2400 => 1.3280, std.dev.: 0.0183) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.63% (0.7840 => 0.8360, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.50% (1.4160 => 1.5080, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 6.42% (0.4360 => 0.4640, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.35% (11.7880 => 12.5360, std.dev.: 0.0577) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.8601 => 0.9121, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.77% (1.5240 => 1.6120, std.dev.: 0.0197) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0133) MultiSource/Applications/d/make_dparser: 4.94% (3.9641 => 4.1601, std.dev.: 0.0204) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.89% (9.9842 => 10.4722, std.dev.: 0.0367) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0129) MultiSource/Applications/lua/lua: 4.84% (4.7920 => 5.0240, std.dev.: 0.0349) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0155) MultiSource/Applications/oggenc/oggenc: 4.46% (6.9124 => 7.2205, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.41% (0.2720 => 0.2840, std.dev.: 0.0043) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.37% (1.3720 => 1.4320, std.dev.: 0.0150) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.22% (6.8321 => 7.1201, std.dev.: 0.0253) MultiSource/Applications/SPASS/SPASS: 4.05% (18.4924 => 19.2406, std.dev.: 0.0419) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.3203 => 10.7284, std.dev.: 0.0389) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.1440 => 1.1880, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (5.5480 => 5.7600, std.dev.: 0.0239) MultiSource/Benchmarks/nbench/nbench: 3.74% (1.8201 => 1.8881, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0193) MultiSource/Applications/treecc/treecc: 3.36% (2.6200 => 2.7080, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (2.0440 => 2.1120, std.dev.: 0.0231) MultiSource/Applications/kimwitu++/kc: 3.28% (19.7371 => 20.3851, std.dev.: 0.0419) MultiSource/Applications/JM/lencod/lencod: 3.23% (22.6287 => 23.3607, std.dev.: 0.0889) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.08% (51.1089 => 52.6849, std.dev.: 0.1370) MultiSource/Applications/siod/siod: 3.05% (2.7562 => 2.8402, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (3.0122 => 3.1002, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0119) MultiSource/Applications/ClamAV/clamscan: 2.86% (20.2445 => 20.8245, std.dev.: 0.0569) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (16.5963 => 17.0523, std.dev.: 0.0607) MultiSource/Benchmarks/Bullet/bullet: 2.61% (38.9366 => 39.9526, std.dev.: 0.0717) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (2.2721 => 2.3281, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 2.00% (25.1895 => 25.6936, std.dev.: 0.0467) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.99% (6.0244 => 6.1444, std.dev.: 0.0248) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (29.4578 => 29.8179, std.dev.: 0.0557) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 10.18% (2.8282 => 3.1162, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0267) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.99% (4.0203 => 4.1003, std.dev.: 0.0162) MultiSource/Applications/lua/lua: 1.94% (21.6534 => 22.0734, std.dev.: 0.1045) MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (5.1603 => 5.2523, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0089) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (2.5322 => 2.5602, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (1.0881 => 1.1001, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.26% (6.2884 => 0.8640, std.dev.: 0.0164) SingleSource/UnitTests/Vector/constpool: -81.26% (10.9087 => 2.0441, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0075) MultiSource/Applications/obsequi/Obsequi: -20.55% (2.6481 => 2.1040, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.63% (7.4801 => 6.2360, std.dev.: 0.0636) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.30% (7.5041 => 6.3560, std.dev.: 0.0546) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -2.57% (13.5243 => 13.1763, std.dev.: 0.0255) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.26% (21.6534 => 17.9171, std.dev.: 0.0313) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: -2.36% (8.3085 => 8.1125, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.24% (2.9122 => 2.8762, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.16% (6.9124 => 6.8324, std.dev.: 0.0252) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 11:47:50 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 11:47:50 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423184824.9891A4FDEB5E@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14751 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206988 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17812 of 17813) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17813 of 17813) 1 warning(s) in tests. Testing Time: 323.13s ******************** Failing Tests (1): Clang :: Driver/android-standalone.cpp Expected Passes : 17663 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::android-standalone.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp:25:19: error: expected string not found in input // CHECK-AARCH64: "-internal-isystem" "{{.*}}/aarch64-linux-android/include/c++/4.8" ^ :4:155: note: scanning from here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-367ad8.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ :4:828: note: possible intended match here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-367ad8.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Wed Apr 23 11:47:50 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 23 Apr 2014 11:47:50 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140423184824.3E32D4FDEB5D@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14751 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 206988 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17812 of 17813) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17813 of 17813) 1 warning(s) in tests. Testing Time: 323.13s ******************** Failing Tests (1): Clang :: Driver/android-standalone.cpp Expected Passes : 17663 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::android-standalone.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp:25:19: error: expected string not found in input // CHECK-AARCH64: "-internal-isystem" "{{.*}}/aarch64-linux-android/include/c++/4.8" ^ :4:155: note: scanning from here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-367ad8.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ :4:828: note: possible intended match here "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang" "-cc1" "-triple" "aarch64--linux-android" "-emit-obj" "-mrelax-all" "-disable-free" "-main-file-name" "android-standalone.cpp" "-mrelocation-model" "static" "-mdisable-fp-elim" "-fmath-errno" "-masm-verbose" "-mconstructor-aliases" "-fuse-init-array" "-target-cpu" "generic" "-target-feature" "+neon" "-target-linker-version" "136" "-resource-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0" "-isysroot" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/local/include" "-internal-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/../lib/clang/3.5.0/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/include" "-internal-externc-isystem" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/Inputs/basic_android_tree/sysroot/usr/include" "-fdeprecated-macro" "-fdebug-compilation-dir" "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/test/Driver" "-ferror-limit" "19" "-fmessage-length" "0" "-mstackrealign" "-fno-signed-char" "-fobjc-runtime=gcc" "-fcxx-exceptions" "-fexceptions" "-fdiagnostics-show-option" "-vectorize-slp" "-o" "/var/tmp/android-standalone-367ad8.o" "-x" "c++ " "/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/android-standalone.cpp" ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Wed Apr 23 11:52:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 13:52:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423185242.710512A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24869?compare_to=24863&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24869, Order: 206979, Start Time: 2014-04-23 14:12:36, End Time: 2014-04-23 18:59:20 To: 24863, Order: 206971, Start Time: 2014-04-23 11:59:07, End Time: 2014-04-23 16:39:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (114 on baseline) Performance Improvements: 4 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2440 => 0.2560, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.19% (1.2761 => 1.3041, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.05% (0.5840 => 0.5960, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: -1.36% (19.4531 => 19.1891, std.dev.: 0.0591) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (5.8564 => 5.7964, std.dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.02% (3.5402 => 3.5042, std.dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.50% (0.1600 => 0.1880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.97% (1.1361 => 1.2721, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.58% (6.0160 => 6.4720, std.dev.: 0.0266) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.36% (0.6520 => 0.7000, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0678) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.6840 => 0.7200, std.dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.21% (8.1441 => 8.5681, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0170) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0475) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (4.9200 => 5.1360, std.dev.: 0.0369) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0261) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0157) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0430) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (10.4082 => 10.8402, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (5.8400 => 6.0600, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: 3.36% (17.6165 => 18.2085, std.dev.: 0.0478) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0215) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (7.8562 => 8.1002, std.dev.: 0.0319) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.8322 => 2.9162, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.76% (48.1088 => 49.4369, std.dev.: 0.0924) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 2.45% (37.0925 => 38.0006, std.dev.: 0.0547) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0591) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (15.2282 => 15.4802, std.dev.: 0.0598) MultiSource/Applications/SPASS/SPASS: 1.57% (17.5484 => 17.8244, std.dev.: 0.0574) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: 1.03% (17.4082 => 17.5882, std.dev.: 0.0457) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 4.86% (21.1533 => 22.1814, std.dev.: 0.1242) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0301) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 1.26% (6.6564 => 6.7404, std.dev.: 0.0254) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0611) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/fldry: -1.97% (0.6080 => 0.5960, std.dev.: 0.0044) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 12:59:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 14:59:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423195935.1115C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24870?compare_to=24869&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24870, Order: 206991, Start Time: 2014-04-23 15:23:17, End Time: 2014-04-23 20:06:14 To: 24869, Order: 206979, Start Time: 2014-04-23 14:12:36, End Time: 2014-04-23 18:59:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (105 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/global_ctor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 25.00% (0.0640 => 0.0800, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 21.74% (0.0920 => 0.1120, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.51% (0.1480 => 0.1680, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (1.3801 => 1.4001, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 19.05% (0.0840 => 0.1000, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.81% (0.2160 => 0.2480, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 9.29% (1.2921 => 1.4121, std.dev.: 0.0386) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.45% (1.3801 => 1.4001, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.35% (1.2521 => 1.1601, std.dev.: 0.0316) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 22.50% (0.1600 => 0.1960, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.82% (0.1560 => 0.1760, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.53% (0.3040 => 0.3360, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0832) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0510) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.3200 => 0.3400, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (8.1441 => 8.5761, std.dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0389) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.1201 => 2.2041, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0496) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0299) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 3.16% (17.6165 => 18.1725, std.dev.: 0.0381) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0341) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0444) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0078) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.50% (48.1088 => 49.3129, std.dev.: 0.0696) MultiSource/Benchmarks/Bullet/bullet: 2.39% (37.0925 => 37.9806, std.dev.: 0.0441) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0264) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0152) MultiSource/Applications/sqlite3/sqlite3: 1.80% (23.7574 => 24.1855, std.dev.: 0.0379) MultiSource/Applications/SPASS/SPASS: 1.71% (17.5484 => 17.8484, std.dev.: 0.0276) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1331, std.dev.: 0.0411) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0191) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 5.05% (21.1533 => 22.2214, std.dev.: 0.0758) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.94% (1.2601 => 1.1601, std.dev.: 0.0316) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 13:51:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 15:51:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423205146.8B6342A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24871?compare_to=24870&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24871, Order: 206997, Start Time: 2014-04-23 16:17:00, End Time: 2014-04-23 20:58:26 To: 24870, Order: 206991, Start Time: 2014-04-23 15:23:17, End Time: 2014-04-23 20:06:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (104 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 200.00% (0.0080 => 0.0240, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 5.17% (0.2320 => 0.2440, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.05% (1.3840 => 1.4400, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.02% (5.9320 => 6.0520, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.92% (1.2521 => 1.2761, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.79% (0.8961 => 0.9121, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.24% (1.1601 => 1.2441, std.dev.: 0.0182) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (10.6960 => 11.4920, std.dev.: 0.0497) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0424) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (8.1441 => 8.5761, std.dev.: 0.0335) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0187) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (5.8000 => 6.0680, std.dev.: 0.0455) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0289) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0227) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (5.8400 => 6.0520, std.dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0473) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0455) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0197) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.41% (48.1088 => 49.2689, std.dev.: 0.0954) MultiSource/Applications/hbd/hbd: 2.38% (1.6800 => 1.7200, std.dev.: 0.0137) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9126, std.dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1251, std.dev.: 0.0519) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.42% (15.2282 => 15.4442, std.dev.: 0.0521) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0643) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 5.03% (21.1533 => 22.2174, std.dev.: 0.1262) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0305) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 14:44:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 16:44:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423214425.219FD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24872?compare_to=24871&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24872, Order: 206999, Start Time: 2014-04-23 17:11:22, End Time: 2014-04-23 21:51:04 To: 24871, Order: 206997, Start Time: 2014-04-23 16:17:00, End Time: 2014-04-23 20:58:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (106 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 29.41% (0.0680 => 0.0880, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.51% (0.3760 => 0.4080, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.2680 => 0.2800, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0062) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.09% (1.2361 => 1.3361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0933) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (5.8000 => 6.0640, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0242) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0352) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (8.1441 => 8.4561, std.dev.: 0.0599) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0321) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0510) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0266) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0091) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.29% (48.1088 => 49.2089, std.dev.: 0.0909) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8206, std.dev.: 0.0863) MultiSource/Applications/sqlite3/sqlite3: 1.75% (23.7574 => 24.1735, std.dev.: 0.0539) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1331, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.39% (15.2282 => 15.4402, std.dev.: 0.0366) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0369) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 12.12% (0.1320 => 0.1480, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0184) MultiSource/Applications/lua/lua: 4.94% (21.1533 => 22.1974, std.dev.: 0.1583) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0358) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/huffbench: -16.13% (0.1240 => 0.1040, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: -11.76% (0.4080 => 0.3600, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.90% (1.2601 => 1.2361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 14:46:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 16:46:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423214619.2FF772A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24873?compare_to=24864&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24873, Order: 206997, Start Time: 2014-04-23 17:10:18, End Time: 2014-04-23 21:53:01 To: 24864, Order: 206971, Start Time: 2014-04-23 12:08:33, End Time: 2014-04-23 16:51:28 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 14 (153 on baseline) Performance Improvements: 6 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.43% (0.1680 => 0.2040, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.88% (1.2360 => 1.2840, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.46% (1.9161 => 1.9441, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/oourafft: 1.06% (3.0122 => 3.0442, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/strcat: 20.00% (0.1200 => 0.1440, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/15-trie/trie: -20.00% (0.0800 => 0.0640, std.dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: -2.07% (20.5171 => 20.0931, std.dev.: 0.0507) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.15% (29.8019 => 29.4578, std.dev.: 0.0302) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (6.2444 => 6.1724, std.dev.: 0.0222) MultiSource/Applications/siod/siod: -1.13% (2.8442 => 2.8122, std.dev.: 0.0086) MultiSource/Benchmarks/7zip/7zip-benchmark: -1.01% (52.3610 => 51.8330, std.dev.: 0.1072) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0123) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0084) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0090) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0048) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0055) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/mandel-text: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0054) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 21.74% (0.0920 => 0.1120, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.14% (1.0240 => 1.2200, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.91% (0.1760 => 0.2040, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.84% (0.6200 => 0.7120, std.dev.: 0.0201) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.11% (0.1440 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.02% (1.5601 => 1.7321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.57% (1.8161 => 2.0081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.34% (1.5481 => 1.7081, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.31% (1.1640 => 1.2840, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/bh/bh: 9.92% (0.4840 => 0.5320, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.91% (1.7361 => 1.9081, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.57% (0.4600 => 0.5040, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.46% (1.7761 => 1.9441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0099) MultiSource/Applications/obsequi/Obsequi: 9.21% (1.8680 => 2.0400, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.89% (1.4841 => 1.6161, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (1.0240 => 1.1120, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.21% (1.6081 => 1.7401, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.80% (1.4361 => 1.5481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.69% (1.4561 => 1.5681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.56% (1.6921 => 1.8201, std.dev.: 0.0128) MultiSource/Applications/Burg/burg: 7.43% (1.5080 => 1.6200, std.dev.: 0.0249) MultiSource/Benchmarks/McCat/18-imp/imp: 7.27% (0.4400 => 0.4720, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (6.4680 => 6.9320, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (11.6440 => 12.4320, std.dev.: 0.0507) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.24% (9.4842 => 10.0762, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.20% (1.4841 => 1.5761, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.00% (1.5201 => 1.5961, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0284) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0316) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (10.0443 => 10.5123, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (5.8121 => 6.0801, std.dev.: 0.0507) MultiSource/Applications/lua/lua: 4.43% (4.7880 => 5.0000, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.36% (6.5080 => 6.7920, std.dev.: 0.0519) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.5600 => 1.6280, std.dev.: 0.0215) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0124) MultiSource/Applications/JM/lencod/lencod: 4.19% (21.9606 => 22.8808, std.dev.: 0.0443) MultiSource/Benchmarks/MallocBench/gs/gs: 4.10% (5.3600 => 5.5800, std.dev.: 0.0374) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (6.5440 => 6.8080, std.dev.: 0.0546) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.9681 => 1.0041, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0195) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0207) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.61% (50.0290 => 51.8330, std.dev.: 0.1072) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 3.53% (2.7162 => 2.8122, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 3.46% (1.7360 => 1.7960, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0165) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 3.26% (38.4046 => 39.6566, std.dev.: 0.0607) MultiSource/Applications/treecc/treecc: 3.25% (2.5840 => 2.6680, std.dev.: 0.0207) MultiSource/Applications/SPASS/SPASS: 3.21% (18.4404 => 19.0326, std.dev.: 0.0643) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (16.3483 => 16.8323, std.dev.: 0.0380) MultiSource/Applications/ClamAV/clamscan: 2.84% (19.0444 => 19.5844, std.dev.: 0.0474) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0241) MultiSource/Applications/kimwitu++/kc: 2.05% (19.6891 => 20.0931, std.dev.: 0.0507) MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (13.0563 => 13.2123, std.dev.: 0.0394) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0222) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0222) MultiSource/Applications/siod/siod: 10.63% (2.8602 => 3.1642, std.dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.89% (0.7200 => 0.7480, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (4.5603 => 4.7163, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.52% (6.6684 => 6.8364, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.26% (3.7122 => 3.7962, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.43% (11.5087 => 11.6727, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 1.23% (8.1245 => 8.2245, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.70% (2.9442 => 0.8920, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.21% (91.8497 => 49.4031, std.dev.: 10.3796) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.75% (26.0616 => 17.0051, std.dev.: 0.1062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.44% (50.3031 => 32.9781, std.dev.: 0.1356) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.77% (42.1466 => 28.7578, std.dev.: 0.2480) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1140) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.01% (1.2481 => 1.1481, std.dev.: 0.0189) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 14:57:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 16:57:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423215715.40D412A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24874?compare_to=24872&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24874, Order: 207000, Start Time: 2014-04-23 17:22:05, End Time: 2014-04-23 22:03:54 To: 24872, Order: 206999, Start Time: 2014-04-23 17:11:22, End Time: 2014-04-23 21:51:04 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (100 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0160 => 0.0320, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/2003-08-11-VaListArg: 80.00% (0.0200 => 0.0360, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.40% (0.9520 => 1.0320, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.7640 => 1.8160, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.89% (1.2681 => 1.2921, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 8.89% (0.3600 => 0.3920, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash: 7.26% (0.4960 => 0.5320, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -14.81% (0.1080 => 0.0920, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.87% (0.1840 => 0.2040, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0543) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0318) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0151) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0388) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0190) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0371) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0505) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0490) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 3.25% (17.6165 => 18.1885, std.dev.: 0.0365) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0620) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0295) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.24% (48.1088 => 49.1850, std.dev.: 0.0990) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0356) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9086, std.dev.: 0.0902) MultiSource/Applications/kimwitu++/kc: 2.15% (18.8170 => 19.2211, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.65% (15.2282 => 15.4802, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0442) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 4.88% (21.1533 => 22.1854, std.dev.: 0.1579) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0321) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.13% (4.2403 => 4.1923, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 15:23:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 17:23:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140423222317.C20F12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24875?compare_to=24865&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24875, Order: 207001, Start Time: 2014-04-23 17:43:21, End Time: 2014-04-23 22:29:57 To: 24865, Order: 206971, Start Time: 2014-04-23 12:38:06, End Time: 2014-04-23 17:24:41 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 10 (144 on baseline) Performance Improvements: 7 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-19-CodegenBug: 200.00% (0.0080 => 0.0240, std.dev.: 0.0049) SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/ccc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.32% (0.2120 => 0.2360, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 2.31% (0.8640 => 0.8840, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5480 => 0.5600, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.04% (0.9161 => 1.0081, std.dev.: 0.0175) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -1.82% (2.8562 => 2.8042, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.47% (6.2604 => 6.1684, std.dev.: 0.0257) MultiSource/Applications/kimwitu++/kc: -1.46% (20.4891 => 20.1891, std.dev.: 0.0644) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.15% (2.4402 => 2.4122, std.dev.: 0.0100) MultiSource/Benchmarks/7zip/7zip-benchmark: -1.15% (52.3890 => 51.7890, std.dev.: 0.1106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.01% (3.1762 => 3.1442, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -1.71% (1.4041 => 1.3801, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.84% (17.6723 => 19.5884, std.dev.: 0.0614) MultiSource/Applications/sqlite3/sqlite3: 1421.89% (1.7001 => 25.8736, std.dev.: 0.0480) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.37% (50.1010 => 51.7890, std.dev.: 0.1106) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.80% (1.0520 => 1.0920, std.dev.: 0.0329) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.02% (11.3920 => 12.4200, std.dev.: 0.0663) SingleSource/Benchmarks/Misc/oourafft: -73.37% (11.3407 => 3.0202, std.dev.: 0.0113) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9962, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0121) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0118) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/sumarray2d: 100.00% (0.0200 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/UnitTests/Vector/sumarray-dbl: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.07% (1.8201 => 2.0761, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.72% (1.9241 => 2.1881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.59% (1.9721 => 2.2401, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.22% (1.8761 => 2.1241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.06% (1.9601 => 2.2161, std.dev.: 0.0183) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.90% (0.1240 => 0.1400, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.76% (1.9121 => 2.1561, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.94% (2.1441 => 2.4001, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0175) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.42% (1.9201 => 2.1201, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.33% (1.8201 => 2.0081, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0134) MultiSource/Applications/obsequi/Obsequi: 9.81% (1.8760 => 2.0600, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.67% (2.0681 => 2.2681, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.26% (0.2160 => 0.2360, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.99% (1.0880 => 1.1640, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.4800 => 6.9240, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.78% (0.7080 => 0.7560, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.46% (2.9721 => 3.1642, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.68% (0.7040 => 0.7440, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0253) MultiSource/Applications/Burg/burg: 5.50% (1.5280 => 1.6120, std.dev.: 0.0297) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.1320 => 1.1920, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.81% (1.6641 => 1.7441, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0160) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (9.6042 => 10.0482, std.dev.: 0.0433) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.5760 => 1.6480, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0216) MultiSource/Applications/sgefa/sgefa: 4.55% (0.6160 => 0.6440, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0157) MultiSource/Applications/minisat/minisat: 4.25% (0.8480 => 0.8840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.19% (5.8281 => 6.0721, std.dev.: 0.0365) MultiSource/Applications/hbd/hbd: 4.17% (1.7280 => 1.8000, std.dev.: 0.0203) MultiSource/Applications/JM/ldecod/ldecod: 4.03% (10.2283 => 10.6404, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.90% (0.3080 => 0.3200, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 3.86% (2.5880 => 2.6880, std.dev.: 0.0269) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (6.5320 => 6.7800, std.dev.: 0.0443) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (2.1600 => 2.2400, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (16.3003 => 16.8923, std.dev.: 0.0470) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0428) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.31% (0.4840 => 0.5000, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: 3.13% (38.6366 => 39.8446, std.dev.: 0.0578) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 3.01% (7.0524 => 7.2645, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 2.92% (18.5284 => 19.0686, std.dev.: 0.0425) MultiSource/Benchmarks/MallocBench/gs/gs: 2.89% (5.3960 => 5.5520, std.dev.: 0.0592) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (6.5360 => 6.7240, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0157) MultiSource/Applications/JM/lencod/lencod: 2.75% (22.2206 => 22.8327, std.dev.: 0.0376) MultiSource/Applications/d/make_dparser: 2.21% (3.9761 => 4.0641, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0135) MultiSource/Applications/siod/siod: 1.89% (2.7522 => 2.8042, std.dev.: 0.0193) MultiSource/Applications/kimwitu++/kc: 1.82% (19.8291 => 20.1891, std.dev.: 0.0644) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.10% (2.1201 => 2.4402, std.dev.: 0.0367) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.4967 => 11.7087, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (4.0003 => 4.0723, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.67% (4.8043 => 4.8843, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.50% (10.4007 => 2.0281, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.16% (94.8339 => 49.1631, std.dev.: 10.7331) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.84% (49.9431 => 33.0421, std.dev.: 0.1056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.32% (25.7136 => 17.1451, std.dev.: 0.1083) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.82% (37.0863 => 28.6218, std.dev.: 0.4400) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (2.7482 => 2.5282, std.dev.: 0.0738) SingleSource/Benchmarks/Dhrystone/fldry: -7.05% (0.6240 => 0.5800, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2363 => 4.1923, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 15:29:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 17:29:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140423222939.0A4962A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24876?compare_to=24866&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24876, Order: 207001, Start Time: 2014-04-23 17:49:40, End Time: 2014-04-23 22:36:20 To: 24866, Order: 206972, Start Time: 2014-04-23 12:48:40, End Time: 2014-04-23 17:36:18 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0018) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 40.00% (0.0400 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.45% (0.2480 => 0.2640, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 5.71% (0.2800 => 0.2960, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.71% (0.3400 => 0.3560, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 1.40% (1.4321 => 1.4521, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 5.38% (0.3720 => 0.3920, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.32% (1.9001 => 1.8561, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.52% (1.8361 => 1.8081, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 15:37:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 17:37:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140423223715.82B3E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24877?compare_to=24867&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24877, Order: 207003, Start Time: 2014-04-23 17:58:59, End Time: 2014-04-23 22:43:55 To: 24867, Order: 206973, Start Time: 2014-04-23 13:00:25, End Time: 2014-04-23 17:45:32 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 5 (162 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 1.46% (1.3721 => 1.3921, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.02% (12.4963 => 12.3683, std.dev.: 0.0461) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0077) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0074) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0058) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 327.63% (0.2320 => 0.9921, std.dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0123) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0054) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0104) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0057) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 65.00% (0.0800 => 0.1320, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0049) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0197) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: 45.11% (1.3920 => 2.0200, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.31% (1.2160 => 1.5481, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.67% (1.2321 => 1.5361, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.55% (1.2401 => 1.5321, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.88% (1.1441 => 1.3601, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 18.79% (8.5802 => 10.1923, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.21% (1.3841 => 1.6361, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.84% (1.1881 => 1.4001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 15.39% (19.5406 => 22.5487, std.dev.: 0.0698) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.17% (5.3360 => 6.0921, std.dev.: 0.0300) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.64% (0.1760 => 0.2000, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.57% (1.7400 => 1.9240, std.dev.: 0.0291) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 9.29% (6.2844 => 6.8684, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 8.64% (11.3843 => 12.3683, std.dev.: 0.0461) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.52% (5.7280 => 6.2160, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.32% (11.4440 => 12.3960, std.dev.: 0.0452) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.69% (5.6680 => 6.1040, std.dev.: 0.0557) SingleSource/Benchmarks/Shootout-C++/moments: 7.41% (0.4320 => 0.4640, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.41% (0.3240 => 0.3480, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.18% (9.5802 => 10.2682, std.dev.: 0.0345) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.07% (0.7360 => 0.7880, std.dev.: 0.0149) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0206) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.44% (1.3240 => 1.3960, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.49% (0.9800 => 1.0240, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (5.3840 => 5.6120, std.dev.: 0.0398) MultiSource/Applications/lua/lua: 4.19% (4.7720 => 4.9720, std.dev.: 0.0302) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (6.8280 => 7.0920, std.dev.: 0.0456) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.1480 => 1.1920, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/lists1: 3.30% (0.3640 => 0.3760, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0074) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.18% (49.1529 => 50.7169, std.dev.: 0.1278) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 3.00% (19.2243 => 19.8004, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 2.60% (24.7575 => 25.4015, std.dev.: 0.0614) MultiSource/Benchmarks/Bullet/bullet: 2.14% (39.0726 => 39.9086, std.dev.: 0.0549) MultiSource/Applications/kimwitu++/kc: 2.07% (19.7491 => 20.1571, std.dev.: 0.0607) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.93% (6.0124 => 6.1284, std.dev.: 0.0091) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.7282 => 2.7642, std.dev.: 0.0125) MultiSource/Applications/SPASS/SPASS: 1.32% (18.7966 => 19.0446, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (16.7083 => 16.9163, std.dev.: 0.0408) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.09% (29.3298 => 29.6499, std.dev.: 0.0310) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0294) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0201) MultiSource/Applications/minisat/minisat: 4.11% (6.8204 => 7.1004, std.dev.: 0.0425) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 2.98% (5.0963 => 5.2483, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0203 => 5.1643, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: 2.35% (1.3601 => 1.3921, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 1.89% (25.4536 => 25.9336, std.dev.: 0.0226) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.27% (21.6534 => 17.9131, std.dev.: 0.0307) SingleSource/Benchmarks/Linpack/linpack-pc: -16.08% (7.8605 => 6.5964, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -9.10% (3.4722 => 3.1562, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0956) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.10% (0.3280 => 0.3080, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 15:47:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 17:47:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140423224723.4922A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24878?compare_to=24868&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24878, Order: 207003, Start Time: 2014-04-23 18:05:52, End Time: 2014-04-23 22:54:05 To: 24868, Order: 206973, Start Time: 2014-04-23 13:03:10, End Time: 2014-04-23 17:52:24 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (128 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 8.96% (0.2680 => 0.2920, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.38% (0.1880 => 0.2000, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 35.71% (0.0560 => 0.0760, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.17% (2.0441 => 2.0201, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: -1.16% (19.2406 => 19.0165, std.dev.: 0.0617) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0037) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.89% (1.8001 => 2.1761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.80% (1.6921 => 2.0441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.62% (1.8041 => 2.1761, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.82% (1.8361 => 2.2001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.02% (1.7241 => 2.0521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.87% (0.1840 => 0.2040, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.00% (0.1200 => 0.1320, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0144) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (6.7200 => 7.1640, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.9920 => 1.0560, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.42% (0.7480 => 0.7960, std.dev.: 0.0133) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.7800 => 0.8280, std.dev.: 0.0159) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.93% (1.3480 => 1.4280, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.26% (11.7880 => 12.4080, std.dev.: 0.0903) MultiSource/Applications/hexxagon/hexxagon: 5.24% (1.1440 => 1.2040, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.05% (9.9842 => 10.4882, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.00% (0.7200 => 0.7560, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 4.51% (4.7920 => 5.0080, std.dev.: 0.0316) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0152) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0196) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 3.76% (6.9124 => 7.1724, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 3.45% (10.3203 => 10.6764, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.04% (6.8321 => 7.0401, std.dev.: 0.0460) MultiSource/Applications/SPASS/SPASS: 2.83% (18.4924 => 19.0165, std.dev.: 0.0617) MultiSource/Applications/JM/lencod/lencod: 2.76% (22.6287 => 23.2528, std.dev.: 0.0612) MultiSource/Applications/treecc/treecc: 2.60% (2.6200 => 2.6880, std.dev.: 0.0262) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.58% (51.1089 => 52.4289, std.dev.: 0.1026) MultiSource/Benchmarks/Bullet/bullet: 2.38% (38.9366 => 39.8646, std.dev.: 0.0939) MultiSource/Applications/ClamAV/clamscan: 2.37% (20.2445 => 20.7245, std.dev.: 0.0581) MultiSource/Applications/kimwitu++/kc: 2.33% (19.7371 => 20.1971, std.dev.: 0.0364) MultiSource/Applications/siod/siod: 2.32% (2.7562 => 2.8202, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.5963 => 16.9523, std.dev.: 0.0718) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (3.0122 => 3.0682, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2203 => 4.2963, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.79% (6.0244 => 6.1324, std.dev.: 0.0151) MultiSource/Applications/sqlite3/sqlite3: 1.70% (25.1895 => 25.6176, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: 13.85% (0.2600 => 0.2960, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (1.2681 => 1.4281, std.dev.: 0.0262) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0447) MultiSource/Applications/spiff/spiff: 3.48% (2.1841 => 2.2601, std.dev.: 0.0252) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (4.2443 => 4.3403, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (5.1603 => 5.2443, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.0923 => 4.1523, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.08% (4.4523 => 4.5003, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.71% (6.2884 => 0.8360, std.dev.: 0.0219) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0198) SingleSource/UnitTests/Vector/multiplies: -19.51% (0.1640 => 0.1320, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.26% (7.4801 => 6.2640, std.dev.: 0.0381) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.67% (7.5041 => 6.3280, std.dev.: 0.0281) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: -6.47% (0.6800 => 0.6360, std.dev.: 0.0164) MultiSource/Benchmarks/mafft/pairlocalalign: -3.02% (13.5243 => 13.1163, std.dev.: 0.0554) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -40.00% (0.0600 => 0.0360, std.dev.: 0.0082) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.22% (21.6534 => 17.9251, std.dev.: 0.0271) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: -2.26% (8.3085 => 8.1205, std.dev.: 0.0314) MultiSource/Applications/hexxagon/hexxagon: -1.85% (11.6527 => 11.4367, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0216) MultiSource/Applications/aha/aha: -1.24% (2.9122 => 2.8762, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.06% (4.1323 => 4.0883, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 16:50:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 18:50:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140423235032.49E922A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24879?compare_to=24874&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24879, Order: 207008, Start Time: 2014-04-23 19:12:34, End Time: 2014-04-23 23:57:11 To: 24874, Order: 207000, Start Time: 2014-04-23 17:22:05, End Time: 2014-04-23 22:03:54 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (105 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.05% (0.0840 => 0.1000, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.67% (0.0960 => 0.1120, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.22% (0.1480 => 0.1720, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.76% (0.1640 => 0.1800, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.98% (0.1720 => 0.1840, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2240 => 0.2360, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0765) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0384) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.45% (8.1441 => 8.5881, std.dev.: 0.0361) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0253) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0429) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (5.8000 => 6.0760, std.dev.: 0.0381) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.71% (0.7640 => 0.8000, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0052) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3800 => 1.4360, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0253) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0348) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0385) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (7.8562 => 8.1002, std.dev.: 0.0242) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0670) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0521) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0366) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.42% (48.1088 => 49.2729, std.dev.: 0.0561) MultiSource/Applications/sqlite3/sqlite3: 2.41% (23.7574 => 24.3295, std.dev.: 0.0309) MultiSource/Benchmarks/Bullet/bullet: 2.19% (37.0925 => 37.9046, std.dev.: 0.0921) MultiSource/Applications/kimwitu++/kc: 1.79% (18.8170 => 19.1531, std.dev.: 0.0285) MultiSource/Applications/SPASS/SPASS: 1.64% (17.5484 => 17.8364, std.dev.: 0.0564) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (15.2282 => 15.4322, std.dev.: 0.0490) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0208) MultiSource/Applications/lua/lua: 4.97% (21.1533 => 22.2054, std.dev.: 0.0782) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0314) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.0123 => 5.0803, std.dev.: 0.0234) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0515) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.5522 => 3.5082, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.03% (1.1681 => 1.1561, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 17:55:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 19:55:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424005537.D13C22A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24880?compare_to=24879&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24880, Order: 207017, Start Time: 2014-04-23 20:20:09, End Time: 2014-04-24 01:02:17 To: 24879, Order: 207008, Start Time: 2014-04-23 19:12:34, End Time: 2014-04-23 23:57:11 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (106 on baseline) Performance Improvements: 0 (13 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/salsa20: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.63% (0.1640 => 0.1880, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.47% (0.2360 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2360 => 0.2520, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 6.40% (0.6880 => 0.7320, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.60% (1.2521 => 1.2721, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.50% (0.2560 => 0.2880, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/health/health: 6.32% (0.3800 => 0.4040, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.49% (4.0323 => 4.0923, std.dev.: 0.0162) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0178) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0452) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (10.6960 => 11.3840, std.dev.: 0.0539) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0262) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0288) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.48% (5.8000 => 6.0600, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0238) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0530) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0427) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0290) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0480) MultiSource/Benchmarks/Bullet/bullet: 2.51% (37.0925 => 38.0246, std.dev.: 0.0700) MultiSource/Applications/sqlite3/sqlite3: 1.95% (23.7574 => 24.2215, std.dev.: 0.0459) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0126) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.82% (48.1088 => 48.9849, std.dev.: 0.1076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0154) MultiSource/Applications/kimwitu++/kc: 1.49% (18.8170 => 19.0971, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.31% (15.2282 => 15.4282, std.dev.: 0.0321) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0414) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.13% (0.2480 => 0.2880, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0148) MultiSource/Applications/lua/lua: 4.80% (21.1533 => 22.1694, std.dev.: 0.1066) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0115) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.00% (0.6000 => 0.6120, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0072) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0080) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0537) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 18:47:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 20:47:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424014722.1C8082A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24881?compare_to=24880&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24881, Order: 207020, Start Time: 2014-04-23 21:12:42, End Time: 2014-04-24 01:54:01 To: 24880, Order: 207017, Start Time: 2014-04-23 20:20:09, End Time: 2014-04-24 01:02:17 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 4 (104 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1107 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/fbench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.4360 => 1.4760, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -12.50% (0.2880 => 0.2520, std.dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0121) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0639) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0472) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0394) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0505) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0499) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (7.8562 => 8.0962, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.7360 => 1.7880, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0391) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0400) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0252) MultiSource/Benchmarks/Bullet/bullet: 2.52% (37.0925 => 38.0286, std.dev.: 0.0586) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.35% (48.1088 => 49.2370, std.dev.: 0.0892) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0482) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1131, std.dev.: 0.0504) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.55% (15.2282 => 15.4642, std.dev.: 0.0459) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0222) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0415) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 5.05% (21.1533 => 22.2214, std.dev.: 0.1129) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/lists: 3.71% (5.8164 => 6.0324, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0319) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.14% (6.6564 => 6.7324, std.dev.: 0.0189) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -35.71% (0.0560 => 0.0360, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 19:38:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 21:38:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424023819.1AE9E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24882?compare_to=24881&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24882, Order: 207029, Start Time: 2014-04-23 22:05:09, End Time: 2014-04-24 02:44:58 To: 24881, Order: 207020, Start Time: 2014-04-23 21:12:42, End Time: 2014-04-24 01:54:01 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (96 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 250.00% (0.0080 => 0.0280, std.dev.: 0.0026) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 31.25% (0.0640 => 0.0840, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.28% (0.2280 => 0.2560, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.54% (0.1040 => 0.1160, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.36% (0.1760 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 5.63% (0.2840 => 0.3000, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: 4.65% (0.3440 => 0.3600, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.56% (0.9361 => 0.9601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.88% (1.2761 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.50% (1.3361 => 1.3561, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.28% (0.2280 => 0.2560, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.42% (1.2401 => 1.3321, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.88% (1.2201 => 1.3041, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0219) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0454) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0286) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0395) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0218) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0421) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0346) MultiSource/Benchmarks/Bullet/bullet: 2.30% (37.0925 => 37.9446, std.dev.: 0.0544) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0040) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.13% (48.1088 => 49.1329, std.dev.: 0.1040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.63% (23.7574 => 24.1455, std.dev.: 0.0645) MultiSource/Applications/kimwitu++/kc: 1.53% (18.8170 => 19.1050, std.dev.: 0.0326) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 12.36% (2.8802 => 3.2362, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1560 => 0.1680, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 4.94% (21.1533 => 22.1974, std.dev.: 0.1216) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0233) MultiSource/Applications/obsequi/Obsequi: 2.13% (2.0681 => 2.1121, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0062) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 19:43:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 21:43:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424024330.38D0E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24883?compare_to=24873&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24883, Order: 207032, Start Time: 2014-04-23 22:07:13, End Time: 2014-04-24 02:50:10 To: 24873, Order: 206997, Start Time: 2014-04-23 17:10:18, End Time: 2014-04-23 21:53:01 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 14 (148 on baseline) Performance Improvements: 3 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0054) SingleSource/UnitTests/printargs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/global_ctor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 21.87% (0.1280 => 0.1560, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 21.43% (0.0560 => 0.0680, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 20.93% (0.1720 => 0.2080, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.69% (0.2600 => 0.2800, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.00% (0.2400 => 0.2520, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 4.24% (0.4720 => 0.4920, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.75% (1.5961 => 1.6241, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.81% (1.7081 => 1.6601, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.09% (1.5281 => 1.4961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.26% (1.9081 => 1.8841, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0086) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0097) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 294.80% (0.4600 => 1.8161, std.dev.: 0.0122) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0026) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0038) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.53% (0.2280 => 0.2520, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.32% (0.6200 => 0.6840, std.dev.: 0.0221) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.97% (1.1640 => 1.2800, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0115) MultiSource/Applications/obsequi/Obsequi: 9.21% (1.8680 => 2.0400, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.49% (1.4601 => 1.5841, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 8.26% (0.4840 => 0.5240, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary2: 8.22% (0.2920 => 0.3160, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.23% (1.5481 => 1.6601, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.95% (1.7841 => 1.9081, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.42% (11.6440 => 12.3920, std.dev.: 0.0692) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.41% (1.4361 => 1.5281, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (1.4640 => 1.5560, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0171) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.4680 => 6.8720, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (1.5600 => 1.6560, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.45% (1.4681 => 1.5481, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.40% (9.4842 => 9.9962, std.dev.: 0.0418) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.35% (1.4201 => 1.4961, std.dev.: 0.0112) MultiSource/Applications/Burg/burg: 5.31% (1.5080 => 1.5880, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.89% (6.5440 => 6.8640, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (5.8121 => 6.0961, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.80% (1.5841 => 1.6601, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0206) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (5.3600 => 5.5920, std.dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.7400 => 1.8120, std.dev.: 0.0266) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 3.94% (10.0443 => 10.4403, std.dev.: 0.0448) MultiSource/Applications/JM/lencod/lencod: 3.88% (21.9606 => 22.8128, std.dev.: 0.0643) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (6.5080 => 6.7560, std.dev.: 0.0511) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (2.3281 => 2.4162, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 3.76% (4.7880 => 4.9680, std.dev.: 0.0416) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.69% (50.0290 => 51.8730, std.dev.: 0.0866) MultiSource/Benchmarks/Bullet/bullet: 3.55% (38.4046 => 39.7686, std.dev.: 0.0847) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0197) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0163) MultiSource/Applications/SPASS/SPASS: 2.91% (18.4404 => 18.9764, std.dev.: 0.0583) MultiSource/Applications/d/make_dparser: 2.72% (3.9681 => 4.0761, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: 2.58% (19.6891 => 20.1971, std.dev.: 0.0425) MultiSource/Applications/ClamAV/clamscan: 2.52% (19.0444 => 19.5244, std.dev.: 0.0660) MultiSource/Applications/lambda-0_1_3/lambda: 2.37% (0.8440 => 0.8640, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (16.3483 => 16.7043, std.dev.: 0.0462) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0154) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (13.0563 => 13.1923, std.dev.: 0.0315) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.97% (0.9241 => 1.1641, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.21% (2.1401 => 2.4442, std.dev.: 0.0346) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.25% (0.1920 => 0.2040, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.51% (4.5603 => 4.7203, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.33% (0.7200 => 0.7440, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: 3.13% (7.4205 => 7.6525, std.dev.: 0.0224) MultiSource/Applications/minisat/minisat: 2.64% (6.6684 => 6.8444, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bisort/bisort: 2.16% (0.7400 => 0.7560, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.60% (11.5087 => 11.6927, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 1.27% (21.7374 => 22.0134, std.dev.: 0.0942) MultiSource/Applications/JM/lencod/lencod: 1.18% (8.1245 => 8.2205, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.02% (2.7442 => 2.7722, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.98% (0.6720 => 0.6520, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.06% (91.8497 => 49.5471, std.dev.: 10.2168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.55% (26.0616 => 17.0571, std.dev.: 0.1227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.22% (50.3031 => 33.0901, std.dev.: 0.2474) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.27% (42.1466 => 28.5458, std.dev.: 0.4936) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1103) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0200) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.83% (4.8083 => 4.6723, std.dev.: 0.0068) MultiSource/Benchmarks/BitBench/five11/five11: -2.38% (2.3561 => 2.3001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0141) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.45% (4.1243 => 4.0643, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 19:51:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 21:51:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424025130.BA16B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24884?compare_to=24882&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24884, Order: 207036, Start Time: 2014-04-23 22:17:59, End Time: 2014-04-24 02:58:09 To: 24882, Order: 207029, Start Time: 2014-04-23 22:05:09, End Time: 2014-04-24 02:44:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (104 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/global_ctor: 400.00% (0.0040 => 0.0200, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-5: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 16.67% (0.0960 => 0.1120, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.11% (0.1480 => 0.1600, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.76% (0.9240 => 0.9680, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.95% (0.3040 => 0.3160, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.10% (1.4200 => 1.4640, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.41% (5.9520 => 6.0360, std.dev.: 0.0273) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.30% (1.2601 => 1.3521, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0563) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.09% (1.3800 => 1.4640, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0513) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0234) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (5.8000 => 6.0680, std.dev.: 0.0358) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0228) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0273) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0507) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0174) MultiSource/Benchmarks/Bullet/bullet: 2.75% (37.0925 => 38.1126, std.dev.: 0.0552) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0509) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0289) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.37% (48.1088 => 49.2489, std.dev.: 0.0672) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0371) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0091) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 1.79% (23.7574 => 24.1815, std.dev.: 0.0323) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1331, std.dev.: 0.0309) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0524) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1560 => 0.1680, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 4.80% (21.1533 => 22.1694, std.dev.: 0.1221) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -19.72% (0.2840 => 0.2280, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 20:23:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 22:23:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140424032312.5FFF02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24885?compare_to=24875&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24885, Order: 207040, Start Time: 2014-04-23 22:44:10, End Time: 2014-04-24 03:29:52 To: 24875, Order: 207001, Start Time: 2014-04-23 17:43:21, End Time: 2014-04-23 22:29:57 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 18 (133 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Applications/aha/aha: 13.33% (0.1200 => 0.1360, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 12.00% (0.1000 => 0.1120, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.10% (0.3920 => 0.4120, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.00% (0.2400 => 0.2520, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 3.92% (0.4080 => 0.4240, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.97% (1.0161 => 1.0361, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.56% (1.7920 => 1.8200, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.41% (2.2681 => 2.3001, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 41.67% (0.0480 => 0.0680, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: 7.69% (0.3640 => 0.3920, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.49% (0.3440 => 0.3560, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 2.76% (0.5800 => 0.5960, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: -11.43% (0.1400 => 0.1240, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.14% (16.8923 => 16.7003, std.dev.: 0.0473) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.45% (17.6723 => 19.6964, std.dev.: 0.0565) MultiSource/Applications/sqlite3/sqlite3: 1418.36% (1.7001 => 25.8136, std.dev.: 0.0502) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.25% (50.1010 => 51.7290, std.dev.: 0.1073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.92% (11.3920 => 12.4080, std.dev.: 0.0722) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0069) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0042, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0118) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0074) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0058) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0047) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 30.56% (0.1440 => 0.1880, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.78% (1.9161 => 2.1801, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.59% (1.9721 => 2.2401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/09-vor/vor: 12.77% (0.3760 => 0.4240, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.68% (1.9241 => 2.1681, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.50% (0.2240 => 0.2520, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.00% (0.1000 => 0.1120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.50% (1.8081 => 2.0161, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0060) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.35% (0.7400 => 0.8240, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.19% (1.8441 => 2.0321, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.14% (2.0521 => 2.2601, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/08-main/main: 9.76% (0.3280 => 0.3600, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: 8.74% (1.8760 => 2.0400, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.52% (0.7040 => 0.7640, std.dev.: 0.0105) MultiSource/Applications/spiff/spiff: 7.48% (1.0160 => 1.0920, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.31% (1.6960 => 1.8200, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (6.4800 => 6.8760, std.dev.: 0.0530) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.04% (9.6042 => 10.0882, std.dev.: 0.0375) MultiSource/Benchmarks/Prolangs-C/football/football: 4.80% (1.0840 => 1.1360, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0198) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5320 => 6.8040, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (1.8440 => 1.9200, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (5.8281 => 6.0681, std.dev.: 0.0319) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0049) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 3.85% (5.3960 => 5.6040, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 3.76% (10.2283 => 10.6124, std.dev.: 0.0462) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0098) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0277) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0220) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0106) MultiSource/Applications/lua/lua: 3.17% (4.7920 => 4.9440, std.dev.: 0.0387) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1600 => 2.2200, std.dev.: 0.0219) MultiSource/Applications/oggenc/oggenc: 2.61% (7.0524 => 7.2365, std.dev.: 0.0208) MultiSource/Benchmarks/Bullet/bullet: 2.61% (38.6366 => 39.6446, std.dev.: 0.0886) MultiSource/Applications/JM/lencod/lencod: 2.59% (22.2206 => 22.7967, std.dev.: 0.0482) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.57% (6.5360 => 6.7040, std.dev.: 0.0490) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2243 => 4.3283, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (16.3003 => 16.7003, std.dev.: 0.0473) MultiSource/Applications/SPASS/SPASS: 2.33% (18.5284 => 18.9605, std.dev.: 0.0652) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0241) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.5040 => 1.5360, std.dev.: 0.0120) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 1.47% (19.8291 => 20.1211, std.dev.: 0.0327) MultiSource/Applications/lemon/lemon: 1.08% (1.4881 => 1.5041, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.40% (2.1201 => 2.4042, std.dev.: 0.0713) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0121) MultiSource/Applications/minisat/minisat: 3.46% (6.5964 => 6.8244, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.67% (4.8043 => 4.8843, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.50% (4.0003 => 4.0603, std.dev.: 0.0179) MultiSource/Applications/hexxagon/hexxagon: 1.46% (11.4967 => 11.6647, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.50% (10.4007 => 2.0281, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.35% (94.8339 => 48.9791, std.dev.: 10.4413) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.84% (49.9431 => 33.0421, std.dev.: 0.1235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.60% (25.7136 => 17.0731, std.dev.: 0.0949) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.84% (37.0863 => 28.2458, std.dev.: 0.4472) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.57% (3.0722 => 2.3481, std.dev.: 0.1028) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0317) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0056) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0258) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 20:30:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 22:30:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424033019.4CEAD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24886?compare_to=24876&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24886, Order: 207040, Start Time: 2014-04-23 22:50:21, End Time: 2014-04-24 03:36:58 To: 24876, Order: 207001, Start Time: 2014-04-23 17:49:40, End Time: 2014-04-23 22:36:20 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 3 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 9.26% (0.2160 => 0.2360, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.16% (0.1960 => 0.2120, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.11% (0.1480 => 0.1600, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.14% (0.1680 => 0.1800, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.35% (0.7360 => 0.7680, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.36% (1.0161 => 1.0401, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.92% (2.0840 => 2.1240, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.51% (1.8561 => 1.8841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.38% (1.7441 => 1.7681, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.31% (28.7058 => 29.3698, std.dev.: 0.1530) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/pointer_method2: -75.00% (0.0320 => 0.0080, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.10% (6.1564 => 6.0884, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.10% (17.0683 => 16.8803, std.dev.: 0.0414) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 20:36:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 22:36:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140424033621.C6A672A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24887?compare_to=24877&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24887, Order: 207042, Start Time: 2014-04-23 22:58:05, End Time: 2014-04-24 03:43:01 To: 24877, Order: 207003, Start Time: 2014-04-23 17:58:59, End Time: 2014-04-23 22:43:55 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 8 (149 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 4.55% (0.4400 => 0.4600, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.91% (1.9240 => 1.9800, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.7880 => 1.8240, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.57% (1.5321 => 1.5561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.45% (1.3801 => 1.4001, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/Towers: -26.67% (0.0600 => 0.0440, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (6.1284 => 6.0564, std.dev.: 0.0218) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0076) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0067) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/nestedloop: 317.28% (0.2320 => 0.9681, std.dev.: 0.0137) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 190.48% (0.2520 => 0.7320, std.dev.: 0.0195) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0097) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0058) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0062) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0057) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: 44.25% (1.3920 => 2.0080, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0148) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.69% (1.1601 => 1.4001, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.07% (1.1561 => 1.3881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.48% (1.2321 => 1.4721, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: 18.46% (8.5802 => 10.1643, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.24% (1.1841 => 1.4001, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.21% (1.2321 => 1.4441, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.13% (1.2841 => 1.5041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.93% (1.2521 => 1.4641, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.91% (0.1760 => 0.2040, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 15.46% (19.5406 => 22.5607, std.dev.: 0.0377) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.99% (5.3360 => 6.1361, std.dev.: 0.0353) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.79% (1.7400 => 1.9800, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0067) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.34% (0.1160 => 0.1280, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (11.3843 => 12.4363, std.dev.: 0.0292) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.10% (5.7280 => 6.1920, std.dev.: 0.0475) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.02% (0.6480 => 0.7000, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.00% (11.4440 => 12.3600, std.dev.: 0.0788) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.69% (5.6680 => 6.1040, std.dev.: 0.0571) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (9.5802 => 10.2642, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/ary: 5.71% (0.2800 => 0.2960, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.6240 => 1.7080, std.dev.: 0.0179) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (5.3840 => 5.6120, std.dev.: 0.0418) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7600 => 1.8240, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (1.0680 => 1.1040, std.dev.: 0.0115) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.33% (49.1529 => 50.7889, std.dev.: 0.0811) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.22% (6.8280 => 7.0480, std.dev.: 0.0431) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.21% (0.8721 => 0.9001, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 2.98% (19.2243 => 19.7964, std.dev.: 0.0712) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (2.0920 => 2.1520, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 2.76% (24.7575 => 25.4415, std.dev.: 0.0480) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (2.7282 => 2.7802, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 1.84% (19.7491 => 20.1131, std.dev.: 0.0401) MultiSource/Benchmarks/Bullet/bullet: 1.60% (39.0726 => 39.6966, std.dev.: 0.0643) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.13% (3.9842 => 4.2683, std.dev.: 0.0242) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0199) MultiSource/Applications/minisat/minisat: 4.11% (6.8204 => 7.1004, std.dev.: 0.0384) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (0.5920 => 0.6120, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 3.14% (5.0963 => 5.2563, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (25.4536 => 25.9176, std.dev.: 0.0485) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0240) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.11% (3.2362 => 3.2722, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.37% (21.6534 => 17.8931, std.dev.: 0.0375) SingleSource/Benchmarks/Linpack/linpack-pc: -16.08% (7.8605 => 6.5964, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -9.33% (3.4722 => 3.1482, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.44% (5.2763 => 4.9363, std.dev.: 0.0904) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.05% (4.5123 => 4.2843, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 20:50:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 22:50:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140424035002.8C25F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24888?compare_to=24878&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24888, Order: 207042, Start Time: 2014-04-23 23:08:15, End Time: 2014-04-24 03:56:44 To: 24878, Order: 207003, Start Time: 2014-04-23 18:05:52, End Time: 2014-04-23 22:54:05 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (134 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 20.00% (0.1000 => 0.1200, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 15.15% (0.1320 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0039) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.90% (1.3800 => 1.4200, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (5.5920 => 5.7320, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.92% (1.0441 => 1.0641, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 9.12% (1.2281 => 1.3401, std.dev.: 0.0346) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.38% (0.8681 => 0.8801, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0070) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.28% (1.6961 => 2.0401, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.09% (1.7321 => 2.0801, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.33% (1.6761 => 2.0001, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.26% (1.7241 => 2.0561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.97% (1.7921 => 2.1321, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.84% (1.7201 => 2.0441, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.51% (1.9881 => 2.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.8281 => 2.1641, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.08% (1.8361 => 2.1681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.61% (1.9081 => 2.2441, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.36% (1.9801 => 2.3041, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.09% (0.3480 => 0.4040, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.38% (0.1040 => 0.1200, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0087) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0027) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0058) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/18-imp/imp: 7.02% (0.4560 => 0.4880, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.9920 => 1.0560, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.12% (0.7840 => 0.8320, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.7200 => 0.7640, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.07% (6.7200 => 7.1280, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.8601 => 0.9121, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (11.7880 => 12.4920, std.dev.: 0.0683) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 5.75% (0.3480 => 0.3680, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.4160 => 1.4880, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (9.9842 => 10.4642, std.dev.: 0.0380) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0133) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.75% (1.3480 => 1.4120, std.dev.: 0.0147) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0108) MultiSource/Applications/d/make_dparser: 4.54% (3.9641 => 4.1441, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.32% (0.5560 => 0.5800, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0373) MultiSource/Applications/treecc/treecc: 4.12% (2.6200 => 2.7280, std.dev.: 0.0236) MultiSource/Applications/oggenc/oggenc: 4.11% (6.9124 => 7.1964, std.dev.: 0.0095) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.50% (1.3720 => 1.4200, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists1: 3.33% (0.3600 => 0.3720, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (5.5480 => 5.7320, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (2.0680 => 2.1360, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (6.8321 => 7.0561, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.5000 => 0.5160, std.dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 3.18% (10.3203 => 10.6484, std.dev.: 0.0489) MultiSource/Applications/SPASS/SPASS: 3.12% (18.4924 => 19.0685, std.dev.: 0.0577) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.11% (0.6440 => 0.6640, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 2.72% (22.6287 => 23.2448, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0108) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (51.1089 => 52.3729, std.dev.: 0.1319) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 2.25% (19.7371 => 20.1811, std.dev.: 0.0672) MultiSource/Benchmarks/Bullet/bullet: 2.20% (38.9366 => 39.7926, std.dev.: 0.0788) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: 2.04% (20.2445 => 20.6565, std.dev.: 0.0608) MultiSource/Applications/sqlite3/sqlite3: 1.92% (25.1895 => 25.6736, std.dev.: 0.0247) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (16.5963 => 16.8483, std.dev.: 0.0660) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 24.52% (7.3405 => 9.1406, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.25% (1.2681 => 1.4361, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 10.56% (1.2121 => 1.3401, std.dev.: 0.0346) MultiSource/Applications/siod/siod: 10.18% (2.8282 => 3.1162, std.dev.: 0.0204) SingleSource/Benchmarks/McGill/queens: 3.86% (2.1761 => 2.2601, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.61% (0.9961 => 1.0321, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0179) MultiSource/Applications/lua/lua: 2.01% (21.6534 => 22.0894, std.dev.: 0.0987) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5322 => 2.5642, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.26% (6.2884 => 0.8640, std.dev.: 0.0119) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.67% (3.1762 => 1.3761, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: -22.36% (2.6481 => 2.0560, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (7.4801 => 6.2520, std.dev.: 0.0464) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.89% (7.5041 => 6.3120, std.dev.: 0.0508) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0085) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (13.5243 => 13.1243, std.dev.: 0.0360) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -40.00% (0.0600 => 0.0360, std.dev.: 0.0074) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.51% (21.6534 => 17.8611, std.dev.: 0.0384) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -8.42% (3.4682 => 3.1762, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.17% (0.9281 => 0.8801, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0069) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0345) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.62% (3.3602 => 3.2722, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: -2.21% (8.3085 => 8.1245, std.dev.: 0.0298) MultiSource/Applications/hexxagon/hexxagon: -1.89% (11.6527 => 11.4327, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 21:52:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Apr 2014 23:52:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424045257.D4BC32A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24889?compare_to=24884&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24889, Order: 207050, Start Time: 2014-04-24 00:16:00, End Time: 2014-04-24 04:59:36 To: 24884, Order: 207036, Start Time: 2014-04-23 22:17:59, End Time: 2014-04-24 02:58:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (99 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-13-SDivTwo: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.76% (0.1640 => 0.1800, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 2.26% (0.7080 => 0.7240, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.07% (1.3521 => 1.3801, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.76% (1.3641 => 1.3881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.61% (1.2441 => 1.2641, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 41.67% (0.0480 => 0.0680, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 18.18% (0.0880 => 0.1040, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (0.1840 => 0.1960, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.14% (5.4083 => 5.5243, std.dev.: 0.0450) MultiSource/Benchmarks/BitBench/five11/five11: 2.09% (2.3001 => 2.3481, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: 1.53% (2.0881 => 2.1201, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0658) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0486) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0103) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0167) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0319) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0220) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (8.1441 => 8.4481, std.dev.: 0.0546) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0411) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0569) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (10.4082 => 10.7122, std.dev.: 0.0403) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0423) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0353) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.20% (48.1088 => 49.1650, std.dev.: 0.0820) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 1.97% (37.0925 => 37.8245, std.dev.: 0.0682) MultiSource/Applications/sqlite3/sqlite3: 1.48% (23.7574 => 24.1095, std.dev.: 0.0396) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 1.25% (18.8170 => 19.0530, std.dev.: 0.0433) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 20.60% (0.9321 => 1.1241, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0187) MultiSource/Applications/lua/lua: 5.03% (21.1533 => 22.2174, std.dev.: 0.1718) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0238) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (25.8896 => 26.7977, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: 2.51% (2.0681 => 2.1201, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0090) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0599) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0140) SingleSource/Benchmarks/Stanford/Puzzle: -13.33% (0.1200 => 0.1040, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.04% (4.2403 => 4.1963, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 22:56:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 00:56:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424055644.B22D02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24890?compare_to=24889&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24890, Order: 207056, Start Time: 2014-04-24 01:21:42, End Time: 2014-04-24 06:03:21 To: 24889, Order: 207050, Start Time: 2014-04-24 00:16:00, End Time: 2014-04-24 04:59:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (113 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray-dbl: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/initp1: 44.44% (0.0360 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 7.23% (0.3320 => 0.3560, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 5.06% (0.3160 => 0.3320, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.67% (0.4280 => 0.4480, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.7040 => 0.7280, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: 3.05% (0.7880 => 0.8120, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.7240 => 0.7400, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.23% (8.4481 => 8.5521, std.dev.: 0.0399) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0042) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (10.6960 => 11.4960, std.dev.: 0.0507) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.36% (0.6520 => 0.7000, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0399) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0379) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (4.9200 => 5.1360, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0210) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0395) MultiSource/Applications/JM/lencod/lencod: 2.88% (17.6165 => 18.1245, std.dev.: 0.0441) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.4400 => 1.4800, std.dev.: 0.0153) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (48.1088 => 49.2969, std.dev.: 0.0719) MultiSource/Benchmarks/Bullet/bullet: 2.46% (37.0925 => 38.0046, std.dev.: 0.0786) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0337) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 1.87% (18.8170 => 19.1691, std.dev.: 0.0410) MultiSource/Applications/sqlite3/sqlite3: 1.84% (23.7574 => 24.1935, std.dev.: 0.0450) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (15.2282 => 15.4002, std.dev.: 0.0402) MultiSource/Applications/SPASS/SPASS: 1.00% (17.5484 => 17.7244, std.dev.: 0.0657) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0162) MultiSource/Applications/lua/lua: 5.05% (21.1533 => 22.2214, std.dev.: 0.1368) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0413) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.49% (3.5322 => 3.6202, std.dev.: 0.0340) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 1.20% (6.6564 => 6.7364, std.dev.: 0.0294) MultiSource/Applications/lambda-0_1_3/lambda: 1.04% (5.0123 => 5.0643, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0091) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 23 23:47:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 01:47:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424064755.0FC812A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24891?compare_to=24890&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24891, Order: 207061, Start Time: 2014-04-24 02:12:45, End Time: 2014-04-24 06:54:26 To: 24890, Order: 207056, Start Time: 2014-04-24 01:21:42, End Time: 2014-04-24 06:03:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 5 (99 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 6.06% (0.2640 => 0.2800, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.13% (0.5120 => 0.5280, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 38.46% (0.0520 => 0.0720, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: -20.00% (0.1200 => 0.0960, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 133.33% (0.0120 => 0.0280, std.dev.: 0.0059) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0861) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0448) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0148) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0468) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.9200 => 0.9520, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0516) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0265) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0377) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0473) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0461) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8886, std.dev.: 0.0956) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.12% (48.1088 => 49.1290, std.dev.: 0.0526) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0141) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 1.75% (23.7574 => 24.1735, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0390) MultiSource/Applications/kimwitu++/kc: 1.51% (18.8170 => 19.1011, std.dev.: 0.0322) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0168) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0192) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0225) MultiSource/Applications/lua/lua: 5.07% (21.1533 => 22.2254, std.dev.: 0.0739) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0322) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0056) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 00:37:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 02:37:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424073714.54FAB2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24892?compare_to=24891&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24892, Order: 207063, Start Time: 2014-04-24 03:03:48, End Time: 2014-04-24 07:43:50 To: 24891, Order: 207061, Start Time: 2014-04-24 02:12:45, End Time: 2014-04-24 06:54:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (104 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.83% (0.0960 => 0.1160, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.82% (0.1560 => 0.1760, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.62% (0.2320 => 0.2520, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 2.78% (0.7200 => 0.7400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.92% (1.4561 => 1.4841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (6.3760 => 6.4640, std.dev.: 0.0258) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.53% (0.2280 => 0.2520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (6.0160 => 6.4640, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.73% (1.2481 => 1.3321, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (10.6960 => 11.3560, std.dev.: 0.0771) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 5.04% (4.5200 => 4.7480, std.dev.: 0.0386) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0688) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0183) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0124) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0528) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0233) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0549) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0507) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.49% (48.1088 => 49.3049, std.dev.: 0.0690) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0287) MultiSource/Benchmarks/Bullet/bullet: 2.30% (37.0925 => 37.9446, std.dev.: 0.1005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0338) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0482) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0613) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (15.2282 => 15.3882, std.dev.: 0.0388) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 5.07% (21.1533 => 22.2254, std.dev.: 0.0889) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout/lists: 3.71% (5.8164 => 6.0324, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (25.8896 => 26.7897, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0336) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0232) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 00:45:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 02:45:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424074525.667082A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24893?compare_to=24883&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24893, Order: 207063, Start Time: 2014-04-24 03:08:57, End Time: 2014-04-24 07:52:01 To: 24883, Order: 207032, Start Time: 2014-04-23 22:07:13, End Time: 2014-04-24 02:50:10 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 21 (153 on baseline) Performance Improvements: 2 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.41% (0.2160 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.51% (0.4560 => 0.4720, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.4800 => 0.4960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4800 => 0.4960, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.10% (0.9040 => 0.9320, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.89% (1.6601 => 1.7081, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.6520 => 0.6680, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.77% (1.5841 => 1.6121, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: 1.62% (1.4801 => 1.5041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.57% (1.5241 => 1.5481, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.57% (1.5281 => 1.5521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.26% (1.9081 => 1.9321, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.03% (3.1202 => 3.1522, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.17% (3.9122 => 4.0363, std.dev.: 0.0393) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/Queens: -23.08% (0.0520 => 0.0400, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -2.12% (0.7560 => 0.7400, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.43% (11.3687 => 3.0202, std.dev.: 0.0103) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0129) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 295.67% (0.4600 => 1.8201, std.dev.: 0.0108) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/UnitTests/ms_struct-bitfield-init: 200.00% (0.0080 => 0.0240, std.dev.: 0.0022) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0040) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0053) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 25.81% (0.1240 => 0.1560, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 22.73% (0.1760 => 0.2160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.69% (0.1160 => 0.1400, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.3640 => 0.4160, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.19% (0.6200 => 0.7080, std.dev.: 0.0234) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0145) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.34% (1.5481 => 1.7081, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0113) MultiSource/Applications/obsequi/Obsequi: 9.85% (1.8680 => 2.0520, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0161) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/wc: 9.52% (0.2520 => 0.2760, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.46% (1.7761 => 1.9441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.01% (1.4201 => 1.5481, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (1.0240 => 1.1160, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.93% (1.6121 => 1.7561, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0063) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.30% (1.7841 => 1.9321, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 8.11% (0.2960 => 0.3200, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.08% (1.4361 => 1.5521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (1.1640 => 1.2560, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4600 => 0.4960, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.69% (1.4561 => 1.5681, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0087) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (6.4680 => 6.9080, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: 6.63% (1.5080 => 1.6080, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (11.6440 => 12.3880, std.dev.: 0.0737) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.2600 => 0.2760, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.07% (9.4842 => 10.0602, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.7400 => 1.8440, std.dev.: 0.0164) MultiSource/Applications/spiff/spiff: 5.95% (1.0080 => 1.0680, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.64% (5.8121 => 6.1401, std.dev.: 0.0417) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.95% (6.5440 => 6.8680, std.dev.: 0.0231) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.5480 => 1.6240, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.5600 => 1.6360, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0155) MultiSource/Applications/JM/lencod/lencod: 4.43% (21.9606 => 22.9328, std.dev.: 0.0475) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (6.5080 => 6.7840, std.dev.: 0.0597) MultiSource/Benchmarks/MallocBench/gs/gs: 4.18% (5.3600 => 5.5840, std.dev.: 0.0461) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (3.0282 => 3.1522, std.dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.0443 => 10.4523, std.dev.: 0.0612) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (2.0440 => 2.1240, std.dev.: 0.0245) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0190) MultiSource/Applications/lua/lua: 3.68% (4.7880 => 4.9640, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/sieve: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 3.46% (38.4046 => 39.7326, std.dev.: 0.0556) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.45% (50.0290 => 51.7570, std.dev.: 0.1184) MultiSource/Applications/SPASS/SPASS: 3.36% (18.4404 => 19.0606, std.dev.: 0.0587) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (4.1843 => 4.3163, std.dev.: 0.0100) MultiSource/Applications/d/make_dparser: 3.12% (3.9681 => 4.0921, std.dev.: 0.0190) MultiSource/Applications/treecc/treecc: 3.10% (2.5840 => 2.6640, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0194) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 2.75% (19.0444 => 19.5684, std.dev.: 0.0418) MultiSource/Applications/kimwitu++/kc: 2.50% (19.6891 => 20.1811, std.dev.: 0.0486) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (16.3483 => 16.7283, std.dev.: 0.0644) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (13.0563 => 13.2483, std.dev.: 0.0307) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (6.1044 => 6.1804, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0494) MultiSource/Applications/siod/siod: 10.35% (2.8602 => 3.1562, std.dev.: 0.0268) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.25% (4.5603 => 4.7083, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0491) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.26% (3.7122 => 3.7962, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 2.16% (6.6684 => 6.8124, std.dev.: 0.0408) MultiSource/Applications/lua/lua: 1.71% (21.7374 => 22.1094, std.dev.: 0.1261) MultiSource/Applications/hexxagon/hexxagon: 1.67% (11.5087 => 11.7007, std.dev.: 0.0160) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 1.08% (9.2606 => 9.3606, std.dev.: 0.0193) MultiSource/Applications/JM/lencod/lencod: 1.03% (8.1245 => 8.2085, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.91% (10.6247 => 2.0281, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.34% (2.9442 => 0.9320, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.28% (91.8497 => 49.3391, std.dev.: 10.6750) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.61% (26.0616 => 17.0411, std.dev.: 0.1133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.13% (50.3031 => 33.1341, std.dev.: 0.0888) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.91% (42.1466 => 28.2778, std.dev.: 0.4421) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1134) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.76% (0.3400 => 0.3000, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.34% (0.1160 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3561 => 2.3161, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0124) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 00:50:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 02:50:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424075004.C43752A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24894?compare_to=24892&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24894, Order: 207065, Start Time: 2014-04-24 03:16:42, End Time: 2014-04-24 07:56:36 To: 24892, Order: 207063, Start Time: 2014-04-24 03:03:48, End Time: 2014-04-24 07:43:50 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (108 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.00% (0.2400 => 0.2640, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/fibo: 9.62% (0.2080 => 0.2280, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2440 => 0.2560, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.40% (1.3321 => 1.3641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.80% (1.3361 => 1.3601, std.dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.07% (1.1601 => 1.3001, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.92% (1.2081 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.51% (1.2161 => 1.3561, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.50% (1.1481 => 1.2801, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.75% (1.2281 => 1.3601, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.65% (6.0160 => 6.4760, std.dev.: 0.0480) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0898) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0516) MultiSource/Applications/Burg/burg: 4.66% (1.4600 => 1.5280, std.dev.: 0.0175) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0325) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (10.4082 => 10.8282, std.dev.: 0.0318) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0523) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0484) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 3.32% (17.6165 => 18.2005, std.dev.: 0.0404) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (7.8562 => 8.1002, std.dev.: 0.0311) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0495) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 2.67% (37.0925 => 38.0846, std.dev.: 0.0658) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.63% (48.1088 => 49.3730, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0417) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0157) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0380) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0185) MultiSource/Applications/kimwitu++/kc: 1.79% (18.8170 => 19.1531, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (15.2282 => 15.4562, std.dev.: 0.0250) MultiSource/Applications/SPASS/SPASS: 1.48% (17.5484 => 17.8084, std.dev.: 0.0390) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0234) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0193) MultiSource/Applications/lua/lua: 4.92% (21.1533 => 22.1934, std.dev.: 0.0920) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (25.8896 => 26.7377, std.dev.: 0.0510) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/bmm/bmm: -14.29% (0.0840 => 0.0720, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.4080 => 0.3720, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 7.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 01:28:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 03:28:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140424082823.77AA02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24895?compare_to=24885&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24895, Order: 207067, Start Time: 2014-04-24 03:48:37, End Time: 2014-04-24 08:34:55 To: 24885, Order: 207040, Start Time: 2014-04-23 22:44:10, End Time: 2014-04-24 03:29:52 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 10 (132 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.30% (0.7440 => 0.7760, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.84% (2.1681 => 2.2081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.70% (2.1201 => 2.1561, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.63% (1.9681 => 2.0001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.57% (2.0321 => 2.0641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.22% (1.9721 => 1.9961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.17% (2.0521 => 2.0761, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 5.51% (0.5080 => 0.5360, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -14.29% (0.1120 => 0.0960, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.57% (17.6723 => 19.7163, std.dev.: 0.0403) MultiSource/Applications/sqlite3/sqlite3: 1420.00% (1.7001 => 25.8416, std.dev.: 0.0405) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.33% (50.1010 => 51.7690, std.dev.: 0.1337) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.20% (11.3920 => 12.4400, std.dev.: 0.0467) SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3407 => 3.0242, std.dev.: 0.0092) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0203, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0140) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0028) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 26.09% (0.0920 => 0.1160, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.41% (1.8281 => 2.1281, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 16.16% (1.8561 => 2.1561, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.99% (2.0281 => 2.3321, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.80% (1.8921 => 2.1721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.76% (1.9241 => 2.2081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.60% (1.8081 => 2.0721, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.98% (0.3720 => 0.4240, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.86% (2.1361 => 2.4322, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.64% (1.7721 => 1.9961, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.00% (1.9001 => 2.1281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.98% (2.1041 => 2.3561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.93% (1.8441 => 2.0641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.87% (1.8201 => 2.0361, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.61% (1.8601 => 2.0761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.46% (1.9201 => 2.1401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0130) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: 9.38% (1.8760 => 2.0520, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0062) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 7.14% (0.6160 => 0.6600, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (6.4800 => 6.9360, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.78% (0.7080 => 0.7560, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.4760 => 0.5080, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0179) SingleSource/Regression/C/bigstack: 6.67% (0.1800 => 0.1920, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.7480 => 1.8520, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0177) MultiSource/Applications/hexxagon/hexxagon: 5.65% (1.1320 => 1.1960, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0276) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 5.24% (1.5280 => 1.6080, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.17% (0.2320 => 0.2440, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.04% (9.6042 => 10.0882, std.dev.: 0.0568) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (5.8281 => 6.0881, std.dev.: 0.0266) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (6.5320 => 6.8080, std.dev.: 0.0468) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.2283 => 10.6604, std.dev.: 0.0365) MultiSource/Applications/lua/lua: 4.17% (4.7920 => 4.9920, std.dev.: 0.0198) MultiSource/Applications/hbd/hbd: 4.17% (1.7280 => 1.8000, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.94% (2.3401 => 2.4322, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0084) MultiSource/Applications/treecc/treecc: 3.55% (2.5880 => 2.6800, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (16.3003 => 16.8643, std.dev.: 0.0402) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (5.3960 => 5.5800, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (6.5360 => 6.7560, std.dev.: 0.0393) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: 3.15% (18.5284 => 19.1125, std.dev.: 0.0376) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.93% (22.2206 => 22.8727, std.dev.: 0.0504) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.5040 => 1.5480, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 2.91% (38.6366 => 39.7606, std.dev.: 0.0871) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0177) MultiSource/Applications/d/make_dparser: 2.52% (3.9761 => 4.0761, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2243 => 4.3163, std.dev.: 0.0165) MultiSource/Applications/siod/siod: 2.03% (2.7522 => 2.8082, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 1.78% (19.8291 => 20.1811, std.dev.: 0.0524) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.7842 => 2.8122, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 44.44% (0.0360 => 0.0520, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.10% (2.1201 => 2.4402, std.dev.: 0.0300) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.5040 => 0.5360, std.dev.: 0.0078) MultiSource/Benchmarks/llubenchmark/llu: 5.30% (5.0603 => 5.3283, std.dev.: 0.0635) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 3.82% (6.5964 => 6.8484, std.dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.80% (3.7122 => 3.8162, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.95% (11.4967 => 11.7207, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.67% (4.8043 => 4.8843, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.3801 => 1.4001, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.54% (10.4007 => 2.0241, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/fbench: -27.27% (0.0880 => 0.0640, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.26% (94.8339 => 49.0671, std.dev.: 10.4835) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.02% (49.9431 => 32.9501, std.dev.: 0.2228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.70% (25.7136 => 17.0491, std.dev.: 0.1107) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.14% (37.0863 => 28.5058, std.dev.: 0.5601) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.92% (7.8165 => 6.7284, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.61% (2.7482 => 2.4842, std.dev.: 0.0906) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.89% (1.2681 => 1.1681, std.dev.: 0.0234) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0059) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0239) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 01:35:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 03:35:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424083558.EE3F92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24896?compare_to=24886&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24896, Order: 207067, Start Time: 2014-04-24 03:55:31, End Time: 2014-04-24 08:42:40 To: 24886, Order: 207040, Start Time: 2014-04-23 22:50:21, End Time: 2014-04-24 03:36:58 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1102 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 13.73% (0.2040 => 0.2320, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.94% (0.8080 => 0.8560, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3160 => 0.3320, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.72% (1.1601 => 1.1801, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 1.71% (2.8042 => 2.8522, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.58% (1.7761 => 1.8041, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (16.8803 => 17.0643, std.dev.: 0.0496) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 126.32% (0.2280 => 0.5160, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0119) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 01:40:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 03:40:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140424084037.0B7AF2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24897?compare_to=24887&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24897, Order: 207070, Start Time: 2014-04-24 04:01:57, End Time: 2014-04-24 08:47:17 To: 24887, Order: 207042, Start Time: 2014-04-23 22:58:05, End Time: 2014-04-24 03:43:01 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (166 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 27.78% (0.0720 => 0.0920, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 25.00% (0.0800 => 0.1000, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.77% (1.4441 => 1.4841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.31% (1.3881 => 1.4201, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.90% (1.0521 => 1.0721, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.30% (1.5441 => 1.5641, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: 1.04% (18.9205 => 19.1165, std.dev.: 0.0467) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 6.12% (1.3081 => 1.3881, std.dev.: 0.0245) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2325.00% (0.0320 => 0.7760, std.dev.: 0.0163) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0090) SingleSource/Regression/C/sumarray2d: 977.78% (0.0360 => 0.3880, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0090) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 195.24% (0.2520 => 0.7440, std.dev.: 0.0195) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0054) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 92.31% (0.1040 => 0.2000, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0040) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0047) SingleSource/UnitTests/2003-05-26-Shorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 65.00% (0.0800 => 0.1320, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0056) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: 45.40% (1.3920 => 2.0240, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 31.58% (0.1520 => 0.2000, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 29.63% (0.1080 => 0.1400, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.32% (1.2481 => 1.5641, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 25.00% (0.0960 => 0.1200, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.84% (1.1561 => 1.4201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.55% (1.1321 => 1.3761, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.12% (1.1361 => 1.3761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.77% (1.1361 => 1.3721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.45% (1.2321 => 1.4841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.45% (1.2521 => 1.5081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.06% (1.2161 => 1.4601, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.88% (1.3681 => 1.6401, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.25% (1.2881 => 1.5361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: 19.07% (8.5802 => 10.2163, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 15.82% (19.5406 => 22.6327, std.dev.: 0.0619) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.81% (0.1080 => 0.1240, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 14.79% (1.3521 => 1.5521, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.77% (5.3360 => 6.1241, std.dev.: 0.0356) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.92% (0.3160 => 0.3600, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.7400 => 1.9560, std.dev.: 0.0229) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0123) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.11% (0.4320 => 0.4800, std.dev.: 0.0158) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 9.56% (11.3843 => 12.4723, std.dev.: 0.0305) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.22% (5.7280 => 6.2560, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.17% (5.6680 => 6.1880, std.dev.: 0.0386) MultiSource/Applications/oggenc/oggenc: 9.04% (6.2844 => 6.8524, std.dev.: 0.0250) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 8.50% (0.6120 => 0.6640, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.93% (11.4440 => 12.3520, std.dev.: 0.0854) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.26% (9.5802 => 10.2762, std.dev.: 0.0294) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.02% (0.3320 => 0.3520, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.4760 => 1.5520, std.dev.: 0.0276) MultiSource/Benchmarks/MallocBench/gs/gs: 5.13% (5.3840 => 5.6600, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 4.95% (4.7720 => 5.0080, std.dev.: 0.0254) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0051) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.10% (6.8280 => 7.1080, std.dev.: 0.0473) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.91% (49.1529 => 51.0729, std.dev.: 0.0792) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.6961 => 1.7561, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (2.2081 => 2.2841, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 3.17% (24.7575 => 25.5416, std.dev.: 0.0150) MultiSource/Applications/ClamAV/clamscan: 2.91% (19.2243 => 19.7844, std.dev.: 0.0548) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (1.7320 => 1.7800, std.dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: 2.57% (19.7491 => 20.2571, std.dev.: 0.0360) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 2.08% (39.0726 => 39.8846, std.dev.: 0.1083) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.90% (1.0521 => 1.0721, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 1.70% (18.7966 => 19.1165, std.dev.: 0.0467) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0124 => 6.1124, std.dev.: 0.0179) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (3.0402 => 3.0802, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (16.7083 => 16.9163, std.dev.: 0.0530) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.79% (1.3121 => 1.3881, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0226) MultiSource/Applications/minisat/minisat: 4.22% (6.8204 => 7.1084, std.dev.: 0.0239) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0281) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.03% (5.0203 => 5.1723, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 2.83% (5.0963 => 5.2403, std.dev.: 0.0391) MultiSource/Applications/sqlite3/sqlite3: 2.66% (4.0563 => 4.1643, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (25.4536 => 25.9016, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 1.08% (21.7974 => 22.0334, std.dev.: 0.0507) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.18% (21.6534 => 17.9331, std.dev.: 0.0276) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -8.87% (3.4722 => 3.1642, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.1034) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.01% (2.7802 => 2.7522, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0182) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 01:57:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 03:57:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140424085723.690DB2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24898?compare_to=24888&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24898, Order: 207070, Start Time: 2014-04-24 04:15:32, End Time: 2014-04-24 09:04:06 To: 24888, Order: 207042, Start Time: 2014-04-23 23:08:15, End Time: 2014-04-24 03:56:44 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (147 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR640: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Regression/C/matrixTranspose: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 10.81% (0.1480 => 0.1640, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 3.73% (1.0720 => 1.1120, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.80% (2.0001 => 2.0361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.57% (2.0441 => 2.0761, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.56% (2.0561 => 2.0881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.36% (2.0641 => 2.0921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.30% (2.1601 => 2.1881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.19% (2.3561 => 2.3841, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.1200 => 0.1400, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.89% (0.1800 => 0.1640, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.82% (0.8801 => 0.8641, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0120) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0052) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0045) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0049) SingleSource/Regression/C/sumarraymalloc: 22.73% (0.0880 => 0.1080, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.63% (1.7201 => 2.0921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.58% (1.6681 => 2.0281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.53% (1.6721 => 2.0321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.48% (1.6761 => 2.0361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.31% (1.7081 => 2.0721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.11% (1.7241 => 2.0881, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.02% (1.8081 => 2.1881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.89% (1.8001 => 2.1761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.84% (1.8041 => 2.1801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.80% (1.6921 => 2.0441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.70% (1.7201 => 2.0761, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.53% (1.7921 => 2.1601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.40% (1.9801 => 2.3841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.92% (1.9881 => 2.3841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.56% (1.8201 => 2.1761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.53% (1.9641 => 2.3281, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.19% (1.9081 => 2.2361, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0234) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 9.02% (1.0200 => 1.1120, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.78% (0.7200 => 0.7760, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.85% (11.7880 => 12.5960, std.dev.: 0.0706) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (3.5002 => 3.7362, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (6.7200 => 7.1640, std.dev.: 0.0526) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.25% (1.5240 => 1.6040, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0070) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.04% (1.3480 => 1.4160, std.dev.: 0.0141) MultiSource/Applications/lua/lua: 4.92% (4.7920 => 5.0280, std.dev.: 0.0328) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.84% (0.2480 => 0.2600, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0211) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (9.9842 => 10.4482, std.dev.: 0.0655) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0072) MultiSource/Applications/d/make_dparser: 4.44% (3.9641 => 4.1401, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0281) MultiSource/Applications/oggenc/oggenc: 4.11% (6.9124 => 7.1964, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (6.8321 => 7.1001, std.dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0082) MultiSource/Applications/Burg/burg: 3.85% (1.5600 => 1.6200, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0075) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.70% (0.7560 => 0.7840, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 3.61% (18.4924 => 19.1605, std.dev.: 0.0404) MultiSource/Applications/JM/ldecod/ldecod: 3.49% (10.3203 => 10.6804, std.dev.: 0.0468) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0283) MultiSource/Applications/JM/lencod/lencod: 3.20% (22.6287 => 23.3527, std.dev.: 0.0592) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.05% (3.0122 => 3.1042, std.dev.: 0.0097) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.98% (51.1089 => 52.6329, std.dev.: 0.0802) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 2.64% (38.9366 => 39.9646, std.dev.: 0.0933) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (1.0001 => 1.0241, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 2.37% (19.7371 => 20.2051, std.dev.: 0.0828) MultiSource/Applications/siod/siod: 2.32% (2.7562 => 2.8202, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (16.5963 => 16.9803, std.dev.: 0.0477) MultiSource/Applications/ClamAV/clamscan: 2.23% (20.2445 => 20.6965, std.dev.: 0.0617) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0201) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 1.73% (25.1895 => 25.6256, std.dev.: 0.0455) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0244 => 6.1124, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (29.4578 => 29.7739, std.dev.: 0.0492) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.44% (6.6644 => 17.1571, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 3.91% (0.5120 => 0.5320, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1761 => 2.2521, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.44% (3.4842 => 3.6042, std.dev.: 0.0309) MultiSource/Applications/minisat/minisat: 2.93% (6.8204 => 7.0204, std.dev.: 0.0574) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 1.96% (21.6534 => 22.0774, std.dev.: 0.1635) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.27% (4.0923 => 4.1443, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (2.5322 => 2.5602, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/nestedloop: -60.32% (2.9642 => 1.1761, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (7.4801 => 6.2520, std.dev.: 0.0506) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.46% (7.5041 => 6.3440, std.dev.: 0.0469) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0082) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -2.63% (13.5243 => 13.1683, std.dev.: 0.0356) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.51% (21.6534 => 17.8611, std.dev.: 0.0376) SingleSource/Benchmarks/Linpack/linpack-pc: -15.69% (7.8005 => 6.5764, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 02:45:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 04:45:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424094504.B1A452A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24899?compare_to=24894&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24899, Order: 207074, Start Time: 2014-04-24 05:07:05, End Time: 2014-04-24 09:51:39 To: 24894, Order: 207065, Start Time: 2014-04-24 03:16:42, End Time: 2014-04-24 07:56:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (101 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/FloatMM: 57.14% (0.0280 => 0.0440, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 35.29% (0.0680 => 0.0920, std.dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 16.00% (0.1000 => 0.1160, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: 15.62% (0.1280 => 0.1480, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.55% (0.7040 => 0.7360, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0056) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.54% (0.6240 => 0.6960, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.15% (1.2201 => 1.3561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.07% (1.1921 => 1.3121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.06% (1.2321 => 1.3561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0112) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0583) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0294) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.28% (0.7640 => 0.8120, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0084) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2480 => 0.2600, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0304) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0393) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.8000 => 6.0440, std.dev.: 0.0425) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0533) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (5.8400 => 6.0480, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0195) MultiSource/Applications/JM/lencod/lencod: 3.25% (17.6165 => 18.1885, std.dev.: 0.0434) MultiSource/Applications/lambda-0_1_3/lambda: 3.05% (0.7880 => 0.8120, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0429) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.62% (1.2200 => 1.2520, std.dev.: 0.0105) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.43% (48.1088 => 49.2770, std.dev.: 0.0655) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 2.38% (37.0925 => 37.9766, std.dev.: 0.0924) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 1.97% (23.7574 => 24.2255, std.dev.: 0.0494) MultiSource/Applications/kimwitu++/kc: 1.93% (18.8170 => 19.1811, std.dev.: 0.0434) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0105) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0377) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (15.2282 => 15.4042, std.dev.: 0.0421) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0153) MultiSource/Applications/lua/lua: 4.86% (21.1533 => 22.1814, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0246) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (25.8896 => 26.7817, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -21.05% (0.0760 => 0.0600, std.dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -9.41% (0.3400 => 0.3080, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 03:50:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 05:50:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424105003.A25152A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24900?compare_to=24899&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24900, Order: 207079, Start Time: 2014-04-24 06:14:43, End Time: 2014-04-24 10:56:37 To: 24899, Order: 207074, Start Time: 2014-04-24 05:07:05, End Time: 2014-04-24 09:51:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (103 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 133.33% (0.0120 => 0.0280, std.dev.: 0.0054) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 40.00% (0.0400 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Towers: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.74% (0.0920 => 0.1120, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.86% (0.1120 => 0.1320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.73% (0.2200 => 0.2480, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3200 => 0.3360, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 6.75% (0.9481 => 1.0121, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/hash: 1.22% (4.2523 => 4.3043, std.dev.: 0.0191) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0052) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0031) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0090) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0708) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0606) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0431) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0383) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0490) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (4.9200 => 5.1120, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0438) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0624) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0463) MultiSource/Benchmarks/Bullet/bullet: 2.43% (37.0925 => 37.9925, std.dev.: 0.0885) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0341) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.35% (48.1088 => 49.2370, std.dev.: 0.0604) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0121) MultiSource/Applications/obsequi/Obsequi: 2.22% (1.2640 => 1.2920, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0316) MultiSource/Applications/kimwitu++/kc: 1.91% (18.8170 => 19.1770, std.dev.: 0.0327) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.21% (15.2282 => 15.4122, std.dev.: 0.0460) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0146) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0567) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 18.02% (0.9321 => 1.1001, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 5.20% (21.1533 => 22.2534, std.dev.: 0.1541) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0065) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0113) MultiSource/Applications/minisat/minisat: 1.20% (6.6564 => 6.7364, std.dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0063) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 04:28:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 06:28:17 -0500 (CDT) Subject: [llvm-testresults] SHIP.BuildSlave.MacOS.01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20140424112817.9987F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24901?compare_to=24857&baseline=24859 Nickname: SHIP.BuildSlave.MacOS.01__O3-plain__clang_DEV__x86_64:40 Comparing: Run: 24901, Order: b4e01ab54a3dfcddb845f241239b2f5efffed8ba,bcb39a444bd8dfdd872d7d3b23aa871e8a29b103, Start Time: 2014-04-24 10:28:45, End Time: 2014-04-24 11:35:01 To: 24857, Order: affcec88d2022e3d30b38c548e3a781ae72d66f0,2e5f39ee0fb4b5d6303e4342b17146952b9bb79c, Start Time: 2014-04-23 11:51:05, End Time: 2014-04-23 12:59:51 Baseline: 24859, Order: affcec88d2022e3d30b38c548e3a781ae72d66f0,2e5f39ee0fb4b5d6303e4342b17146952b9bb79c, Start Time: 2014-04-23 14:18:53, End Time: 2014-04-23 14:41:50 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 1 (1 on baseline) Performance Improvements: 158 (228 on baseline) Existing Failures: 122 (122 on baseline) Unchanged Tests: 830 (760 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.35% (0.0673 => 0.0637, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 11.83% (5.6577 => 6.3268, std.dev.: 0.0439) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.79% (0.1481 => 0.1336, std.dev.: 0.0034) SingleSource/Benchmarks/SmallPT/smallpt: -9.60% (0.1385 => 0.1252, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/instance-method-metadata: -9.38% (0.4767 => 0.4320, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -9.31% (0.1354 => 0.1228, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -8.92% (0.1244 => 0.1133, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.91% (0.2716 => 0.2474, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/block-byref-aggr: -8.84% (0.4819 => 0.4393, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.56% (0.7767 => 0.7102, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.86% (0.7968 => 0.7342, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -7.46% (0.6905 => 0.6390, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/ks/ks: -7.34% (0.1757 => 0.1628, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: -7.28% (0.4750 => 0.4404, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.08% (0.2697 => 0.2506, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.00% (0.8067 => 0.7502, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.97% (0.7887 => 0.7337, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2681 => 0.2495, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.94% (0.7397 => 0.6884, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.88% (0.7359 => 0.6853, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/parameter-passing: -6.81% (0.5126 => 0.4777, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.80% (0.7334 => 0.6835, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.80% (0.1810 => 0.1687, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.78% (0.7508 => 0.6999, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.67% (0.7665 => 0.7154, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/for-in: -6.66% (0.4849 => 0.4526, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.48% (1.3637 => 1.2754, std.dev.: 0.0311) MultiSource/Benchmarks/mafft/pairlocalalign: -6.46% (13.1674 => 12.3169, std.dev.: 0.2358) SingleSource/Benchmarks/Misc/ReedSolomon: -6.43% (0.2612 => 0.2444, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -6.36% (2.5012 => 2.3420, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.34% (0.7869 => 0.7370, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.30% (0.6936 => 0.6499, std.dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: -6.25% (1.7953 => 1.6831, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.24% (0.9056 => 0.8491, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.23% (0.3016 => 0.2828, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.18% (0.3606 => 0.3383, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.16% (0.6897 => 0.6472, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -6.14% (0.3224 => 0.3026, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -6.11% (1.3199 => 1.2392, std.dev.: 0.0248) SingleSource/UnitTests/ObjC/exceptions-3: -6.10% (0.4605 => 0.4324, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.06% (6.4077 => 6.0196, std.dev.: 0.0526) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.05% (0.7590 => 0.7131, std.dev.: 0.0151) MultiSource/Benchmarks/7zip/7zip-benchmark: -6.05% (48.4937 => 45.5613, std.dev.: 1.0386) MultiSource/Applications/sgefa/sgefa: -6.01% (0.7706 => 0.7243, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/exceptions: -5.97% (0.4960 => 0.4664, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.91% (0.3230 => 0.3039, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.73% (0.7132 => 0.6723, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.70% (0.6932 => 0.6537, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.63% (0.8572 => 0.8089, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.51% (0.7888 => 0.7453, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/exceptions-2: -5.44% (0.4632 => 0.4380, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.42% (13.7224 => 12.9790, std.dev.: 0.2345) SingleSource/UnitTests/ObjC++/property-reference-object: -5.39% (0.7174 => 0.6787, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.38% (0.7662 => 0.7250, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/09-vor/vor: -5.36% (0.3749 => 0.3548, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.36% (0.2950 => 0.2792, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.22% (0.9087 => 0.8613, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.12% (0.6911 => 0.6557, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.10% (1.9654 => 1.8652, std.dev.: 0.0335) MultiSource/Benchmarks/McCat/05-eks/eks: -4.87% (0.8437 => 0.8026, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.64% (0.3926 => 0.3744, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.54% (6.1130 => 5.8352, std.dev.: 0.0988) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.40% (0.6772 => 0.6474, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.40% (0.5550 => 0.5306, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.33% (0.2634 => 0.2520, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.27% (1.2497 => 1.1964, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.10% (2.4136 => 2.3146, std.dev.: 0.0321) MultiSource/Benchmarks/McCat/18-imp/imp: -3.65% (0.4358 => 0.4199, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -34.65% (0.9585 => 0.6264, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: -23.08% (0.9875 => 0.7596, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-5: -21.59% (1.8209 => 1.4278, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/flops-8: -20.23% (1.8684 => 1.4904, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-6: -18.65% (1.5587 => 1.2680, std.dev.: 0.1064) SingleSource/Benchmarks/Misc/flops-3: -17.11% (1.9875 => 1.6475, std.dev.: 0.0416) SingleSource/Benchmarks/Misc/himenobmtxpa: -12.81% (2.1464 => 1.8714, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -12.19% (0.3717 => 0.3264, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -11.72% (0.7258 => 0.6407, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -9.83% (0.2746 => 0.2476, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -8.81% (0.8762 => 0.7990, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -8.75% (1.8143 => 1.6556, std.dev.: 0.0444) SingleSource/Benchmarks/BenchmarkGame/n-body: -8.18% (1.0339 => 0.9493, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -7.82% (0.1981 => 0.1826, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.52% (5.3500 => 4.9475, std.dev.: 0.1350) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.49% (1.6474 => 1.5240, std.dev.: 0.0135) MultiSource/Benchmarks/BitBench/five11/five11: -7.20% (6.8463 => 6.3536, std.dev.: 0.1329) SingleSource/Benchmarks/Stanford/FloatMM: -7.17% (0.3486 => 0.3236, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/puzzle: -7.16% (0.2709 => 0.2515, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -7.15% (4.0336 => 3.7450, std.dev.: 0.0383) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.90% (2.8507 => 2.6539, std.dev.: 0.0695) SingleSource/UnitTests/Vector/multiplies: -6.87% (1.8786 => 1.7496, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.82% (2.3992 => 2.2356, std.dev.: 0.0484) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -6.76% (0.2620 => 0.2443, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/distray/distray: -6.70% (0.1910 => 0.1782, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.68% (1.1350 => 1.0592, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.65% (1.7179 => 1.6036, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -6.65% (0.8723 => 0.8143, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.58% (2.2428 => 2.0953, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/flops-2: -6.56% (1.4620 => 1.3661, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.51% (4.1174 => 3.8492, std.dev.: 0.1015) SingleSource/Benchmarks/Misc/perlin: -6.45% (4.5325 => 4.2401, std.dev.: 0.0311) MultiSource/Benchmarks/PAQ8p/paq8p: -6.40% (57.2161 => 53.5532, std.dev.: 1.0009) SingleSource/Benchmarks/Misc/salsa20: -6.33% (8.7882 => 8.2319, std.dev.: 0.1482) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -6.28% (0.6035 => 0.5656, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: -6.25% (0.1696 => 0.1590, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: -6.25% (3.8565 => 3.6155, std.dev.: 0.0818) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.22% (2.7146 => 2.5457, std.dev.: 0.0506) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.22% (2.3945 => 2.2456, std.dev.: 0.0521) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.20% (1.1289 => 1.0589, std.dev.: 0.0226) SingleSource/Benchmarks/SmallPT/smallpt: -6.20% (7.6578 => 7.1830, std.dev.: 0.1810) MultiSource/Benchmarks/Olden/em3d/em3d: -6.20% (2.9759 => 2.7915, std.dev.: 0.0640) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.18% (3.7275 => 3.4972, std.dev.: 0.0721) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.11% (1.3765 => 1.2924, std.dev.: 0.0244) MultiSource/Benchmarks/mafft/pairlocalalign: -6.02% (26.6268 => 25.0233, std.dev.: 0.4932) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.00% (3.6824 => 3.4614, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.83% (3.2772 => 3.0862, std.dev.: 0.0706) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.78% (7.1660 => 6.7520, std.dev.: 0.1412) SingleSource/Benchmarks/McGill/queens: -5.75% (1.9589 => 1.8462, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.72% (2.5777 => 2.4303, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.68% (7.2022 => 6.7929, std.dev.: 0.1111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.67% (3.5106 => 3.3116, std.dev.: 0.0769) SingleSource/Benchmarks/Misc/fbench: -5.62% (1.6338 => 1.5419, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.62% (4.0587 => 3.8306, std.dev.: 0.0681) SingleSource/Benchmarks/BenchmarkGame/recursive: -5.57% (0.8072 => 0.7622, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/random: -5.57% (2.4092 => 2.2749, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.56% (3.8847 => 3.6689, std.dev.: 0.0565) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.51% (3.7165 => 3.5119, std.dev.: 0.0607) SingleSource/Benchmarks/Shootout/sieve: -5.48% (4.8369 => 4.5718, std.dev.: 0.0314) SingleSource/Regression/C/uint64_to_float: -5.48% (0.4215 => 0.3984, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/lowercase: -5.41% (4.1618 => 3.9367, std.dev.: 0.0836) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.36% (0.2145 => 0.2030, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.36% (2.4556 => 2.3241, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.35% (4.0808 => 3.8624, std.dev.: 0.0725) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -5.23% (6.1499 => 5.8282, std.dev.: 0.1123) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.23% (41.6400 => 39.4625, std.dev.: 0.5931) SingleSource/Benchmarks/Misc/flops-1: -5.21% (2.5713 => 2.4373, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.20% (0.2866 => 0.2717, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.18% (13.3587 => 12.6665, std.dev.: 0.0868) MultiSource/Benchmarks/NPB-serial/is/is: -5.14% (6.8501 => 6.4979, std.dev.: 0.1204) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.11% (2.6305 => 2.4961, std.dev.: 0.0470) MultiSource/Benchmarks/sim/sim: -5.05% (4.2668 => 4.0512, std.dev.: 0.0663) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.04% (0.7976 => 0.7574, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.98% (4.0634 => 3.8610, std.dev.: 0.0712) SingleSource/Benchmarks/Shootout/matrix: -4.97% (1.5291 => 1.4531, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -4.93% (3.0885 => 2.9363, std.dev.: 0.0537) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.80% (4.1481 => 3.9489, std.dev.: 0.0519) SingleSource/Benchmarks/Shootout/methcall: -4.68% (4.2266 => 4.0288, std.dev.: 0.0649) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.67% (4.2612 => 4.0621, std.dev.: 0.0675) SingleSource/Benchmarks/Shootout/hash: -4.59% (4.3984 => 4.1965, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/dt: -4.28% (1.1044 => 1.0571, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: -4.28% (0.2873 => 0.2750, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: -4.24% (1.3548 => 1.2973, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.20% (3.8691 => 3.7065, std.dev.: 0.0618) MultiSource/Applications/viterbi/viterbi: -4.20% (1.6520 => 1.5826, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++/mandel-text: -4.15% (1.9306 => 1.8504, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.66% (3.4605 => 3.3338, std.dev.: 0.0363) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.40% (0.6229 => 0.6017, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.06% (4.0638 => 3.9393, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.95% (3.7939 => 3.6819, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.86% (8.1587 => 7.9250, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.40% (4.0283 => 3.9316, std.dev.: 0.0248) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.37% (1.2296 => 1.1636, std.dev.: 0.0461) MultiSource/Applications/ALAC/encode/alacconvert-encode: -7.50% (1.2538 => 1.1598, std.dev.: 0.0517) MultiSource/Applications/hexxagon/hexxagon: -1.43% (0.3005 => 0.2962, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: -5.60% (3.2433 => 3.0616, std.dev.: 0.1276) MultiSource/Applications/minisat/minisat: -1.29% (0.0853 => 0.0842, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -6.61% (14.0597 => 13.1304, std.dev.: 0.7050) MultiSource/Benchmarks/Prolangs-C++/NP/np: -6.32% (0.0095 => 0.0089, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 0.33% (0.1195 => 0.1199, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.88% (0.0170 => 0.0180, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.01% (0.0199 => 0.0203, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -0.62% (0.0322 => 0.0320, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0161 => 0.0161, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: -16.24% (0.0117 => 0.0098, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.04% (0.0142 => 0.0152, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.53% (1.1128 => 1.0290, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/functionobjects: -11.11% (0.0414 => 0.0368, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -9.70% (0.1371 => 0.1238, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.86% (0.1038 => 0.0946, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.43% (0.0630 => 0.0621, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -14.75% (0.0434 => 0.0370, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.79% (0.0121 => 0.0114, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.47% (0.3555 => 0.3254, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.10% (0.0122 => 0.0117, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -13.64% (0.0176 => 0.0152, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 10.09% (0.0109 => 0.0120, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.89% (0.0305 => 0.0284, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/EH/except: -5.49% (0.0091 => 0.0086, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 0.43% (0.0231 => 0.0232, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 12.50% (0.0088 => 0.0099, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.62% (0.0089 => 0.0084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -18.63% (0.0102 => 0.0083, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (0.0216 => 0.0202, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.0160 => 0.0170, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -0.65% (0.0155 => 0.0154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -11.67% (0.0300 => 0.0265, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: -1.20% (0.0083 => 0.0082, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -5.62% (0.0089 => 0.0084, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.0085 => 0.0081, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 1.79% (0.0224 => 0.0228, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -4.92% (0.0244 => 0.0232, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 2.11% (0.0095 => 0.0097, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -0.87% (0.0229 => 0.0227, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: -6.17% (0.0227 => 0.0213, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: -6.81% (0.0279 => 0.0260, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.09% (0.0088 => 0.0096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.12% (0.0097 => 0.0093, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -9.57% (0.0094 => 0.0085, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0087 => 0.0087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -9.69% (0.0258 => 0.0233, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.44% (0.0090 => 0.0086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.06% (0.0099 => 0.0105, std.dev.: 0.0004) SingleSource/Regression/C++/BuiltinTypeInfo: -12.77% (0.0094 => 0.0082, std.dev.: 0.0004) SingleSource/Regression/C++/EH/class_hierarchy: 2.02% (0.0099 => 0.0101, std.dev.: 0.0007) SingleSource/Regression/C++/EH/exception_spec_test: -3.45% (0.0261 => 0.0252, std.dev.: 0.0012) SingleSource/Regression/C++/EH/inlined_cleanup: -16.50% (0.0103 => 0.0086, std.dev.: 0.0010) SingleSource/Regression/C++/EH/recursive-throw: -3.33% (0.0090 => 0.0087, std.dev.: 0.0008) SingleSource/Regression/C++/EH/throw_rethrow_test: -5.43% (0.0092 => 0.0087, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -9.20% (0.0087 => 0.0079, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -9.63% (0.7144 => 0.6456, std.dev.: 0.0201) SingleSource/UnitTests/Vectorizer/gcc-loops: -9.97% (0.0391 => 0.0352, std.dev.: 0.0012) SingleSource/UnitTests/member-function-pointers: -17.82% (0.0101 => 0.0083, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0001 => 0.0001) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0001 => 0.0001) MultiSource/Applications/hexxagon/hexxagon: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/minisat/minisat: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/NP/np: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: - (0.0001 => 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/EH/except: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/random: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: - (0.0001 => 0.0001) SingleSource/Regression/C++/BuiltinTypeInfo: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/class_hierarchy: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/recursive-throw: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/ofstream_ctor: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: - (0.0001 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0001 => 0.0001) SingleSource/UnitTests/member-function-pointers: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.14% (0.0686 => 0.0637, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 17.36% (5.3908 => 6.3268, std.dev.: 0.0439) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -26.37% (0.1331 => 0.0980, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/dt: -25.72% (0.0556 => 0.0413, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: -25.22% (0.5777 => 0.4320, std.dev.: 0.0093) SingleSource/Benchmarks/Stanford/Quicksort: -24.87% (0.0571 => 0.0429, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -21.59% (0.0667 => 0.0523, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -21.21% (0.1259 => 0.0992, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -20.37% (0.0653 => 0.0520, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -20.00% (0.1535 => 0.1228, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: -18.96% (0.0670 => 0.0543, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Towers: -18.25% (0.0641 => 0.0524, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/FloatMM: -17.34% (0.0594 => 0.0491, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -17.29% (0.0966 => 0.0799, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -17.15% (0.1044 => 0.0865, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.62% (0.0985 => 0.0841, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -14.59% (0.0809 => 0.0691, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -14.58% (0.1564 => 0.1336, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -14.13% (0.0736 => 0.0632, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -13.65% (0.0982 => 0.0848, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -13.45% (0.1309 => 0.1133, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -13.38% (0.7912 => 0.6853, std.dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: -12.67% (1.6533 => 1.4439, std.dev.: 0.0366) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.36% (0.2823 => 0.2474, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -12.22% (0.8902 => 0.7814, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.15% (2.1231 => 1.8652, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -12.13% (0.8387 => 0.7370, std.dev.: 0.0186) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.50% (0.0965 => 0.0854, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -11.14% (0.7929 => 0.7046, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -10.62% (0.7702 => 0.6884, std.dev.: 0.0051) MultiSource/Benchmarks/7zip/7zip-benchmark: -10.51% (50.9096 => 45.5613, std.dev.: 1.0386) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -10.45% (0.1302 => 0.1166, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -10.16% (6.7005 => 6.0196, std.dev.: 0.0526) SingleSource/Benchmarks/Stanford/Puzzle: -10.13% (0.1619 => 0.1455, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.05% (0.2437 => 0.2192, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -9.93% (0.3756 => 0.3383, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -9.92% (0.8048 => 0.7250, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.89% (0.3367 => 0.3034, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -9.86% (0.7274 => 0.6557, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/08-main/main: -9.76% (0.3218 => 0.2904, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -9.60% (0.7919 => 0.7159, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -9.51% (0.7553 => 0.6835, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/bmm/bmm: -9.34% (0.1403 => 0.1272, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -9.32% (0.8091 => 0.7337, std.dev.: 0.0213) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -9.22% (0.2776 => 0.2520, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: -9.08% (0.2413 => 0.2194, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -8.82% (0.7821 => 0.7131, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/himenobmtxpa: -8.80% (0.2319 => 0.2115, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: -8.77% (0.2679 => 0.2444, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -8.77% (0.4104 => 0.3744, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.74% (0.8864 => 0.8089, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: -8.56% (2.4693 => 2.2580, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.40% (0.9270 => 0.8491, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.37% (0.3047 => 0.2792, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (0.1775 => 0.1628, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: -8.28% (0.3299 => 0.3026, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.20% (0.7231 => 0.6638, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.14% (5.2065 => 4.7829, std.dev.: 0.0921) SingleSource/UnitTests/ObjC/parameter-passing: -7.98% (0.5191 => 0.4777, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -7.94% (0.8194 => 0.7543, std.dev.: 0.0222) SingleSource/UnitTests/2006-12-11-LoadConstants: -7.93% (0.1450 => 0.1335, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.90% (0.5761 => 0.5306, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.89% (8.0668 => 7.4305, std.dev.: 0.1702) SingleSource/Benchmarks/Misc/oourafft: -7.80% (0.2706 => 0.2495, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.79% (0.7590 => 0.6999, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/exceptions-3: -7.76% (0.4688 => 0.4324, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -7.72% (0.8034 => 0.7414, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.71% (0.1828 => 0.1687, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -7.68% (6.3205 => 5.8352, std.dev.: 0.0988) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.63% (14.0507 => 12.9790, std.dev.: 0.2345) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.38% (0.8100 => 0.7502, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -7.28% (0.6980 => 0.6472, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -7.22% (0.8253 => 0.7657, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.21% (0.8098 => 0.7514, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -7.19% (1.8547 => 1.7213, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -7.16% (0.8028 => 0.7453, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: -7.11% (1.8120 => 1.6831, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.08% (10.1985 => 9.4769, std.dev.: 0.2555) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.97% (0.3040 => 0.2828, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/09-vor/vor: -6.95% (0.3813 => 0.3548, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -6.83% (2.5138 => 2.3420, std.dev.: 0.0587) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.82% (0.7622 => 0.7102, std.dev.: 0.0182) SingleSource/UnitTests/ObjC++/property-reference-object: -6.75% (0.7278 => 0.6787, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.67% (0.4707 => 0.4393, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.66% (1.4016 => 1.3082, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.34% (0.7839 => 0.7342, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: -6.24% (1.3217 => 1.2392, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.22% (0.8169 => 0.7661, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.13% (1.3587 => 1.2754, std.dev.: 0.0311) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.12% (0.3237 => 0.3039, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: -6.08% (13.1148 => 12.3169, std.dev.: 0.2358) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.04% (0.6917 => 0.6499, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.04% (0.7614 => 0.7154, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.01% (0.7153 => 0.6723, std.dev.: 0.0152) SingleSource/Benchmarks/CoyoteBench/lpbench: -5.97% (0.2665 => 0.2506, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.93% (0.6793 => 0.6390, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.90% (0.9153 => 0.8613, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.88% (0.8080 => 0.7605, std.dev.: 0.0179) SingleSource/UnitTests/ObjC/exceptions: -5.70% (0.4946 => 0.4664, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/for-in: -5.65% (0.4797 => 0.4526, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.6916 => 0.6537, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions-2: -5.03% (0.4612 => 0.4380, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.02% (0.6816 => 0.6474, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -4.47% (0.2374 => 0.2268, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -3.72% (2.4040 => 2.3146, std.dev.: 0.0321) MultiSource/Benchmarks/McCat/18-imp/imp: -3.63% (0.4357 => 0.4199, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: -3.13% (0.8285 => 0.8026, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.08% (1.2319 => 1.1940, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -33.94% (0.9483 => 0.6264, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: -25.07% (1.0137 => 0.7596, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-8: -24.87% (1.9838 => 1.4904, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-5: -24.00% (1.8788 => 1.4278, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/flops-6: -22.09% (1.6276 => 1.2680, std.dev.: 0.1064) SingleSource/Benchmarks/BenchmarkGame/puzzle: -20.94% (0.3181 => 0.2515, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -20.67% (2.0768 => 1.6475, std.dev.: 0.0416) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.79% (0.0974 => 0.0791, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: -17.63% (8.9884 => 7.4040, std.dev.: 0.3651) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -16.76% (0.7697 => 0.6407, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: -15.63% (1.3124 => 1.1073, std.dev.: 0.0373) SingleSource/Benchmarks/Misc/himenobmtxpa: -15.58% (2.2168 => 1.8714, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -14.42% (0.0950 => 0.0813, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -14.11% (0.0992 => 0.0852, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: -13.45% (3.2189 => 2.7861, std.dev.: 0.1028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -12.14% (0.3715 => 0.3264, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/partialsums: -11.38% (0.2794 => 0.2476, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/FloatMM: -11.29% (0.3648 => 0.3236, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.94% (0.2120 => 0.1888, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.77% (0.6339 => 0.5656, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.58% (0.2288 => 0.2046, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.27% (0.3283 => 0.2946, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/five11/five11: -10.16% (7.0724 => 6.3536, std.dev.: 0.1329) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.15% (3.2150 => 2.8886, std.dev.: 0.1110) MultiSource/Benchmarks/FreeBench/neural/neural: -9.35% (0.1754 => 0.1590, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -9.34% (2.3111 => 2.0953, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -9.32% (1.6806 => 1.5240, std.dev.: 0.0135) MultiSource/Benchmarks/BitBench/drop3/drop3: -9.30% (0.2881 => 0.2613, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -9.25% (1.8243 => 1.6556, std.dev.: 0.0444) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.13% (43.4272 => 39.4625, std.dev.: 0.5931) SingleSource/Benchmarks/Shootout/sieve: -9.04% (5.0260 => 4.5718, std.dev.: 0.0314) SingleSource/Benchmarks/BenchmarkGame/n-body: -8.96% (1.0427 => 0.9493, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/mandel: -8.93% (0.5117 => 0.4660, std.dev.: 0.0146) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -8.80% (5.4250 => 4.9475, std.dev.: 0.1350) MultiSource/Benchmarks/PAQ8p/paq8p: -8.74% (58.6834 => 53.5532, std.dev.: 1.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.61% (3.8429 => 3.5119, std.dev.: 0.0607) SingleSource/Benchmarks/Misc/richards_benchmark: -8.60% (0.8742 => 0.7990, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -8.60% (0.8909 => 0.8143, std.dev.: 0.0130) SingleSource/Regression/C/uint64_to_float: -8.56% (0.4357 => 0.3984, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.53% (0.9303 => 0.8509, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -8.32% (4.1983 => 3.8492, std.dev.: 0.1015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -8.29% (2.7217 => 2.4961, std.dev.: 0.0470) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -8.27% (2.5335 => 2.3241, std.dev.: 0.0415) SingleSource/Benchmarks/Misc/oourafft: -8.06% (4.0731 => 3.7450, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -8.05% (2.4421 => 2.2456, std.dev.: 0.0521) SingleSource/Benchmarks/Misc/flops-1: -8.03% (2.6501 => 2.4373, std.dev.: 0.0382) SingleSource/Benchmarks/Misc/flops-2: -8.01% (1.4850 => 1.3661, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.99% (1.2885 => 1.1855, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/fbench: -7.87% (1.6737 => 1.5419, std.dev.: 0.0354) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.76% (3.0698 => 2.8317, std.dev.: 0.0867) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.68% (1.3538 => 1.2498, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -7.66% (1.7366 => 1.6036, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -7.64% (0.1977 => 0.1826, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-7: -7.44% (3.9060 => 3.6155, std.dev.: 0.0818) MultiSource/Benchmarks/sim/sim: -7.43% (4.3764 => 4.0512, std.dev.: 0.0663) SingleSource/Benchmarks/Misc/perlin: -7.43% (4.5804 => 4.2401, std.dev.: 0.0311) SingleSource/Benchmarks/Misc/lowercase: -7.38% (4.2505 => 3.9367, std.dev.: 0.0836) SingleSource/UnitTests/Vector/multiplies: -7.37% (1.8889 => 1.7496, std.dev.: 0.0402) SingleSource/Benchmarks/Misc/salsa20: -7.22% (8.8721 => 8.2319, std.dev.: 0.1482) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -7.19% (2.8594 => 2.6539, std.dev.: 0.0695) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -7.13% (3.3907 => 3.1488, std.dev.: 0.0858) MultiSource/Benchmarks/Olden/em3d/em3d: -7.12% (3.0054 => 2.7915, std.dev.: 0.0640) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.11% (0.8154 => 0.7574, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.07% (2.4057 => 2.2356, std.dev.: 0.0484) MultiSource/Benchmarks/FreeBench/distray/distray: -7.04% (0.1917 => 0.1782, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.02% (4.3689 => 4.0621, std.dev.: 0.0675) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.97% (7.3020 => 6.7929, std.dev.: 0.1111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.89% (4.1707 => 3.8834, std.dev.: 0.1101) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -6.86% (0.2623 => 0.2443, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.82% (1.4272 => 1.3298, std.dev.: 0.0377) MultiSource/Benchmarks/mafft/pairlocalalign: -6.78% (26.8424 => 25.0233, std.dev.: 0.4932) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.77% (1.1358 => 1.0589, std.dev.: 0.0226) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.73% (9.3068 => 8.6800, std.dev.: 0.1902) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -6.63% (0.1645 => 0.1536, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.60% (3.4925 => 3.2619, std.dev.: 0.0782) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.60% (2.7256 => 2.5457, std.dev.: 0.0506) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.50% (3.7403 => 3.4972, std.dev.: 0.0721) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -6.47% (6.2313 => 5.8282, std.dev.: 0.1123) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.47% (13.5424 => 12.6665, std.dev.: 0.0868) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.47% (0.8149 => 0.7622, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.43% (3.9210 => 3.6689, std.dev.: 0.0565) MultiSource/Benchmarks/VersaBench/bmm/bmm: -6.41% (2.0889 => 1.9549, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.37% (3.6970 => 3.4614, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout/random: -6.34% (2.4290 => 2.2749, std.dev.: 0.0262) MultiSource/Benchmarks/7zip/7zip-benchmark: -6.30% (9.1782 => 8.6001, std.dev.: 0.1537) SingleSource/Benchmarks/SmallPT/smallpt: -6.29% (7.6655 => 7.1830, std.dev.: 0.1810) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.23% (7.2003 => 6.7520, std.dev.: 0.1412) MultiSource/Benchmarks/NPB-serial/is/is: -6.17% (6.9251 => 6.4979, std.dev.: 0.1204) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.11% (2.9365 => 2.7571, std.dev.: 0.0655) SingleSource/Benchmarks/Shootout/methcall: -6.03% (4.2874 => 4.0288, std.dev.: 0.0649) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.01% (3.5235 => 3.3116, std.dev.: 0.0769) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.01% (2.5858 => 2.4303, std.dev.: 0.0555) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.01% (0.9137 => 0.8588, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/ffbench: -5.93% (0.9326 => 0.8773, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.84% (3.2776 => 3.0862, std.dev.: 0.0706) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -5.79% (0.3749 => 0.3532, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -5.75% (1.3713 => 1.2924, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.67% (0.2152 => 0.2030, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: -5.66% (1.1205 => 1.0571, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.1226 => 1.0592, std.dev.: 0.0156) SingleSource/Benchmarks/McGill/queens: -5.57% (1.9550 => 1.8462, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.55% (4.0556 => 3.8306, std.dev.: 0.0681) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -5.46% (0.8822 => 0.8340, std.dev.: 0.0175) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.35% (2.3340 => 2.2091, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.33% (4.0799 => 3.8624, std.dev.: 0.0725) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.33% (0.2870 => 0.2717, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/health/health: -5.14% (0.2899 => 0.2750, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.03% (4.1579 => 3.9489, std.dev.: 0.0519) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.01% (3.0911 => 2.9363, std.dev.: 0.0537) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.99% (4.0637 => 3.8610, std.dev.: 0.0712) MultiSource/Applications/viterbi/viterbi: -4.97% (1.6653 => 1.5826, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout/matrix: -4.88% (1.5277 => 1.4531, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/hash: -4.81% (4.4084 => 4.1965, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.67% (3.8879 => 3.7065, std.dev.: 0.0618) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.37% (3.4860 => 3.3338, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.36% (3.3907 => 3.2428, std.dev.: 0.0510) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.28% (0.6286 => 0.6017, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/mandel-text: -3.74% (1.9223 => 1.8504, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.54% (8.2161 => 7.9250, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.36% (3.8098 => 3.6819, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.14% (4.0668 => 3.9393, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.83% (4.0462 => 3.9316, std.dev.: 0.0248) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.22% (1.2408 => 1.1636, std.dev.: 0.0461) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.51% (1.2405 => 1.1598, std.dev.: 0.0517) MultiSource/Applications/hexxagon/hexxagon: -6.38% (0.3164 => 0.2962, std.dev.: 0.0125) MultiSource/Applications/kimwitu++/kc: -7.23% (3.3002 => 3.0616, std.dev.: 0.1276) MultiSource/Applications/minisat/minisat: - (0.0842 => 0.0842, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -15.33% (15.5084 => 13.1304, std.dev.: 0.7050) MultiSource/Benchmarks/Prolangs-C++/NP/np: -4.30% (0.0093 => 0.0089, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.40% (0.1216 => 0.1199, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.65% (0.0172 => 0.0180, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -40.12% (0.0339 => 0.0203, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -18.58% (0.0393 => 0.0320, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -0.62% (0.0162 => 0.0161, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: -12.50% (0.0112 => 0.0098, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.04% (0.0142 => 0.0152, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -20.23% (1.2899 => 1.0290, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/functionobjects: -14.02% (0.0428 => 0.0368, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -17.14% (0.1494 => 0.1238, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -14.08% (0.1101 => 0.0946, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -9.74% (0.0688 => 0.0621, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -8.87% (0.0406 => 0.0370, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -18.57% (0.0140 => 0.0114, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.48% (0.3635 => 0.3254, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.10% (0.0122 => 0.0117, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -17.39% (0.0184 => 0.0152, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.76% (0.0126 => 0.0120, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.53% (0.0321 => 0.0284, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/EH/except: -28.33% (0.0120 => 0.0086, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.13% (0.0242 => 0.0232, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 12.50% (0.0088 => 0.0099, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -8.70% (0.0092 => 0.0084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -17.82% (0.0101 => 0.0083, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -9.01% (0.0222 => 0.0202, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 0.59% (0.0169 => 0.0170, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -1.28% (0.0156 => 0.0154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -12.25% (0.0302 => 0.0265, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: -2.38% (0.0084 => 0.0082, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -16.83% (0.0101 => 0.0084, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -22.12% (0.0104 => 0.0081, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -0.44% (0.0229 => 0.0228, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -1.69% (0.0236 => 0.0232, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 2.11% (0.0095 => 0.0097, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.61% (0.0217 => 0.0227, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: -6.99% (0.0229 => 0.0213, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: -12.46% (0.0297 => 0.0260, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.04% (0.0098 => 0.0096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.05% (0.0083 => 0.0093, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.59% (0.0091 => 0.0085, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -2.25% (0.0089 => 0.0087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -11.74% (0.0264 => 0.0233, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.44% (0.0090 => 0.0086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -9.48% (0.0116 => 0.0105, std.dev.: 0.0004) SingleSource/Regression/C++/BuiltinTypeInfo: -12.77% (0.0094 => 0.0082, std.dev.: 0.0004) SingleSource/Regression/C++/EH/class_hierarchy: -9.01% (0.0111 => 0.0101, std.dev.: 0.0007) SingleSource/Regression/C++/EH/exception_spec_test: -4.18% (0.0263 => 0.0252, std.dev.: 0.0012) SingleSource/Regression/C++/EH/inlined_cleanup: -17.31% (0.0104 => 0.0086, std.dev.: 0.0010) SingleSource/Regression/C++/EH/recursive-throw: -7.45% (0.0094 => 0.0087, std.dev.: 0.0008) SingleSource/Regression/C++/EH/throw_rethrow_test: -2.25% (0.0089 => 0.0087, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -15.05% (0.0093 => 0.0079, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -7.92% (0.7011 => 0.6456, std.dev.: 0.0201) SingleSource/UnitTests/Vectorizer/gcc-loops: -7.61% (0.0381 => 0.0352, std.dev.: 0.0012) SingleSource/UnitTests/member-function-pointers: -6.74% (0.0089 => 0.0083, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0001 => 0.0001) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0001 => 0.0001) MultiSource/Applications/hexxagon/hexxagon: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/minisat/minisat: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/NP/np: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: - (0.0001 => 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/EH/except: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/random: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: - (0.0001 => 0.0001) SingleSource/Regression/C++/BuiltinTypeInfo: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/class_hierarchy: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/recursive-throw: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/ofstream_ctor: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: - (0.0001 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0001 => 0.0001) SingleSource/UnitTests/member-function-pointers: - (0.0001 => 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 04:41:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 06:41:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424114153.617612A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24902?compare_to=24900&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24902, Order: 207082, Start Time: 2014-04-24 07:06:07, End Time: 2014-04-24 11:48:29 To: 24900, Order: 207079, Start Time: 2014-04-24 06:14:43, End Time: 2014-04-24 10:56:37 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (115 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Perm: 42.86% (0.0280 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 36.36% (0.0440 => 0.0600, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.30% (0.1720 => 0.1880, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/health/health: 9.09% (0.1760 => 0.1920, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.08% (0.3920 => 0.4080, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 3.61% (0.3320 => 0.3440, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.29% (1.2441 => 1.2601, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (2.1801 => 2.2081, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.11% (2.8882 => 2.9202, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.28% (0.1720 => 0.2000, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 20.00% (0.1600 => 0.1920, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.2161 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 10.26% (0.3120 => 0.3440, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0102) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.77% (1.3681 => 1.4881, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.59% (10.6960 => 11.5080, std.dev.: 0.0467) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0487) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0155) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.35% (8.1441 => 8.5801, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 4.96% (4.5200 => 4.7440, std.dev.: 0.0319) MultiSource/Benchmarks/MallocBench/gs/gs: 4.72% (4.9200 => 5.1520, std.dev.: 0.0333) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0222) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0305) MultiSource/Applications/JM/lencod/lencod: 3.52% (17.6165 => 18.2365, std.dev.: 0.0361) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0186) MultiSource/Applications/siod/siod: 2.64% (2.5721 => 2.6401, std.dev.: 0.0150) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.61% (48.1088 => 49.3648, std.dev.: 0.0576) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0412) MultiSource/Benchmarks/Bullet/bullet: 2.43% (37.0925 => 37.9926, std.dev.: 0.0967) MultiSource/Applications/sqlite3/sqlite3: 2.24% (23.7574 => 24.2895, std.dev.: 0.0345) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 2.17% (18.8170 => 19.2251, std.dev.: 0.0551) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.58% (15.2282 => 15.4682, std.dev.: 0.0434) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0632) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0156) MultiSource/Applications/lua/lua: 4.94% (21.1533 => 22.1974, std.dev.: 0.1110) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0140) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.47% (7.7485 => 6.7044, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 05:32:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 07:32:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424123206.BFE0B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24903?compare_to=24902&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24903, Order: 207085, Start Time: 2014-04-24 07:58:55, End Time: 2014-04-24 12:38:47 To: 24902, Order: 207082, Start Time: 2014-04-24 07:06:07, End Time: 2014-04-24 11:48:29 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (106 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.33% (0.1200 => 0.1360, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.96% (0.2160 => 0.2440, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.26% (0.3120 => 0.3440, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 7.69% (0.1560 => 0.1680, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 2.88% (1.6680 => 1.7160, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash2: 2.46% (0.4880 => 0.5000, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.45% (1.3801 => 1.4001, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.78% (1.1721 => 1.2281, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (0.4720 => 0.4840, std.dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0039) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0092) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.16% (1.2601 => 1.3881, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.3200 => 0.3440, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0684) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (8.1441 => 8.5641, std.dev.: 0.0477) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0051) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0242) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0351) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0182) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0501) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (4.9000 => 5.0720, std.dev.: 0.0256) MultiSource/Applications/JM/lencod/lencod: 3.36% (17.6165 => 18.2085, std.dev.: 0.0315) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0538) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.0122 => 4.1123, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 2.36% (37.0925 => 37.9686, std.dev.: 0.0728) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.36% (48.1088 => 49.2450, std.dev.: 0.1257) MultiSource/Applications/kimwitu++/kc: 2.30% (18.8170 => 19.2491, std.dev.: 0.0303) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.21% (0.5440 => 0.5560, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 2.07% (23.7574 => 24.2495, std.dev.: 0.0745) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0522) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0563) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: 1.10% (17.4082 => 17.6002, std.dev.: 0.0337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (15.2282 => 15.3882, std.dev.: 0.0565) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.5040 => 0.5360, std.dev.: 0.0101) MultiSource/Applications/lua/lua: 4.82% (21.1533 => 22.1734, std.dev.: 0.0520) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (25.8896 => 26.7977, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0099) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0327) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 05:43:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 07:43:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424124323.2F02C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24904?compare_to=24893&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24904, Order: 207085, Start Time: 2014-04-24 08:06:41, End Time: 2014-04-24 12:50:03 To: 24893, Order: 207063, Start Time: 2014-04-24 03:08:57, End Time: 2014-04-24 07:52:01 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 11 (178 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (905 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/FloatPrecision: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/nestedloop: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 18.18% (0.0880 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.12% (0.1960 => 0.2080, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.96% (0.5400 => 0.5560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.47% (1.6281 => 1.6521, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 1.14% (2.7962 => 2.8282, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.30% (0.7280 => 0.7520, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/wc: -11.59% (0.2760 => 0.2440, std.dev.: 0.0111) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0103) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0152) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0115) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/UnitTests/FloatPrecision: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0044) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/UnitTests/Vector/divides: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: 25.81% (0.1240 => 0.1560, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.53% (1.0240 => 1.2240, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.56% (0.1800 => 0.2080, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.38% (0.3640 => 0.4200, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.00% (0.0800 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.54% (1.5601 => 1.7401, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.32% (1.4841 => 1.6521, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.69% (1.4961 => 1.6561, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.24% (1.5241 => 1.6801, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.17% (0.2360 => 0.2600, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.97% (1.1640 => 1.2800, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.92% (1.6121 => 1.7721, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 9.59% (0.5840 => 0.6400, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.46% (1.7761 => 1.9441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: 9.21% (1.8680 => 2.0400, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.03% (0.6200 => 0.6760, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.01% (1.4201 => 1.5481, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.57% (0.9800 => 1.0640, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0135) MultiSource/Applications/Burg/burg: 7.96% (1.5080 => 1.6280, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.95% (0.7040 => 0.7600, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (0.2200 => 0.2360, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.87% (11.6440 => 12.4440, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (6.4680 => 6.8920, std.dev.: 0.0479) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.44% (1.7400 => 1.8520, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.8440 => 1.9600, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.12% (9.4842 => 10.0642, std.dev.: 0.0525) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (1.5480 => 1.6360, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (5.8121 => 6.1161, std.dev.: 0.0358) MultiSource/Benchmarks/MallocBench/gs/gs: 5.22% (5.3600 => 5.6400, std.dev.: 0.0338) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0220) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (1.7921 => 1.8801, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.83% (6.5440 => 6.8600, std.dev.: 0.0487) MultiSource/Applications/JM/lencod/lencod: 4.77% (21.9606 => 23.0088, std.dev.: 0.0354) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.0443 => 10.5163, std.dev.: 0.0347) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.69% (0.7680 => 0.8040, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0214) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.36% (6.5080 => 6.7920, std.dev.: 0.0484) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.36% (3.0282 => 3.1602, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0125) MultiSource/Applications/treecc/treecc: 4.33% (2.5840 => 2.6960, std.dev.: 0.0289) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.30% (50.0290 => 52.1810, std.dev.: 0.0913) MultiSource/Benchmarks/sim/sim: 4.26% (0.3760 => 0.3920, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 4.18% (4.7880 => 4.9880, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 4.12% (2.7162 => 2.8282, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.1280 => 1.1720, std.dev.: 0.0147) MultiSource/Benchmarks/Bullet/bullet: 3.76% (38.4046 => 39.8486, std.dev.: 0.0715) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.69% (18.4404 => 19.1205, std.dev.: 0.0485) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.63% (1.3240 => 1.3720, std.dev.: 0.0157) MultiSource/Applications/oggenc/oggenc: 3.61% (6.9844 => 7.2365, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.54% (4.1843 => 4.3323, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0205) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (16.3483 => 16.8923, std.dev.: 0.0478) MultiSource/Applications/kimwitu++/kc: 3.19% (19.6891 => 20.3171, std.dev.: 0.0602) MultiSource/Applications/ClamAV/clamscan: 3.13% (19.0444 => 19.6404, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0220) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.38% (6.1044 => 6.1884, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 1.35% (13.0563 => 13.2323, std.dev.: 0.0335) MultiSource/Applications/sqlite3/sqlite3: 1.07% (25.6856 => 25.9616, std.dev.: 0.0290) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0269) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0404) MultiSource/Applications/siod/siod: 10.35% (2.8602 => 3.1562, std.dev.: 0.0327) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (4.5603 => 4.7163, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.31% (1.0881 => 1.1241, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0486) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (3.9922 => 4.0883, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0344) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 1.60% (11.5087 => 11.6927, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0149) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.87% (10.6247 => 2.0321, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.13% (91.8497 => 49.4751, std.dev.: 10.7586) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.26% (50.3031 => 33.0701, std.dev.: 0.1421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.17% (26.0616 => 17.1571, std.dev.: 0.0567) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.12% (42.1466 => 28.6098, std.dev.: 0.5292) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1127) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.09% (1.2481 => 1.1721, std.dev.: 0.0257) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.17% (0.3840 => 0.3680, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3561 => 2.3161, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.06% (26.6977 => 26.4137, std.dev.: 0.0600) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 05:50:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 07:50:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424125023.B47BD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24905?compare_to=24903&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24905, Order: 207087, Start Time: 2014-04-24 08:17:12, End Time: 2014-04-24 12:57:04 To: 24903, Order: 207085, Start Time: 2014-04-24 07:58:55, End Time: 2014-04-24 12:38:47 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (105 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) MultiSource/Benchmarks/llubenchmark/llu: 40.00% (0.0400 => 0.0560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 25.00% (0.0800 => 0.1000, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.19% (0.9121 => 0.9321, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 13.70% (0.2920 => 0.3320, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0058) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0176) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0477) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0943) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (1.7360 => 1.8280, std.dev.: 0.0141) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0528) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (5.8000 => 6.0680, std.dev.: 0.0442) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0243) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0223) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0465) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.66% (0.7640 => 0.7920, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0453) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 3.27% (17.6165 => 18.1925, std.dev.: 0.0256) MultiSource/Applications/hbd/hbd: 3.10% (1.6800 => 1.7320, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0473) MultiSource/Benchmarks/Bullet/bullet: 2.52% (37.0925 => 38.0286, std.dev.: 0.0600) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0160) MultiSource/Applications/treecc/treecc: 2.29% (2.4480 => 2.5040, std.dev.: 0.0190) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.28% (48.1088 => 49.2049, std.dev.: 0.1226) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0427) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0390) MultiSource/Applications/sqlite3/sqlite3: 2.14% (23.7574 => 24.2655, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 2.06% (18.8170 => 19.2051, std.dev.: 0.0349) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (15.2282 => 15.4762, std.dev.: 0.0314) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0459) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0198) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0144) MultiSource/Applications/lua/lua: 4.67% (21.1533 => 22.1414, std.dev.: 0.1374) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0122) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0127) SingleSource/UnitTests/AtomicOps: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0092) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 06:22:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 08:22:42 -0500 (CDT) Subject: [llvm-testresults] SHIP.BuildSlave.MacOS.01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20140424132242.E729A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24906?baseline=24906 Nickname: SHIP.BuildSlave.MacOS.01__O3-plain__clang_DEV__x86_64:40 Comparing: Run: 24906, Order: 3cc798b4632e9bbef325653b167a85a3ef2b38fc,befdb1a6421e4c3ae77da1fee45b480ef9cb2710, Start Time: 2014-04-24 12:23:39, End Time: 2014-04-24 13:29:28 To: (none) Baseline: 24906, Order: 3cc798b4632e9bbef325653b167a85a3ef2b38fc,befdb1a6421e4c3ae77da1fee45b480ef9cb2710, Start Time: 2014-04-24 12:23:39, End Time: 2014-04-24 13:29:28 =============== Tests Summary =============== New Failures: 123 (0 on baseline) Added Tests: 909 (0 on baseline) Existing Failures: 0 (123 on baseline) Unchanged Tests: 80 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: - (1.1698 => 1.1698, std.dev.: 0.0389) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (1.1635 => 1.1635, std.dev.: 0.0287) MultiSource/Applications/hexxagon/hexxagon: - (0.2904 => 0.2904, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: - (3.0429 => 3.0429, std.dev.: 0.0799) MultiSource/Applications/minisat/minisat: - (0.0818 => 0.0818, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: - (13.3581 => 13.3581, std.dev.: 0.0802) MultiSource/Benchmarks/Prolangs-C++/NP/np: - (0.0088 => 0.0088, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.1227 => 0.1227, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: - (0.0161 => 0.0161, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: - (0.0206 => 0.0206, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: - (0.0312 => 0.0312, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0164 => 0.0164, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: - (0.0099 => 0.0099, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: - (0.0151 => 0.0151, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (1.0562 => 1.0562, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/functionobjects: - (0.0385 => 0.0385, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: - (0.1349 => 0.1349, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: - (0.0976 => 0.0976, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: - (0.0634 => 0.0634, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: - (0.0374 => 0.0374, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0116 => 0.0116, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3236 => 0.3236, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0118 => 0.0118, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0168 => 0.0168, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0110 => 0.0110, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0318 => 0.0318, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/EH/except: - (0.0086 => 0.0086, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: - (0.0223 => 0.0223, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: - (0.0096 => 0.0096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0085 => 0.0085, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: - (0.0085 => 0.0085, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: - (0.0224 => 0.0224, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: - (0.0159 => 0.0159, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: - (0.0156 => 0.0156, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: - (0.0267 => 0.0267, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: - (0.0084 => 0.0084, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: - (0.0088 => 0.0088, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: - (0.0084 => 0.0084, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: - (0.0220 => 0.0220, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: - (0.0234 => 0.0234, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: - (0.0106 => 0.0106, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: - (0.0233 => 0.0233, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0218 => 0.0218, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: - (0.0285 => 0.0285, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0082 => 0.0082, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: - (0.0082 => 0.0082, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0088 => 0.0088, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0092 => 0.0092, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0246 => 0.0246, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: - (0.0101 => 0.0101, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: - (0.0110 => 0.0110, std.dev.: 0.0001) SingleSource/Regression/C++/BuiltinTypeInfo: - (0.0082 => 0.0082, std.dev.: 0.0007) SingleSource/Regression/C++/EH/class_hierarchy: - (0.0094 => 0.0094, std.dev.: 0.0008) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0243 => 0.0243, std.dev.: 0.0010) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0091 => 0.0091, std.dev.: 0.0014) SingleSource/Regression/C++/EH/recursive-throw: - (0.0086 => 0.0086, std.dev.: 0.0012) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0088 => 0.0088, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: - (0.0079 => 0.0079, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: - (0.6488 => 0.6488, std.dev.: 0.0759) SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0375 => 0.0375, std.dev.: 0.0127) SingleSource/UnitTests/member-function-pointers: - (0.0082 => 0.0082, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/ofstream_ctor SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/member-function-pointers MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0001 => 0.0001) MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0001 => 0.0001) MultiSource/Applications/hexxagon/hexxagon: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/minisat/minisat: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/NP/np: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0640 => 0.0640, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: - (0.0001 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: - (0.0001 => 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/EH/except: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/random: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: - (0.0001 => 0.0001) SingleSource/Regression/C++/BuiltinTypeInfo: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/class_hierarchy: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/recursive-throw: - (0.0001 => 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0001 => 0.0001) SingleSource/Regression/C++/ofstream_ctor: - (0.0001 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference: - (0.0001 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0001 => 0.0001) SingleSource/UnitTests/member-function-pointers: - (0.0001 => 0.0001) Report Time: 0.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 06:27:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 08:27:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140424132746.1EBE62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24907?compare_to=24895&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24907, Order: 207088, Start Time: 2014-04-24 08:49:30, End Time: 2014-04-24 13:34:25 To: 24895, Order: 207067, Start Time: 2014-04-24 03:48:37, End Time: 2014-04-24 08:34:55 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 8 (133 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C/casts: 57.14% (0.0280 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.33% (0.1920 => 0.2080, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.23% (0.3720 => 0.3840, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.41% (17.6723 => 19.6883, std.dev.: 0.0592) MultiSource/Applications/sqlite3/sqlite3: 1416.24% (1.7001 => 25.7776, std.dev.: 0.0462) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.46% (50.1010 => 51.8330, std.dev.: 0.0835) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.0520 => 1.0800, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.74% (11.3920 => 12.3880, std.dev.: 0.0590) SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3407 => 3.0242, std.dev.: 0.0129) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0523, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0069) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/2011-03-28-Bitfield: 200.00% (0.0080 => 0.0240, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/PR640: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.93% (0.1720 => 0.2080, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.19% (1.8281 => 2.1241, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 15.85% (0.3280 => 0.3800, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.73% (1.8561 => 2.1481, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.38% (0.4160 => 0.4800, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.59% (2.0281 => 2.3241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.38% (1.8921 => 2.1641, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 14.29% (0.1400 => 0.1600, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.15% (1.9161 => 2.1681, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.97% (1.9121 => 2.1601, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.94% (2.1441 => 2.4001, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.19% (1.8441 => 2.0321, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.21% (0.3040 => 0.3320, std.dev.: 0.0105) MultiSource/Applications/obsequi/Obsequi: 8.96% (1.8760 => 2.0440, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0056) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.47% (0.2360 => 0.2560, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.72% (1.0880 => 1.1720, std.dev.: 0.0173) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.3760 => 0.4040, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (6.4800 => 6.8840, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0211) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.12% (1.5640 => 1.6440, std.dev.: 0.0162) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.81% (1.6641 => 1.7441, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0326) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (9.6042 => 10.0522, std.dev.: 0.0530) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.39% (5.8281 => 6.0841, std.dev.: 0.0332) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.31% (1.3000 => 1.3560, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0164) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (10.2283 => 10.6444, std.dev.: 0.0377) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (5.3960 => 5.6000, std.dev.: 0.0396) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.7480 => 1.8080, std.dev.: 0.0213) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0332) MultiSource/Applications/treecc/treecc: 3.25% (2.5880 => 2.6720, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.00% (6.5320 => 6.7280, std.dev.: 0.0657) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (2.1600 => 2.2240, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 2.88% (22.2206 => 22.8607, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (6.5360 => 6.7240, std.dev.: 0.0390) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (16.3003 => 16.7523, std.dev.: 0.0519) MultiSource/Applications/d/make_dparser: 2.72% (3.9761 => 4.0841, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.5040 => 1.5440, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (3.0562 => 3.1362, std.dev.: 0.0124) MultiSource/Applications/SPASS/SPASS: 2.59% (18.5284 => 19.0084, std.dev.: 0.0558) MultiSource/Benchmarks/Bullet/bullet: 2.52% (38.6366 => 39.6086, std.dev.: 0.0820) MultiSource/Applications/oggenc/oggenc: 2.27% (7.0524 => 7.2124, std.dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0129) MultiSource/Applications/kimwitu++/kc: 2.00% (19.8291 => 20.2251, std.dev.: 0.0221) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.91% (2.1201 => 2.4362, std.dev.: 0.0469) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.3725 => 7.6765, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.80% (3.7122 => 3.8162, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.50% (4.8043 => 4.8763, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.32% (11.4967 => 11.6487, std.dev.: 0.0349) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.18% (94.8339 => 49.1431, std.dev.: 6.3589) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.13% (49.9431 => 32.8981, std.dev.: 0.1561) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.96% (25.7136 => 16.9811, std.dev.: 0.1126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.10% (37.0863 => 28.1498, std.dev.: 0.5933) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1118) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.57% (1.2681 => 1.1721, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.47% (2.4522 => 2.4162, std.dev.: 0.0127) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 06:36:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 08:36:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424133644.0A0D12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24908?compare_to=24896&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24908, Order: 207088, Start Time: 2014-04-24 08:57:08, End Time: 2014-04-24 13:43:26 To: 24896, Order: 207067, Start Time: 2014-04-24 03:55:31, End Time: 2014-04-24 08:42:40 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1101 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/FloatMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.12% (0.1320 => 0.1480, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.90% (0.3480 => 0.3720, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3560 => 0.3680, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 2.33% (0.5160 => 0.5280, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0128) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 06:38:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 08:38:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140424133834.9B53E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24909?compare_to=24897&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24909, Order: 207088, Start Time: 2014-04-24 09:01:36, End Time: 2014-04-24 13:45:17 To: 24897, Order: 207070, Start Time: 2014-04-24 04:01:57, End Time: 2014-04-24 08:47:17 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (167 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (922 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 12.73% (0.2200 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.36% (0.1760 => 0.1960, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.00% (0.2000 => 0.2160, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.67% (0.2400 => 0.2560, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0052) SingleSource/Regression/C/sumarray2d: 4.12% (0.3880 => 0.4040, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/nestedloop: 2.58% (0.7760 => 0.7960, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 10.57% (1.0601 => 1.1721, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.71% (0.3400 => 0.3560, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: -35.00% (0.0800 => 0.0520, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0076) SingleSource/Benchmarks/Stanford/Puzzle: 1190.40% (0.1240 => 1.6001, std.dev.: 0.0084) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 979.08% (0.0760 => 0.8201, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 320.73% (0.2320 => 0.9761, std.dev.: 0.0103) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0158) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0057) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0069) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 80.00% (0.1400 => 0.2520, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0062) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0049) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0047) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0057) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0159) MultiSource/Benchmarks/NPB-serial/is/is: 44.44% (0.0720 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0146) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.14% (0.1160 => 0.1440, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.72% (1.2481 => 1.5441, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.47% (1.1761 => 1.4521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.29% (1.2921 => 1.5801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.45% (1.2521 => 1.5081, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.13% (1.2321 => 1.4801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 18.73% (1.1321 => 1.3441, std.dev.: 0.0143) MultiSource/Applications/JM/ldecod/ldecod: 18.56% (8.5802 => 10.1723, std.dev.: 0.0426) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0109) SingleSource/Benchmarks/SmallPT/smallpt: 17.65% (0.1360 => 0.1600, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.39% (1.2881 => 1.5121, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0162) MultiSource/Applications/JM/lencod/lencod: 15.52% (19.5406 => 22.5727, std.dev.: 0.0370) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (5.3360 => 6.0961, std.dev.: 0.0333) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.71% (0.3360 => 0.3720, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.19% (0.4320 => 0.4760, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 9.17% (11.3843 => 12.4283, std.dev.: 0.0312) MultiSource/Applications/oggenc/oggenc: 8.97% (6.2844 => 6.8484, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.26% (5.6680 => 6.1360, std.dev.: 0.0386) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.02% (0.6480 => 0.7000, std.dev.: 0.0162) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.89% (5.7280 => 6.1800, std.dev.: 0.0450) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (11.4440 => 12.2960, std.dev.: 0.0793) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.26% (9.5802 => 10.2762, std.dev.: 0.0584) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0153) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.92% (6.8280 => 7.1640, std.dev.: 0.0373) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 4.69% (4.7720 => 4.9960, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (1.6240 => 1.6920, std.dev.: 0.0244) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.88% (1.3400 => 1.3920, std.dev.: 0.0174) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (5.3840 => 5.5800, std.dev.: 0.0531) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.47% (49.1529 => 50.8609, std.dev.: 0.1124) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (1.0680 => 1.1040, std.dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0185) MultiSource/Applications/sqlite3/sqlite3: 2.91% (24.7575 => 25.4775, std.dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: 2.89% (19.2243 => 19.7804, std.dev.: 0.0658) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.7600 => 1.8080, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0065) MultiSource/Applications/treecc/treecc: 2.42% (2.6480 => 2.7120, std.dev.: 0.0189) MultiSource/Applications/kimwitu++/kc: 2.41% (19.7491 => 20.2251, std.dev.: 0.0361) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 1.60% (39.0726 => 39.6966, std.dev.: 0.0721) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (3.0402 => 3.0882, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0124 => 6.0884, std.dev.: 0.0184) MultiSource/Applications/SPASS/SPASS: 1.26% (18.7966 => 19.0326, std.dev.: 0.0523) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0126) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.63% (3.9842 => 4.2883, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.23% (0.3320 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 => 0.3200, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 5.78% (1.1081 => 1.1721, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 4.28% (6.8204 => 7.1124, std.dev.: 0.0303) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0202) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (0.5920 => 0.6120, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 2.98% (5.0963 => 5.2483, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.87% (4.0563 => 4.1323, std.dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (25.4536 => 25.9096, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4041 => 1.4241, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0111) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.44% (21.6534 => 17.8771, std.dev.: 0.0531) SingleSource/Benchmarks/Linpack/linpack-pc: -15.98% (7.8605 => 6.6044, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -11.11% (0.2880 => 0.2560, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: -2.00% (0.6000 => 0.5880, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0191) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 07:00:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 09:00:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140424140013.812872A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24910?compare_to=24898&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24910, Order: 207089, Start Time: 2014-04-24 09:18:35, End Time: 2014-04-24 14:06:55 To: 24898, Order: 207070, Start Time: 2014-04-24 04:15:32, End Time: 2014-04-24 09:04:06 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (135 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: 250.00% (0.0080 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.00% (0.0640 => 0.0800, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.89% (0.3600 => 0.3920, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.45% (0.2200 => 0.2320, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2280 => 0.2400, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 4.92% (0.4880 => 0.5120, std.dev.: 0.0063) MultiSource/Benchmarks/sim/sim: 4.12% (0.3880 => 0.4040, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.04% (2.3041 => 2.3281, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 7.14% (1.0641 => 1.1401, std.dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.36% (3.3962 => 3.5442, std.dev.: 0.0401) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 295.64% (0.4560 => 1.8041, std.dev.: 0.0115) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.48% (1.7321 => 2.1041, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.90% (1.6681 => 2.0001, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.73% (1.7641 => 2.1121, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.05% (1.6801 => 2.0001, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.64% (0.2360 => 0.2800, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.31% (1.7481 => 2.0681, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.96% (1.9601 => 2.3121, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.21% (1.9761 => 2.3161, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.90% (1.9641 => 2.2961, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.52% (11.7880 => 12.5560, std.dev.: 0.0592) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0074) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9920 => 1.0480, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0126) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2280 => 0.2400, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.4160 => 1.4880, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0160) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (9.9842 => 10.4482, std.dev.: 0.0643) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0056) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0194) MultiSource/Applications/lua/lua: 4.42% (4.7920 => 5.0040, std.dev.: 0.0348) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (6.8321 => 7.1121, std.dev.: 0.0362) MultiSource/Benchmarks/Olden/bh/bh: 4.07% (0.4920 => 0.5120, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.92% (0.4080 => 0.4240, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 3.70% (6.9124 => 7.1684, std.dev.: 0.0210) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (10.3203 => 10.6884, std.dev.: 0.0395) MultiSource/Applications/SPASS/SPASS: 3.48% (18.4924 => 19.1366, std.dev.: 0.0448) MultiSource/Applications/treecc/treecc: 3.36% (2.6200 => 2.7080, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0137) MultiSource/Applications/d/make_dparser: 3.23% (3.9641 => 4.0921, std.dev.: 0.0338) MultiSource/Benchmarks/MallocBench/gs/gs: 2.96% (5.5480 => 5.7120, std.dev.: 0.0366) MultiSource/Applications/JM/lencod/lencod: 2.90% (22.6287 => 23.2848, std.dev.: 0.0533) MultiSource/Applications/kimwitu++/kc: 2.80% (19.7371 => 20.2891, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0106) MultiSource/Applications/siod/siod: 2.61% (2.7562 => 2.8282, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.51% (51.1089 => 52.3929, std.dev.: 0.1301) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (2.2721 => 2.3281, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 2.19% (38.9366 => 39.7886, std.dev.: 0.0613) MultiSource/Applications/ClamAV/clamscan: 2.15% (20.2445 => 20.6805, std.dev.: 0.0704) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (16.5963 => 16.9003, std.dev.: 0.0467) MultiSource/Applications/sqlite3/sqlite3: 1.65% (25.1895 => 25.6056, std.dev.: 0.0586) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.59% (6.0244 => 6.1204, std.dev.: 0.0228) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 19.39% (0.9281 => 1.1081, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0230) MultiSource/Applications/minisat/minisat: 3.87% (6.8204 => 7.0844, std.dev.: 0.0311) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 1.66% (21.6534 => 22.0134, std.dev.: 0.0761) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.60% (4.4883 => 4.5603, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4041 => 1.4201, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (2.5322 => 2.5602, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (1.0881 => 1.1001, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (4.7563 => 4.8083, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0161) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/nestedloop: -60.32% (2.9642 => 1.1761, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.45% (1.5881 => 1.1681, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.36% (7.4801 => 6.2560, std.dev.: 0.0548) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.67% (7.5041 => 6.3280, std.dev.: 0.0509) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0050) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: -2.81% (13.5243 => 13.1443, std.dev.: 0.0406) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.46% (21.6534 => 17.8731, std.dev.: 0.0426) SingleSource/Benchmarks/Linpack/linpack-pc: -15.80% (7.8005 => 6.5684, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -8.19% (3.4682 => 3.1842, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.44% (2.6202 => 2.5562, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -2.36% (8.3085 => 8.1125, std.dev.: 0.0371) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.26% (4.1323 => 4.0803, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 07:42:44 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 09:42:44 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424144244.319F82A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24911?compare_to=24905&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24911, Order: 207091, Start Time: 2014-04-24 10:04:56, End Time: 2014-04-24 14:49:24 To: 24905, Order: 207087, Start Time: 2014-04-24 08:17:12, End Time: 2014-04-24 12:57:04 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 9 (110 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0480 => 0.0480, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count-2: 200.00% (0.0080 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/objinst: 44.44% (0.0360 => 0.0520, std.dev.: 0.0028) SingleSource/Regression/C/bigstack: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 9.09% (0.2200 => 0.2400, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 5.75% (0.3480 => 0.3680, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.24% (1.2921 => 1.3081, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.91% (2.3081 => 2.3521, std.dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.69% (0.0520 => 0.0480, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0061) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0069) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.07% (1.1601 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.37% (1.1961 => 1.3201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 5.04% (4.5200 => 4.7480, std.dev.: 0.0267) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2480 => 0.2600, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0482) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0237) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.3520 => 0.3680, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0481) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0506) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0497) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.7040 => 0.7240, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0056) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.56% (48.1088 => 49.3410, std.dev.: 0.0827) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0340) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (5.8400 => 5.9720, std.dev.: 0.0457) MultiSource/Benchmarks/Bullet/bullet: 2.22% (37.0925 => 37.9166, std.dev.: 0.0665) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0114) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.96% (4.9000 => 4.9960, std.dev.: 0.0328) MultiSource/Applications/kimwitu++/kc: 1.89% (18.8170 => 19.1731, std.dev.: 0.0720) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0185) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0590) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0173) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0449) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0497) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.68% (0.2480 => 0.2720, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 4.95% (21.1533 => 22.2014, std.dev.: 0.0524) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.37% (1.6601 => 1.7161, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.26% (6.6564 => 6.7404, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 08:44:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 10:44:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424154425.DF1F52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24912?compare_to=24911&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24912, Order: 207095, Start Time: 2014-04-24 11:09:31, End Time: 2014-04-24 15:51:05 To: 24911, Order: 207091, Start Time: 2014-04-24 10:04:56, End Time: 2014-04-24 14:49:24 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 14 (102 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1097 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/div: 100.00% (0.0160 => 0.0320, std.dev.: 0.0030) SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/distray/distray: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.20% (0.1640 => 0.1840, std.dev.: 0.0077) SingleSource/Benchmarks/SmallPT/smallpt: 8.82% (0.1360 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 4.55% (0.2640 => 0.2760, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.2280 => 1.2640, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.25% (2.8842 => 2.9202, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.33% (0.0480 => 0.0520, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (6.0160 => 6.4480, std.dev.: 0.0424) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (1.5200 => 1.6200, std.dev.: 0.0188) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.24% (0.7640 => 0.8040, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0136) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0424) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (5.8000 => 6.0520, std.dev.: 0.0246) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0286) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.3760 => 1.4280, std.dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0360) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0587) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.58% (1.7080 => 1.7520, std.dev.: 0.0154) MultiSource/Benchmarks/Bullet/bullet: 2.37% (37.0925 => 37.9725, std.dev.: 0.0674) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0395) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.35% (48.1088 => 49.2409, std.dev.: 0.0919) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 1.93% (18.8170 => 19.1811, std.dev.: 0.0556) MultiSource/Applications/sqlite3/sqlite3: 1.80% (23.7574 => 24.1855, std.dev.: 0.0516) MultiSource/Applications/SPASS/SPASS: 1.37% (17.5484 => 17.7884, std.dev.: 0.0488) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (15.2282 => 15.3882, std.dev.: 0.0478) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 5.09% (21.1533 => 22.2294, std.dev.: 0.0979) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 09:36:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 11:36:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424163651.BA5792A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24913?compare_to=24912&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24913, Order: 207098, Start Time: 2014-04-24 12:01:36, End Time: 2014-04-24 16:43:32 To: 24912, Order: 207095, Start Time: 2014-04-24 11:09:31, End Time: 2014-04-24 15:51:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 10 (103 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1101 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_member: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 18.18% (0.0880 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.91% (0.4040 => 0.4400, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (0.2160 => 0.2280, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.41% (0.3520 => 0.3640, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 3.05% (0.7880 => 0.8120, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.69% (0.0520 => 0.0480, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.69% (0.0520 => 0.0480, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.57% (0.3680 => 0.4400, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (6.0160 => 6.4640, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0357) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (8.1441 => 8.5921, std.dev.: 0.0282) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0233) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0365) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0327) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0308) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0305) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.44% (48.1088 => 49.2849, std.dev.: 0.0926) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9246, std.dev.: 0.0903) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 2.04% (18.8170 => 19.2011, std.dev.: 0.0396) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0356) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0130) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0496) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0235) MultiSource/Applications/lua/lua: 4.97% (21.1533 => 22.2054, std.dev.: 0.1363) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (25.8896 => 26.7377, std.dev.: 0.0364) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 1.04% (5.0123 => 5.0643, std.dev.: 0.0192) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.64% (10.8967 => 2.0001, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.81% (1.2601 => 1.2121, std.dev.: 0.0176) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 10:16:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 12:16:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424171622.4F2E32A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24914?compare_to=24913&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24914, Order: 207106, Start Time: 2014-04-24 12:42:51, End Time: 2014-04-24 17:23:01 To: 24913, Order: 207098, Start Time: 2014-04-24 12:01:36, End Time: 2014-04-24 16:43:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 14 (102 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1097 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2003-04-22-Switch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-31-CastToBool: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 6.06% (0.2640 => 0.2800, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.2920 => 0.3080, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0059) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.33% (0.0480 => 0.0520, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0049) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0331) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0492) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0314) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0447) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0403) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0571) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0330) MultiSource/Applications/hbd/hbd: 2.86% (1.6800 => 1.7280, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0107) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0092) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0112) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.36% (48.1088 => 49.2449, std.dev.: 0.0537) MultiSource/Benchmarks/Bullet/bullet: 2.16% (37.0925 => 37.8926, std.dev.: 0.0841) MultiSource/Applications/kimwitu++/kc: 2.11% (18.8170 => 19.2131, std.dev.: 0.0361) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 1.58% (23.7574 => 24.1335, std.dev.: 0.0482) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0519) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (15.2282 => 15.3842, std.dev.: 0.0408) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 4.97% (21.1533 => 22.2054, std.dev.: 0.0688) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0456) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4842 => 3.5482, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0062) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0440) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 10:30:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 12:30:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424173027.592CB2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24915?compare_to=24904&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24915, Order: 207106, Start Time: 2014-04-24 12:54:06, End Time: 2014-04-24 17:37:10 To: 24904, Order: 207085, Start Time: 2014-04-24 08:06:41, End Time: 2014-04-24 12:50:03 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 7 (152 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C/PR640: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 50.00% (0.0400 => 0.0600, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wc: 9.84% (0.2440 => 0.2680, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 3.13% (0.5120 => 0.5280, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0124) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0117) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0055) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0062) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.36% (1.0240 => 1.2120, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 16.67% (0.1440 => 0.1680, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.90% (0.6200 => 0.7000, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.31% (1.1640 => 1.2840, std.dev.: 0.0225) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.76% (0.1640 => 0.1800, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.47% (1.8161 => 1.9881, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.44% (1.6121 => 1.7481, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.43% (0.3320 => 0.3600, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0120) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0134) MultiSource/Applications/obsequi/Obsequi: 7.49% (1.8680 => 2.0080, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.03% (1.0240 => 1.0960, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.95% (1.7841 => 1.9081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.4680 => 6.8840, std.dev.: 0.0439) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.6440 => 12.3560, std.dev.: 0.0648) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0108) MultiSource/Applications/spiff/spiff: 5.95% (1.0080 => 1.0680, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0276) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (5.8121 => 6.1241, std.dev.: 0.0435) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.19% (9.4842 => 9.9762, std.dev.: 0.0508) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.16% (0.6200 => 0.6520, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (2.0440 => 2.1480, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.05% (1.5841 => 1.6641, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.79% (1.4201 => 1.4881, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/hash2: 4.76% (0.5040 => 0.5280, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0289) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.52% (6.5440 => 6.8400, std.dev.: 0.0519) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (6.5080 => 6.7840, std.dev.: 0.0642) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 4.15% (21.9606 => 22.8728, std.dev.: 0.0511) MultiSource/Benchmarks/MallocBench/gs/gs: 4.10% (5.3600 => 5.5800, std.dev.: 0.0447) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 3.94% (10.0443 => 10.4403, std.dev.: 0.0423) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.94% (50.0290 => 52.0010, std.dev.: 0.0765) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0175) MultiSource/Applications/lua/lua: 3.43% (4.7880 => 4.9520, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.35% (4.1843 => 4.3243, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 3.26% (6.9844 => 7.2124, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 3.24% (2.7162 => 2.8042, std.dev.: 0.0175) MultiSource/Benchmarks/Bullet/bullet: 3.22% (38.4046 => 39.6406, std.dev.: 0.1118) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: 3.10% (18.4404 => 19.0125, std.dev.: 0.0470) MultiSource/Applications/kimwitu++/kc: 2.97% (19.6891 => 20.2731, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.64% (16.3483 => 16.7803, std.dev.: 0.0389) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5284, std.dev.: 0.0614) MultiSource/Applications/d/make_dparser: 2.12% (3.9681 => 4.0521, std.dev.: 0.0256) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0263) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.34% (2.1401 => 2.4042, std.dev.: 0.0577) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (4.5603 => 4.7163, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (3.9922 => 4.1003, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.48% (3.7122 => 3.8042, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0344) MultiSource/Applications/hexxagon/hexxagon: 1.74% (11.5087 => 11.7087, std.dev.: 0.0189) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 1.53% (21.7374 => 22.0694, std.dev.: 0.1175) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 1.23% (8.1245 => 8.2245, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (2.9322 => 2.9682, std.dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.43% (2.9442 => 0.9000, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.10% (91.8497 => 49.5111, std.dev.: 10.4165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.47% (50.3031 => 32.9661, std.dev.: 0.1636) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.35% (26.0616 => 17.1091, std.dev.: 0.0987) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.26% (42.1466 => 28.5498, std.dev.: 0.3378) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1149) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.94% (0.3400 => 0.2960, std.dev.: 0.0143) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0037) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 10:36:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 12:36:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424173623.B0DEB2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24916?compare_to=24914&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24916, Order: 207107, Start Time: 2014-04-24 13:02:40, End Time: 2014-04-24 17:43:03 To: 24914, Order: 207106, Start Time: 2014-04-24 12:42:51, End Time: 2014-04-24 17:23:01 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 15 (101 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1094 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/div: 80.00% (0.0200 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.00% (0.1000 => 0.1160, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.38% (0.1040 => 0.1200, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1560 => 0.1720, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.46% (0.2960 => 0.3240, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.89% (0.3040 => 0.3280, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: 5.95% (0.3360 => 0.3560, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 1.50% (5.0720 => 5.1480, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.16% (1.3841 => 1.4001, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.91% (0.2200 => 0.2440, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.85% (0.3120 => 0.3240, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/callargs: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: -23.08% (0.0520 => 0.0400, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0053) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0538) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0097) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2480 => 0.2600, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0419) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (4.9200 => 5.1480, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0229) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (5.8000 => 6.0520, std.dev.: 0.0469) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0418) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0171) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (10.4082 => 10.7162, std.dev.: 0.0488) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 2.59% (17.6165 => 18.0725, std.dev.: 0.0419) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: 2.19% (37.0925 => 37.9045, std.dev.: 0.0725) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0202) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.02% (48.1088 => 49.0809, std.dev.: 0.1110) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0353) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0692) MultiSource/Applications/sqlite3/sqlite3: 1.55% (23.7574 => 24.1255, std.dev.: 0.0487) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0135) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0414) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0121) MultiSource/Applications/lua/lua: 4.95% (21.1533 => 22.2014, std.dev.: 0.0678) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (25.8896 => 26.7297, std.dev.: 0.0376) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0070) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0326) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0448) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (2.3881 => 2.2561, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 11:17:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 13:17:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140424181733.183872A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24917?compare_to=24907&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24917, Order: 207112, Start Time: 2014-04-24 13:38:24, End Time: 2014-04-24 18:24:13 To: 24907, Order: 207088, Start Time: 2014-04-24 08:49:30, End Time: 2014-04-24 13:34:25 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 16 (133 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/mandel-text: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ackermann: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/UnitTests/2002-08-19-CodegenBug: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Treesort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.00% (0.1000 => 0.1160, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.43% (0.2120 => 0.2320, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/rem: 9.38% (0.1280 => 0.1400, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3080 => 0.3240, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 3.11% (0.6440 => 0.6640, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.48% (2.1681 => 2.2001, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.82% (0.3320 => 0.3480, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.37% (1.6881 => 1.7281, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.39% (17.6723 => 19.6843, std.dev.: 0.0327) MultiSource/Applications/sqlite3/sqlite3: 1413.89% (1.7001 => 25.7376, std.dev.: 0.0615) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.41% (50.1010 => 51.8090, std.dev.: 0.0709) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.85% (11.3920 => 12.4000, std.dev.: 0.0494) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0080) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0363, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0111) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0100) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C/sumarray2d: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0031) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/mst/mst: 17.65% (0.1360 => 0.1600, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.82% (1.9161 => 2.2001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0119) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.31% (2.1441 => 2.4081, std.dev.: 0.0128) MultiSource/Benchmarks/NPB-serial/is/is: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0053) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0117) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0153) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 7.79% (0.6160 => 0.6640, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.3240 => 0.3480, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.39% (0.7040 => 0.7560, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.42% (6.4800 => 6.8960, std.dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0070) MultiSource/Applications/Burg/burg: 5.50% (1.5280 => 1.6120, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (2.9721 => 3.1322, std.dev.: 0.0206) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (1.6960 => 1.7800, std.dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.58% (9.6042 => 10.0442, std.dev.: 0.0317) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (5.8281 => 6.0761, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (6.5320 => 6.7960, std.dev.: 0.0528) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.95% (0.7080 => 0.7360, std.dev.: 0.0106) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 3.59% (1.7841 => 1.8481, std.dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: 3.52% (10.2283 => 10.5884, std.dev.: 0.0375) MultiSource/Applications/treecc/treecc: 2.94% (2.5880 => 2.6640, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.82% (6.5360 => 6.7200, std.dev.: 0.0444) MultiSource/Applications/SPASS/SPASS: 2.68% (18.5284 => 19.0245, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (16.3003 => 16.7363, std.dev.: 0.0466) MultiSource/Applications/JM/lencod/lencod: 2.61% (22.2206 => 22.8007, std.dev.: 0.0704) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.3960 => 5.5320, std.dev.: 0.0404) MultiSource/Applications/lua/lua: 2.50% (4.7920 => 4.9120, std.dev.: 0.0405) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 2.48% (38.6366 => 39.5966, std.dev.: 0.0642) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 1.71% (19.8291 => 20.1691, std.dev.: 0.0601) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.36% (2.1201 => 2.4882, std.dev.: 0.0528) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0297) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.34% (5.0243 => 5.1923, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 2.85% (6.5964 => 6.7844, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.02% (11.4967 => 11.7287, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.75% (4.8043 => 4.8883, std.dev.: 0.0078) MultiSource/Applications/obsequi/Obsequi: 1.57% (2.0441 => 2.0761, std.dev.: 0.0123) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 1.10% (21.8014 => 22.0414, std.dev.: 0.0880) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.42% (10.4007 => 2.0361, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.61% (2.9562 => 0.9280, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.75% (1.5881 => 1.0521, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.11% (94.8339 => 49.2071, std.dev.: 10.7094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.94% (49.9431 => 32.9941, std.dev.: 0.2729) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.65% (25.7136 => 17.0611, std.dev.: 0.0994) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.87% (37.0863 => 28.6058, std.dev.: 0.3598) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0044) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0085) MultiSource/Benchmarks/BitBench/five11/five11: -2.21% (2.3521 => 2.3001, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.57% (2.8002 => 2.7562, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 11:27:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 13:27:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424182708.40E392A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24918?compare_to=24908&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24918, Order: 207115, Start Time: 2014-04-24 13:47:24, End Time: 2014-04-24 18:33:48 To: 24908, Order: 207088, Start Time: 2014-04-24 08:57:08, End Time: 2014-04-24 13:43:26 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1105 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.35% (0.2520 => 0.2680, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.02% (1.9561 => 1.9761, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.00% (0.9601 => 1.0081, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.8361 => 0.8601, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.73% (0.7280 => 0.5480, std.dev.: 0.0139) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 11:27:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 13:27:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140424182730.D16D02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24919?compare_to=24909&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24919, Order: 207115, Start Time: 2014-04-24 13:49:16, End Time: 2014-04-24 18:34:14 To: 24909, Order: 207088, Start Time: 2014-04-24 09:01:36, End Time: 2014-04-24 13:45:17 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (158 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.00% (0.0800 => 0.0920, std.dev.: 0.0028) MultiSource/Applications/aha/aha: 13.33% (0.1200 => 0.1360, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: 5.31% (0.4520 => 0.4760, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.95% (0.7280 => 0.7640, std.dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0086) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0077) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 319.01% (0.2320 => 0.9721, std.dev.: 0.0149) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 204.76% (0.2520 => 0.7680, std.dev.: 0.0181) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0047) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0061) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0068) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0084) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0059) MultiSource/Applications/obsequi/Obsequi: 44.25% (1.3920 => 2.0080, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 31.58% (0.0760 => 0.1000, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.13% (1.2521 => 1.5041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.80% (1.2321 => 1.4761, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.79% (1.1321 => 1.3561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 19.72% (1.1561 => 1.3841, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.23% (0.1040 => 0.1240, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.75% (1.1521 => 1.3681, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: 18.42% (8.5802 => 10.1603, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.89% (1.2521 => 1.4761, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.54% (1.3681 => 1.6081, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.18% (1.3841 => 1.6081, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0057) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 14.58% (19.5406 => 22.3887, std.dev.: 0.0640) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.47% (5.3360 => 6.1081, std.dev.: 0.0371) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0102) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.6800 => 0.7640, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0106) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 9.07% (11.3843 => 12.4163, std.dev.: 0.0362) MultiSource/Applications/oggenc/oggenc: 8.40% (6.2844 => 6.8124, std.dev.: 0.0183) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.19% (5.6680 => 6.1320, std.dev.: 0.0659) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.96% (5.7280 => 6.1840, std.dev.: 0.0451) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (11.4440 => 12.3440, std.dev.: 0.0616) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0127) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.7640 => 0.8200, std.dev.: 0.0152) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.64% (9.5802 => 10.2162, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 5.71% (0.2800 => 0.2960, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0080) MultiSource/Applications/lua/lua: 4.95% (4.7720 => 5.0080, std.dev.: 0.0272) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (5.3840 => 5.6240, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (1.6240 => 1.6920, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0484) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (1.7600 => 1.8280, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.39% (49.1529 => 50.8209, std.dev.: 0.0970) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (1.0680 => 1.1040, std.dev.: 0.0091) MultiSource/Applications/ClamAV/clamscan: 2.73% (19.2243 => 19.7484, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 2.41% (24.7575 => 25.3535, std.dev.: 0.0515) MultiSource/Applications/kimwitu++/kc: 2.23% (19.7491 => 20.1891, std.dev.: 0.0347) MultiSource/Benchmarks/Bullet/bullet: 1.66% (39.0726 => 39.7206, std.dev.: 0.0751) MultiSource/Benchmarks/PAQ8p/paq8p: 1.47% (2.7282 => 2.7682, std.dev.: 0.0123) MultiSource/Applications/SPASS/SPASS: 1.13% (18.7966 => 19.0086, std.dev.: 0.0349) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0276) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 4.05% (6.8204 => 7.0964, std.dev.: 0.0297) MultiSource/Applications/siod/siod: 4.02% (2.9842 => 3.1042, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.03% (5.0203 => 5.1723, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.8281 => 0.8521, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0215) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (25.4536 => 25.8936, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0119) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.13% (21.6534 => 17.9451, std.dev.: 0.0372) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -8.52% (3.4722 => 3.1762, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0905) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 11:52:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 13:52:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140424185243.285EE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24920?compare_to=24910&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24920, Order: 207115, Start Time: 2014-04-24 14:10:57, End Time: 2014-04-24 18:59:25 To: 24910, Order: 207089, Start Time: 2014-04-24 09:18:35, End Time: 2014-04-24 14:06:55 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (139 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: 26.67% (0.0600 => 0.0760, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.86% (1.0920 => 1.1560, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/18-imp/imp: 5.26% (0.4560 => 0.4800, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (1.2880 => 1.3320, std.dev.: 0.0102) SingleSource/Benchmarks/Stanford/Puzzle: 1.11% (1.8041 => 1.8241, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.04% (2.3721 => 2.4442, std.dev.: 0.0233) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0076) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0048) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0092) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.62% (1.6921 => 2.0241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.50% (1.7641 => 2.1081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.44% (1.7081 => 2.0401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.28% (1.6801 => 2.0041, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.18% (1.6681 => 1.9881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.85% (1.8881 => 2.2441, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.60% (1.8281 => 2.1681, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.65% (1.8361 => 2.1601, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.41% (1.9761 => 2.3201, std.dev.: 0.0135) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.11% (1.9641 => 2.3001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.56% (1.9801 => 2.3081, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.38% (0.6120 => 0.7000, std.dev.: 0.0174) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.42% (1.2400 => 1.3320, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.22% (0.7200 => 0.7720, std.dev.: 0.0085) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (6.7200 => 7.1640, std.dev.: 0.0493) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (11.7880 => 12.5520, std.dev.: 0.0808) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.9920 => 1.0560, std.dev.: 0.0155) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.7800 => 0.8280, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (3.5002 => 3.7002, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 5.26% (0.4560 => 0.4800, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.17% (0.2320 => 0.2440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (9.9842 => 10.4562, std.dev.: 0.0412) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0109) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0166) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.33% (1.1080 => 1.1560, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 4.01% (4.7920 => 4.9840, std.dev.: 0.0381) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.94% (1.7280 => 1.7960, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 3.59% (6.9124 => 7.1604, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (2.0440 => 2.1160, std.dev.: 0.0179) MultiSource/Benchmarks/nbench/nbench: 3.52% (1.8201 => 1.8841, std.dev.: 0.0171) MultiSource/Applications/d/make_dparser: 3.43% (3.9641 => 4.1001, std.dev.: 0.0203) MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (10.3203 => 10.6324, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.99% (6.8321 => 7.0361, std.dev.: 0.0388) MultiSource/Applications/SPASS/SPASS: 2.96% (18.4924 => 19.0405, std.dev.: 0.0710) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.93% (51.1089 => 52.6049, std.dev.: 0.0920) MultiSource/Applications/treecc/treecc: 2.90% (2.6200 => 2.6960, std.dev.: 0.0239) MultiSource/Benchmarks/MallocBench/gs/gs: 2.81% (5.5480 => 5.7040, std.dev.: 0.0406) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 2.74% (22.6287 => 23.2488, std.dev.: 0.0412) MultiSource/Applications/kimwitu++/kc: 2.72% (19.7371 => 20.2731, std.dev.: 0.0530) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (3.0122 => 3.0922, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.44% (0.4920 => 0.5040, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 2.34% (38.9366 => 39.8486, std.dev.: 0.0688) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.93% (6.0244 => 6.1404, std.dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: 1.90% (20.2445 => 20.6285, std.dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (16.5963 => 16.9043, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 1.30% (25.1895 => 25.5175, std.dev.: 0.0423) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0157) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0248) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0113) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1761 => 2.2521, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (4.4883 => 4.5563, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (2.5322 => 2.5602, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0156) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0097) SingleSource/Regression/C++/EH/dead_try_block: -60.00% (0.0200 => 0.0080, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.18% (3.1762 => 1.3601, std.dev.: 0.0102) SingleSource/Regression/C/PR10189: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: -21.00% (2.6481 => 2.0920, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.33% (7.4801 => 6.1840, std.dev.: 0.0538) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.99% (7.5041 => 6.3040, std.dev.: 0.0550) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0092) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -3.02% (13.5243 => 13.1163, std.dev.: 0.0293) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.35% (21.6534 => 17.8971, std.dev.: 0.0361) SingleSource/Benchmarks/Linpack/linpack-pc: -15.69% (7.8005 => 6.5764, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.19% (3.4682 => 3.1842, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.69% (0.2560 => 0.2440, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.60% (4.6083 => 4.4883, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7603 => 4.6843, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 12:30:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 14:30:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424193054.0F03C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24921?compare_to=24916&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24921, Order: 207118, Start Time: 2014-04-24 14:53:24, End Time: 2014-04-24 19:37:33 To: 24916, Order: 207107, Start Time: 2014-04-24 13:02:40, End Time: 2014-04-24 17:43:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (103 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1104 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.57% (0.0840 => 0.1080, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.38% (0.1040 => 0.1200, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.82% (0.1760 => 0.1880, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 9.06% (3.8402 => 4.1883, std.dev.: 0.0608) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0042) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0144) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0164) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.98% (0.6520 => 0.7040, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0668) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0106) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0260) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/ary2: 4.17% (0.2880 => 0.3000, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0453) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0557) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0347) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0512) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0593) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0237) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2369, std.dev.: 0.0662) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0263) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0125) MultiSource/Benchmarks/Bullet/bullet: 1.73% (37.0925 => 37.7325, std.dev.: 0.0560) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 1.36% (23.7574 => 24.0815, std.dev.: 0.0513) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0681) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0505) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.81% (3.9962 => 4.1883, std.dev.: 0.0608) MultiSource/Applications/lua/lua: 4.75% (21.1533 => 22.1574, std.dev.: 0.1481) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0244) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.70% (0.4440 => 0.4560, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/bmm/bmm: -19.05% (0.0840 => 0.0680, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.93% (3.3482 => 3.1162, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/health/health: -3.92% (0.4080 => 0.3920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 13:29:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 15:29:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424202927.A3A002A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24922?compare_to=24921&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24922, Order: 207120, Start Time: 2014-04-24 15:55:14, End Time: 2014-04-24 20:36:07 To: 24921, Order: 207118, Start Time: 2014-04-24 14:53:24, End Time: 2014-04-24 19:37:33 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 10 (101 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1101 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-09-18-BitFieldTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 9.62% (0.2080 => 0.2280, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 9.09% (0.2200 => 0.2400, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 3.70% (0.4320 => 0.4480, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.86% (1.2881 => 1.3121, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.62% (1.2321 => 1.2521, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 13.13% (0.3960 => 0.4480, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0170) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.06% (0.2480 => 0.2680, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0639) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0588) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0377) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (1.5200 => 1.5760, std.dev.: 0.0202) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0415) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0378) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0385) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0314) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0081) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.97% (48.1088 => 49.0570, std.dev.: 0.0986) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 1.70% (37.0925 => 37.7245, std.dev.: 0.0688) MultiSource/Applications/kimwitu++/kc: 1.53% (18.8170 => 19.1051, std.dev.: 0.0450) MultiSource/Applications/sqlite3/sqlite3: 1.48% (23.7574 => 24.1095, std.dev.: 0.0445) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0370) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (15.2282 => 15.3922, std.dev.: 0.0491) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0167) MultiSource/Applications/lua/lua: 4.88% (21.1533 => 22.1854, std.dev.: 0.0906) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0313) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0278) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0104) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.18% (0.1760 => 0.1440, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 14:23:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 16:23:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424212351.A9E262A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24923?compare_to=24922&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24923, Order: 207123, Start Time: 2014-04-24 16:49:28, End Time: 2014-04-24 21:30:32 To: 24922, Order: 207120, Start Time: 2014-04-24 15:55:14, End Time: 2014-04-24 20:36:07 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 8 (93 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1102 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray-dbl: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ackermann: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 5.81% (0.3440 => 0.3640, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.39% (0.4560 => 0.4760, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.80% (1.3321 => 1.3561, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.16% (3.8842 => 3.8002, std.dev.: 0.0281) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.69% (0.0520 => 0.0480, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.69% (0.0520 => 0.0480, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0061) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0106) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0138) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0373) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0228) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0314) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0405) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.74% (0.8561 => 0.8881, std.dev.: 0.0115) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0384) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0415) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0191) MultiSource/Applications/JM/lencod/lencod: 2.47% (17.6165 => 18.0525, std.dev.: 0.0561) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0090) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0139) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.99% (48.1088 => 49.0650, std.dev.: 0.0824) MultiSource/Benchmarks/Bullet/bullet: 1.81% (37.0925 => 37.7646, std.dev.: 0.0963) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.67% (23.7574 => 24.1535, std.dev.: 0.0343) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1211, std.dev.: 0.0293) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0177) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0406) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 5.05% (21.1533 => 22.2214, std.dev.: 0.0966) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0295) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0070) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0159) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1921 => 2.2241, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.06% (3.9202 => 3.8002, std.dev.: 0.0281) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 15:02:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 17:02:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424220256.CE72E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24924?compare_to=24923&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24924, Order: 207126, Start Time: 2014-04-24 17:29:46, End Time: 2014-04-24 22:09:37 To: 24923, Order: 207123, Start Time: 2014-04-24 16:49:28, End Time: 2014-04-24 21:30:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 19 (106 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1092 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-LoadShorts: 133.33% (0.0120 => 0.0280, std.dev.: 0.0026) SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 71.43% (0.0280 => 0.0480, std.dev.: 0.0045) SingleSource/Regression/C++/EH/class_hierarchy: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.18% (0.0880 => 0.1040, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 16.67% (0.0960 => 0.1120, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 6.78% (0.4720 => 0.5040, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 71.43% (0.0280 => 0.0480, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 11.34% (1.1641 => 1.2961, std.dev.: 0.0450) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.83% (1.3281 => 1.4321, std.dev.: 0.0311) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.00% (0.3200 => 0.3360, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.21% (3.8002 => 3.8842, std.dev.: 0.0067) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.80% (1.1081 => 1.1281, std.dev.: 0.0073) MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (2.3201 => 2.3441, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/fbench: 1.03% (1.9441 => 1.9641, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.33% (0.0480 => 0.0520, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0538) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 5.22% (4.5200 => 4.7560, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/bh/bh: 4.71% (0.3400 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/05-eks/eks: 4.12% (0.6800 => 0.7080, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (8.1441 => 8.4761, std.dev.: 0.0567) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0319) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0456) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0291) MultiSource/Applications/Burg/burg: 3.01% (1.4600 => 1.5040, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0210) MultiSource/Applications/JM/lencod/lencod: 2.68% (17.6165 => 18.0885, std.dev.: 0.0605) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0348) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1210, std.dev.: 0.0811) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 1.84% (23.7574 => 24.1935, std.dev.: 0.0262) MultiSource/Benchmarks/Bullet/bullet: 1.77% (37.0925 => 37.7486, std.dev.: 0.1007) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1131, std.dev.: 0.0487) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0505) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0231) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.53% (0.3040 => 0.3360, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 4.80% (21.1533 => 22.1694, std.dev.: 0.1198) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0431) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.26% (6.6564 => 6.7404, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 15:22:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 17:22:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424222231.297D22A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24925?compare_to=24915&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24925, Order: 207127, Start Time: 2014-04-24 17:46:34, End Time: 2014-04-24 22:29:12 To: 24915, Order: 207106, Start Time: 2014-04-24 12:54:06, End Time: 2014-04-24 17:37:10 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 3 (137 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1108 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.21% (1.6521 => 1.6721, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 1.19% (2.0241 => 2.0481, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.09% (20.2731 => 20.0531, std.dev.: 0.0471) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.43% (11.3687 => 3.0202, std.dev.: 0.0130) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0144) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0096) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.55% (0.2920 => 0.3520, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.75% (1.0240 => 1.2160, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0060) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.42% (1.5281 => 1.6721, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.03% (0.6200 => 0.6760, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0093) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: 7.92% (1.8680 => 2.0160, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.83% (1.7361 => 1.8721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.90% (1.7401 => 1.8601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.13% (1.4361 => 1.5241, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.04% (1.4561 => 1.5441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.93% (1.4161 => 1.5001, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.84% (1.1640 => 1.2320, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (5.8121 => 6.1241, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.26% (1.5201 => 1.6001, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.22% (11.6440 => 12.2520, std.dev.: 0.0891) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0164) MultiSource/Applications/SIBsim4/SIBsim4: 4.69% (1.7921 => 1.8761, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0223) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (9.4842 => 9.9202, std.dev.: 0.0504) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.5600 => 1.6240, std.dev.: 0.0198) MultiSource/Applications/JM/lencod/lencod: 4.10% (21.9606 => 22.8608, std.dev.: 0.0317) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 3.98% (10.0443 => 10.4443, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.4040 => 0.4200, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.72% (2.0440 => 2.1200, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (6.5080 => 6.7440, std.dev.: 0.0459) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (5.3600 => 5.5400, std.dev.: 0.0382) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.12% (6.5440 => 6.7480, std.dev.: 0.0696) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.03% (50.0290 => 51.5450, std.dev.: 0.1269) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 2.73% (38.4046 => 39.4526, std.dev.: 0.1108) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0216) MultiSource/Applications/treecc/treecc: 2.63% (2.5840 => 2.6520, std.dev.: 0.0219) MultiSource/Applications/SPASS/SPASS: 2.60% (18.4404 => 18.9206, std.dev.: 0.0563) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (4.1843 => 4.2923, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.42% (16.3483 => 16.7443, std.dev.: 0.0603) MultiSource/Applications/siod/siod: 2.21% (2.7162 => 2.7762, std.dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: 2.06% (19.0444 => 19.4364, std.dev.: 0.0747) MultiSource/Applications/d/make_dparser: 1.92% (3.9681 => 4.0441, std.dev.: 0.0229) MultiSource/Applications/kimwitu++/kc: 1.85% (19.6891 => 20.0531, std.dev.: 0.0471) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 25.11% (0.9241 => 1.1561, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.52% (2.1401 => 2.4722, std.dev.: 0.0490) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (3.9922 => 4.0923, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.48% (3.7122 => 3.8042, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 2.28% (6.6684 => 6.8204, std.dev.: 0.0408) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.77% (11.5087 => 11.7127, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (2.9322 => 2.9802, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (2.7442 => 2.7762, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.03% (8.1245 => 8.2085, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.72% (10.6247 => 2.0481, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.89% (2.9442 => 0.9160, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.18% (91.8497 => 49.4311, std.dev.: 10.6476) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.50% (50.3031 => 32.9501, std.dev.: 0.1540) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.29% (26.0616 => 17.1251, std.dev.: 0.0795) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.17% (42.1466 => 28.5898, std.dev.: 0.7113) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.68% (3.1122 => 2.3441, std.dev.: 0.1159) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0191) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.83% (4.8083 => 4.6723, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.94% (5.1563 => 5.0563, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0125) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 15:26:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 17:26:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140424222605.49EB92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24926?compare_to=24924&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24926, Order: 207128, Start Time: 2014-04-24 17:52:34, End Time: 2014-04-24 22:32:45 To: 24924, Order: 207126, Start Time: 2014-04-24 17:29:46, End Time: 2014-04-24 22:09:37 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (96 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1104 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.51% (0.6760 => 0.7200, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.60% (0.6960 => 0.7280, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.5520 => 1.5880, std.dev.: 0.0138) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.69% (0.0520 => 0.0480, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.69% (0.0520 => 0.0480, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.29% (0.2480 => 0.2760, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0105) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0564) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0434) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0371) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0336) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0451) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0515) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (10.4082 => 10.7162, std.dev.: 0.0403) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.5480 => 1.5880, std.dev.: 0.0138) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0356) MultiSource/Benchmarks/Bullet/bullet: 2.28% (37.0925 => 37.9365, std.dev.: 0.0342) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0309) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.94% (48.1088 => 49.0410, std.dev.: 0.0807) MultiSource/Applications/sqlite3/sqlite3: 1.80% (23.7574 => 24.1855, std.dev.: 0.0366) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0113) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0324) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.02% (0.9321 => 1.1001, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0145) MultiSource/Applications/lua/lua: 4.92% (21.1533 => 22.1934, std.dev.: 0.1358) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (25.8896 => 26.7857, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.70% (0.4440 => 0.4560, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0181) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/obsequi/Obsequi: 1.93% (2.0681 => 2.1081, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/2003-06-08-VirtualFunctions: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.28% (10.8967 => 2.0401, std.dev.: 0.0101) SingleSource/Benchmarks/Stanford/Puzzle: -13.33% (0.1200 => 0.1040, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 16:13:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 18:13:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140424231308.2B68A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/24927?compare_to=24917&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24927, Order: 207130, Start Time: 2014-04-24 18:34:03, End Time: 2014-04-24 23:19:50 To: 24917, Order: 207112, Start Time: 2014-04-24 13:38:24, End Time: 2014-04-24 18:24:13 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 11 (145 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1760 => 0.2000, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.20% (0.3480 => 0.3800, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.51% (0.4560 => 0.4720, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 3.25% (0.9841 => 1.0161, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/mandel-2: 1.22% (0.9841 => 0.9961, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.05% (17.6723 => 19.6243, std.dev.: 0.0673) MultiSource/Applications/sqlite3/sqlite3: 1418.59% (1.7001 => 25.8176, std.dev.: 0.0451) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (50.1010 => 51.8130, std.dev.: 0.0768) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (1.0520 => 1.0520, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.57% (11.3920 => 12.3680, std.dev.: 0.0579) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0104) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0483, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0115) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 315.76% (0.4320 => 1.7961, std.dev.: 0.0093) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0051) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/PR640: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0059) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/UnitTests/ms_struct_pack_layout: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 30.00% (0.0800 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.38% (0.4160 => 0.4800, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.44% (1.8561 => 2.1241, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.38% (1.8081 => 2.0681, std.dev.: 0.0202) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.59% (1.9721 => 2.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.30% (2.1361 => 2.4202, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.07% (1.8361 => 2.0761, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.93% (2.1121 => 2.3641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.11% (0.1800 => 0.2000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.83% (1.7721 => 1.9641, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.8441 => 2.0401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.53% (1.9761 => 2.1841, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.11% (1.8201 => 2.0041, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.06% (2.0681 => 2.2761, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.89% (1.8601 => 2.0441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.45% (1.9481 => 2.1321, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0247) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (1.0880 => 1.1760, std.dev.: 0.0286) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (6.4800 => 6.8880, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.21% (0.7080 => 0.7520, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.7280 => 0.7680, std.dev.: 0.0143) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (0.4760 => 0.5000, std.dev.: 0.0072) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.81% (1.7480 => 1.8320, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.6960 => 1.7760, std.dev.: 0.0207) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.59% (6.5320 => 6.8320, std.dev.: 0.0393) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.8280 => 0.8640, std.dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout-C++/matrix: 4.29% (0.2800 => 0.2920, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (10.2283 => 10.6644, std.dev.: 0.0368) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (5.8281 => 6.0761, std.dev.: 0.0352) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0146) MultiSource/Applications/hbd/hbd: 3.94% (1.7280 => 1.7960, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (6.5360 => 6.7840, std.dev.: 0.0446) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3360 => 0.3480, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (5.3960 => 5.5800, std.dev.: 0.0488) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (1.6641 => 1.7201, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (0.3760 => 0.3880, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (16.3003 => 16.7683, std.dev.: 0.0459) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 2.67% (4.7920 => 4.9200, std.dev.: 0.0370) MultiSource/Applications/SPASS/SPASS: 2.51% (18.5284 => 18.9926, std.dev.: 0.0411) MultiSource/Applications/JM/lencod/lencod: 2.45% (22.2206 => 22.7647, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 2.27% (7.0524 => 7.2124, std.dev.: 0.0262) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: 1.86% (38.6366 => 39.3566, std.dev.: 0.0814) MultiSource/Applications/siod/siod: 1.74% (2.7522 => 2.8002, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 1.47% (19.8291 => 20.1211, std.dev.: 0.0681) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.80% (2.1201 => 2.4762, std.dev.: 0.0283) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0293) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 3.09% (6.5964 => 6.8004, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.95% (11.4967 => 11.7207, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.67% (4.8043 => 4.8843, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: 1.63% (0.9801 => 0.9961, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (4.0003 => 4.0643, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (3.9442 => 3.9962, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0150) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -34.25% (1.5881 => 1.0441, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.89% (94.8339 => 49.4151, std.dev.: 9.5534) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.16% (49.9431 => 32.8821, std.dev.: 0.2269) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.65% (25.7136 => 17.0611, std.dev.: 0.1267) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.14% (37.0863 => 28.5058, std.dev.: 0.4678) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.77% (7.8165 => 6.7404, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0161) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.57% (2.8002 => 2.7562, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 16:20:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 18:20:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140424232054.3DD7C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24928?compare_to=24919&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24928, Order: 207130, Start Time: 2014-04-24 18:44:11, End Time: 2014-04-24 23:27:37 To: 24919, Order: 207115, Start Time: 2014-04-24 13:49:16, End Time: 2014-04-24 18:34:14 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 8 (153 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray: 200.00% (0.0080 => 0.0240, std.dev.: 0.0054) SingleSource/UnitTests/2003-07-09-LoadShorts: 166.67% (0.0120 => 0.0320, std.dev.: 0.0027) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 2.06% (0.9721 => 0.9921, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 21.43% (0.1680 => 0.2040, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.82% (0.8521 => 0.8761, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.72% (0.7360 => 0.7560, std.dev.: 0.0074) MultiSource/Applications/obsequi/Obsequi: 2.14% (2.0601 => 2.1041, std.dev.: 0.0169) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0101) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 968.55% (0.0760 => 0.8121, std.dev.: 0.0101) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 327.63% (0.2320 => 0.9921, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0118) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0040) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0072) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0051) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 48.86% (0.7040 => 1.0480, std.dev.: 0.0237) MultiSource/Applications/obsequi/Obsequi: 44.83% (1.3920 => 2.0160, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.43% (1.2481 => 1.5281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.73% (1.1761 => 1.4081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.45% (1.1721 => 1.4001, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 18.70% (8.5802 => 10.1843, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.43% (1.1721 => 1.3881, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 15.60% (19.5406 => 22.5887, std.dev.: 0.0442) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.32% (5.3360 => 6.1001, std.dev.: 0.0417) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.35% (0.6800 => 0.7640, std.dev.: 0.0126) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (11.3843 => 12.4363, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.89% (5.6680 => 6.1720, std.dev.: 0.0467) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0189) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.82% (0.1360 => 0.1480, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.24% (5.7280 => 6.2000, std.dev.: 0.0512) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (11.4440 => 12.2920, std.dev.: 0.0773) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.67% (0.4800 => 0.5120, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.65% (1.6240 => 1.7320, std.dev.: 0.0189) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.35% (9.5802 => 10.1882, std.dev.: 0.0563) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 4.02% (4.7720 => 4.9640, std.dev.: 0.0510) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (6.8280 => 7.0920, std.dev.: 0.0443) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (5.3840 => 5.5840, std.dev.: 0.0287) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash: 3.48% (0.4600 => 0.4760, std.dev.: 0.0062) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.33% (49.1529 => 50.7889, std.dev.: 0.0811) MultiSource/Applications/ClamAV/clamscan: 2.93% (19.2243 => 19.7884, std.dev.: 0.0387) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 2.54% (24.7575 => 25.3855, std.dev.: 0.0553) MultiSource/Applications/kimwitu++/kc: 1.62% (19.7491 => 20.0691, std.dev.: 0.0459) MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (2.7282 => 2.7722, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 1.13% (39.0726 => 39.5126, std.dev.: 0.0396) MultiSource/Applications/SPASS/SPASS: 1.11% (18.7966 => 19.0045, std.dev.: 0.0442) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0218) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.00% (0.7200 => 0.7560, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 4.42% (2.9842 => 3.1162, std.dev.: 0.0118) MultiSource/Applications/minisat/minisat: 4.05% (6.8204 => 7.0964, std.dev.: 0.0337) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0203 => 5.1643, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.59% (5.0963 => 5.2283, std.dev.: 0.0374) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (25.4536 => 25.8976, std.dev.: 0.0311) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.0563 => 4.1203, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0152) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.36% (3.2362 => 3.2802) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.56% (11.0207 => 2.0321, std.dev.: 0.0081) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -80.00% (0.0200 => 0.0040, std.dev.: 0.0051) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.38% (21.6534 => 17.8891, std.dev.: 0.0440) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -8.64% (3.4722 => 3.1722, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0855) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.14% (4.5123 => 4.2803, std.dev.: 0.0252) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.85% (4.7643 => 4.6763, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 16:23:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 18:23:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140424232318.CFEED2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24929?compare_to=24918&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24929, Order: 207130, Start Time: 2014-04-24 18:43:44, End Time: 2014-04-24 23:30:01 To: 24918, Order: 207115, Start Time: 2014-04-24 13:47:24, End Time: 2014-04-24 18:33:48 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1107 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.33% (0.1920 => 0.2080, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.38% (0.1880 => 0.2000, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -21.43% (0.7280 => 0.5720, std.dev.: 0.0105) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 16:51:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 18:51:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140424235111.E4CBB2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24930?compare_to=24920&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24930, Order: 207136, Start Time: 2014-04-24 19:09:34, End Time: 2014-04-24 23:57:51 To: 24920, Order: 207115, Start Time: 2014-04-24 14:10:57, End Time: 2014-04-24 18:59:25 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (132 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/BuiltinTypeInfo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: 30.77% (0.0520 => 0.0680, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/mst/mst: 10.53% (0.1520 => 0.1680, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 2.12% (1.8841 => 1.9241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.18% (2.0401 => 2.0641, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (7.0361 => 7.1161, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.04% (2.3001 => 2.3241, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 57.14% (0.0280 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.36% (0.0440 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 36.17% (0.1880 => 0.2560, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.18% (1.7641 => 2.1201, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.26% (1.7441 => 2.0801, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.97% (1.7921 => 2.1321, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.08% (1.8361 => 2.1681, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.19% (1.9081 => 2.2361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.38% (0.1040 => 0.1200, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0052) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0154) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0347) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.40% (3.5002 => 3.7242, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (11.7880 => 12.4880, std.dev.: 0.0603) MultiSource/Benchmarks/nbench/nbench: 5.71% (1.8201 => 1.9241, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.58% (0.8601 => 0.9081, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.99% (1.5240 => 1.6000, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.8120 => 0.8520, std.dev.: 0.0152) MultiSource/Applications/lua/lua: 4.92% (4.7920 => 5.0280, std.dev.: 0.0195) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (1.6801 => 1.7601, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.61% (1.6481 => 1.7241, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 4.39% (0.4560 => 0.4760, std.dev.: 0.0071) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 4.34% (6.9124 => 7.2124, std.dev.: 0.0193) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.9842 => 10.4122, std.dev.: 0.0560) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (6.8321 => 7.1161, std.dev.: 0.0188) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0151) MultiSource/Applications/d/make_dparser: 3.94% (3.9641 => 4.1201, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: 3.45% (10.3203 => 10.6763, std.dev.: 0.0404) MultiSource/Applications/SPASS/SPASS: 3.40% (18.4924 => 19.1205, std.dev.: 0.0763) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.92% (22.6287 => 23.2888, std.dev.: 0.0434) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 2.76% (2.7562 => 2.8322, std.dev.: 0.0159) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.74% (51.1089 => 52.5089, std.dev.: 0.0643) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (5.5480 => 5.6920, std.dev.: 0.0472) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (3.0122 => 3.0882, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 2.51% (19.7371 => 20.2331, std.dev.: 0.0412) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (2.2721 => 2.3241, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (16.5963 => 16.9643, std.dev.: 0.0443) MultiSource/Benchmarks/Bullet/bullet: 1.92% (38.9366 => 39.6846, std.dev.: 0.0752) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0154) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 1.54% (25.1895 => 25.5776, std.dev.: 0.0561) MultiSource/Applications/ClamAV/clamscan: 1.48% (20.2445 => 20.5445, std.dev.: 0.1020) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 17.67% (0.9281 => 1.0921, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0155) MultiSource/Applications/minisat/minisat: 3.81% (6.8204 => 7.0804, std.dev.: 0.0355) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1761 => 2.2521, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 3.48% (2.1841 => 2.2601, std.dev.: 0.0276) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.21% (3.4842 => 3.5962, std.dev.: 0.0348) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 1.85% (21.6534 => 22.0534, std.dev.: 0.1259) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (4.2443 => 4.3163, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (5.1603 => 5.2403, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (1.2921 => 1.3121, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.0923 => 4.1403, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (2.5322 => 2.5602, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0167) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/nestedloop: -60.19% (2.9642 => 1.1801, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: -60.00% (0.0200 => 0.0080, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0102) MultiSource/Applications/obsequi/Obsequi: -21.45% (2.6481 => 2.0800, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.69% (7.4801 => 6.2320, std.dev.: 0.0518) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.69% (7.5041 => 6.2520, std.dev.: 0.0664) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0051) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: -3.05% (13.5243 => 13.1123, std.dev.: 0.0384) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.42% (21.6534 => 17.8811, std.dev.: 0.0496) SingleSource/Benchmarks/Linpack/linpack-pc: -15.64% (7.8005 => 6.5804, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -8.19% (3.4682 => 3.1842, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.52% (4.6083 => 4.4923, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: -2.26% (8.3085 => 8.1205, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 17:24:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 19:24:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425002453.AB4E72A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24931?compare_to=24926&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24931, Order: 207137, Start Time: 2014-04-24 19:47:27, End Time: 2014-04-25 00:31:34 To: 24926, Order: 207128, Start Time: 2014-04-24 17:52:34, End Time: 2014-04-24 22:32:45 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 11 (101 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1100 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 22.73% (0.0880 => 0.1080, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.65% (0.3440 => 0.3600, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.90% (1.2401 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.79% (1.3401 => 1.3641, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 1.58% (3.7881 => 3.8481, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.58% (1.0361 => 1.1561, std.dev.: 0.0322) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.33% (0.0480 => 0.0520, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.2401 => 1.3641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0839) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0503) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0247) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0388) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0495) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0441) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0670) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0327) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.4400 => 1.4800, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0528) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0428) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0161) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1169, std.dev.: 0.1024) MultiSource/Benchmarks/Bullet/bullet: 1.90% (37.0925 => 37.7966, std.dev.: 0.0732) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1491, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.57% (23.7574 => 24.1295, std.dev.: 0.0451) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0347) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.10% (15.2282 => 15.3962, std.dev.: 0.0411) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.24% (1.0681 => 1.1561, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.5040 => 0.5360, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.33% (3.3802 => 3.5602, std.dev.: 0.0648) MultiSource/Applications/lua/lua: 4.86% (21.1533 => 22.1814, std.dev.: 0.1005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0120) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (4.5203 => 4.6283, std.dev.: 0.0347) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 18:22:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 20:22:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425012227.121A72A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24932?compare_to=24931&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24932, Order: 207144, Start Time: 2014-04-24 20:47:13, End Time: 2014-04-25 01:29:07 To: 24931, Order: 207137, Start Time: 2014-04-24 19:47:27, End Time: 2014-04-25 00:31:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 12 (101 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (2 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1097 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 40.00% (0.0400 => 0.0560, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.56% (0.2440 => 0.2600, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: 6.25% (0.1920 => 0.2040, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (0.3560 => 0.3760, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 4.10% (0.7800 => 0.8120, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.51% (1.3281 => 1.3481, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -6.98% (4.1283 => 3.8402, std.dev.: 0.0870) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0148) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0691) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2320 => 0.2440, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0309) MultiSource/Applications/Burg/burg: 4.38% (1.4600 => 1.5240, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0441) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0394) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0533) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0470) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0447) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.35% (48.1088 => 49.2409, std.dev.: 0.0786) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0178) MultiSource/Applications/kimwitu++/kc: 2.04% (18.8170 => 19.2011, std.dev.: 0.0401) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8165, std.dev.: 0.1074) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0497) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0136) MultiSource/Applications/SPASS/SPASS: 1.37% (17.5484 => 17.7884, std.dev.: 0.0349) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0030) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0189) MultiSource/Applications/lua/lua: 5.11% (21.1533 => 22.2334, std.dev.: 0.1605) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (25.8896 => 26.7897, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0342) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 1.14% (6.6564 => 6.7324, std.dev.: 0.0226) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.28% (10.8967 => 2.0401, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 24 19:19:36 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 24 Apr 2014 19:19:36 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425021953.473414FEDD7A@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14788 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207155 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17833 of 17834) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17834) 1 warning(s) in tests. Testing Time: 407.62s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17684 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207155) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Thu Apr 24 19:19:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 24 Apr 2014 19:19:35 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425021953.381CE4FEDD79@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14788 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207155 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17833 of 17834) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17834) 1 warning(s) in tests. Testing Time: 407.62s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17684 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207155) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Thu Apr 24 19:15:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 21:15:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425021553.720062A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24933?compare_to=24932&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24933, Order: 207146, Start Time: 2014-04-24 21:41:01, End Time: 2014-04-25 02:22:34 To: 24932, Order: 207144, Start Time: 2014-04-24 20:47:13, End Time: 2014-04-25 01:29:07 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== New Passes: 1 (0 on baseline) Performance Regressions: 10 (105 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0520 => 0.0520, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/mandel-text: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 16.67% (0.0960 => 0.1120, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1560 => 0.1760, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.62% (0.6920 => 0.7240, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.26% (1.2401 => 1.2681, std.dev.: 0.0097) MultiSource/Applications/treecc/treecc: 1.79% (2.4520 => 2.4960, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.56% (4.6803 => 4.8003, std.dev.: 0.0314) MultiSource/Benchmarks/BitBench/five11/five11: 1.56% (2.3121 => 2.3481, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/flops-4: -40.00% (0.0400 => 0.0240, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -14.29% (0.1120 => 0.0960, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0032) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.18% (0.6240 => 0.7000, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0487) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 4.96% (4.5200 => 4.7440, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0225) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0423) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.68% (8.1441 => 8.4441, std.dev.: 0.0599) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0359) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.59% (17.6165 => 18.0725, std.dev.: 0.0502) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0094) MultiSource/Applications/treecc/treecc: 1.96% (2.4480 => 2.4960, std.dev.: 0.0148) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.92% (48.1088 => 49.0330, std.dev.: 0.0945) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0413) MultiSource/Benchmarks/Bullet/bullet: 1.82% (37.0925 => 37.7685, std.dev.: 0.0631) MultiSource/Applications/sqlite3/sqlite3: 1.73% (23.7574 => 24.1695, std.dev.: 0.0342) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1251, std.dev.: 0.0536) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0352) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0187) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 4.69% (21.1533 => 22.1454, std.dev.: 0.1386) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0093) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0303) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0116) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -28.57% (0.0560 => 0.0400, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.71% (1.2601 => 1.1881, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 24 19:55:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 24 Apr 2014 19:55:32 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425025548.1E3E34FEE1AD@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14789 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207159 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17832 of 17833) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17833 of 17833) 1 warning(s) in tests. Testing Time: 368.50s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207159) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Thu Apr 24 19:52:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 21:52:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425025249.E5D602A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24934?compare_to=24933&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24934, Order: 207147, Start Time: 2014-04-24 22:19:42, End Time: 2014-04-25 02:59:29 To: 24933, Order: 207146, Start Time: 2014-04-24 21:41:01, End Time: 2014-04-25 02:22:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (112 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray2d: 100.00% (0.0160 => 0.0320, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.08% (0.0520 => 0.0640, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.22% (0.0720 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.38% (0.1280 => 0.1400, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.57% (0.2800 => 0.3040, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/fibo: 7.69% (0.2080 => 0.2240, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.11% (1.1400 => 1.1640, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.51% (1.3281 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.37% (1.4561 => 1.4761, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 8.18% (0.4400 => 0.4760, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.38% (1.1881 => 1.2401, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/sieve: 1.02% (2.3521 => 2.3761, std.dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: 14.29% (0.1400 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (10.6960 => 11.3200, std.dev.: 0.0903) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0479) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (4.9200 => 5.1120, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0247) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0342) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0241) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0301) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0391) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0107) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.11% (48.1088 => 49.1250, std.dev.: 0.0993) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0112) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0146) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0430) MultiSource/Benchmarks/Bullet/bullet: 1.93% (37.0925 => 37.8085, std.dev.: 0.0727) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0376) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 1.70% (23.7574 => 24.1615, std.dev.: 0.0344) MultiSource/Applications/SPASS/SPASS: 1.46% (17.5484 => 17.8044, std.dev.: 0.0375) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 20.60% (0.9321 => 1.1241, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0140) MultiSource/Applications/lua/lua: 4.82% (21.1533 => 22.1734, std.dev.: 0.1352) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.49% (25.8896 => 26.7937, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0078) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0335) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0063) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0550) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-2: -30.00% (0.0400 => 0.0280, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 20:14:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 22:14:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425031459.BD61F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24935?compare_to=24925&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24935, Order: 207147, Start Time: 2014-04-24 22:38:57, End Time: 2014-04-25 03:21:43 To: 24925, Order: 207127, Start Time: 2014-04-24 17:46:34, End Time: 2014-04-24 22:29:12 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 14 (153 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.23% (1.4840 => 1.5320, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5480 => 0.5600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 1.58% (0.7600 => 0.7720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.31% (12.2520 => 12.4120, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.11% (1.7961 => 1.8161, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 19.05% (0.0840 => 0.1000, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.76% (2.0481 => 2.0121, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0082) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0084) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0062) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0039) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0063) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0087) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0066) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 20.00% (0.0800 => 0.0960, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.1800 => 0.2000, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (1.0240 => 1.1280, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.80% (0.2040 => 0.2240, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0115) MultiSource/Applications/obsequi/Obsequi: 8.99% (1.8680 => 2.0360, std.dev.: 0.0158) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.78% (1.5481 => 1.6841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0054) SingleSource/Benchmarks/SmallPT/smallpt: 8.11% (0.1480 => 0.1600, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (1.1640 => 1.2560, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0076) MultiSource/Applications/viterbi/viterbi: 7.84% (0.2040 => 0.2200, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.23% (0.3320 => 0.3560, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0088) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.60% (11.6440 => 12.4120, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (6.4680 => 6.8920, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (9.4842 => 9.9642, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (5.8121 => 6.0961, std.dev.: 0.0305) MultiSource/Applications/Burg/burg: 4.77% (1.5080 => 1.5800, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0153) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0228) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.43% (6.5080 => 6.7960, std.dev.: 0.0333) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.5600 => 1.6240, std.dev.: 0.0222) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.0443 => 10.4523, std.dev.: 0.0397) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (6.5440 => 6.8080, std.dev.: 0.0415) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 3.95% (21.9606 => 22.8288, std.dev.: 0.0598) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (5.3600 => 5.5480, std.dev.: 0.0612) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0184) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.28% (50.0290 => 51.6690, std.dev.: 0.0958) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 2.92% (4.7880 => 4.9280, std.dev.: 0.0326) MultiSource/Benchmarks/Bullet/bullet: 2.84% (38.4046 => 39.4966, std.dev.: 0.0409) MultiSource/Applications/SPASS/SPASS: 2.84% (18.4404 => 18.9645, std.dev.: 0.0520) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/football/football: 2.55% (1.1000 => 1.1280, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0205) MultiSource/Applications/siod/siod: 2.36% (2.7162 => 2.7802, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (16.3483 => 16.7083, std.dev.: 0.0527) MultiSource/Applications/kimwitu++/kc: 1.87% (19.6891 => 20.0571, std.dev.: 0.0875) MultiSource/Applications/ClamAV/clamscan: 1.79% (19.0444 => 19.3844, std.dev.: 0.0779) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.09% (2.1401 => 2.4202, std.dev.: 0.0451) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0236) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.42% (4.5603 => 4.7163, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.37% (3.7122 => 3.8002, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (3.9922 => 4.0763, std.dev.: 0.0277) MultiSource/Applications/minisat/minisat: 1.98% (6.6684 => 6.8004, std.dev.: 0.0468) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.60% (21.7374 => 22.0854, std.dev.: 0.1331) MultiSource/Applications/hexxagon/hexxagon: 1.43% (11.5087 => 11.6727, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 1.17% (9.2606 => 9.3686, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 1.09% (2.9322 => 2.9642, std.dev.: 0.0124) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1245 => 8.2125, std.dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5641 => 1.0401, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.27% (91.8497 => 49.3551, std.dev.: 10.3813) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.55% (26.0616 => 17.0571, std.dev.: 0.1467) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.31% (50.3031 => 33.0461, std.dev.: 0.1487) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.63% (42.1466 => 28.3938, std.dev.: 0.3261) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1123) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -9.41% (0.3400 => 0.3080, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.02% (5.1563 => 5.0523, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.94% (5.1563 => 5.0563, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0123) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 20:36:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 22:36:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425033603.D90952A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24936?compare_to=24934&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24936, Order: 207151, Start Time: 2014-04-24 23:02:36, End Time: 2014-04-25 03:42:44 To: 24934, Order: 207147, Start Time: 2014-04-24 22:19:42, End Time: 2014-04-25 02:59:29 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (102 on baseline) Performance Improvements: 3 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/2003-08-11-VaListArg: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 35.71% (0.0560 => 0.0760, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.49% (1.4440 => 1.4800, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.75% (1.3721 => 1.3961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.55% (1.2921 => 1.3121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.29% (1.2401 => 1.2561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.20% (1.3361 => 1.3521, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/build: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -4.21% (3.6122 => 3.4602, std.dev.: 0.0546) MultiSource/Benchmarks/BitBench/five11/five11: -1.71% (2.3441 => 2.3041, std.dev.: 0.0152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.81% (0.1240 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0429) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0911) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.3200 => 0.3400, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0175) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0216) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0451) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0178) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0504) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.4400 => 1.4800, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 2.68% (17.6165 => 18.0885, std.dev.: 0.0400) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0424) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.23% (48.1088 => 49.1809, std.dev.: 0.0756) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0428) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0190) MultiSource/Applications/kimwitu++/kc: 1.85% (18.8170 => 19.1651, std.dev.: 0.0537) MultiSource/Benchmarks/Bullet/bullet: 1.79% (37.0925 => 37.7565, std.dev.: 0.0854) MultiSource/Applications/sqlite3/sqlite3: 1.77% (23.7574 => 24.1775, std.dev.: 0.0453) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0189) MultiSource/Applications/SPASS/SPASS: 1.19% (17.5484 => 17.7564, std.dev.: 0.0572) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0129) MultiSource/Applications/lua/lua: 5.03% (21.1533 => 22.2174, std.dev.: 0.1186) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0284) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0189) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0089) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0556) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 24 20:45:40 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 24 Apr 2014 20:45:40 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425034609.080804FEE7F6@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14790 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207163 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17832 of 17833) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17833 of 17833) 1 warning(s) in tests. Testing Time: 375.87s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207163) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Thu Apr 24 21:09:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 23:09:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140425040920.EDEAC2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24937?compare_to=24927&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24937, Order: 207155, Start Time: 2014-04-24 23:29:44, End Time: 2014-04-25 04:16:02 To: 24927, Order: 207130, Start Time: 2014-04-24 18:34:03, End Time: 2014-04-24 23:19:50 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 17 (130 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.86% (1.7201 => 1.7521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.73% (2.0761 => 2.1121, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.65% (2.1841 => 2.2201, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.43% (1.9641 => 1.9921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.41% (2.2761 => 2.3081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.35% (2.3641 => 2.3961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.33% (2.1041 => 2.1321, std.dev.: 0.0092) SingleSource/UnitTests/Vector/constpool: 1.19% (2.0121 => 2.0361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.06% (2.2681 => 2.2921, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.02% (3.1282 => 3.1602, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.00% (1.9921 => 2.0121, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.69% (3.5722 => 3.6682, std.dev.: 0.0228) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.61% (17.6723 => 19.7243, std.dev.: 0.0627) MultiSource/Applications/sqlite3/sqlite3: 1425.18% (1.7001 => 25.9296, std.dev.: 0.0561) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.93% (50.1010 => 52.0690, std.dev.: 0.0935) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.80% (1.0520 => 1.0920, std.dev.: 0.0361) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.02% (11.3920 => 12.4200, std.dev.: 0.0460) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0083) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0323, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0124) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0089) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 45.45% (0.0440 => 0.0640, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0044) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.73% (1.8561 => 2.1481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.45% (1.9161 => 2.2121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.10% (1.9601 => 2.2561, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.99% (2.0281 => 2.3321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.45% (2.1121 => 2.3961, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.50% (0.2240 => 0.2520, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.41% (1.7721 => 1.9921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.21% (1.9001 => 2.1321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0179) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.76% (1.0880 => 1.2160, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.70% (2.0521 => 2.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.65% (1.8201 => 2.0321, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.60% (2.0681 => 2.3081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.60% (2.1041 => 2.3481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.40% (1.8601 => 2.0721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.42% (1.9201 => 2.1201, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Applications/obsequi/Obsequi: 9.81% (1.8760 => 2.0600, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.45% (1.9481 => 2.1321, std.dev.: 0.0207) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.16% (6.4800 => 6.9440, std.dev.: 0.0297) MultiSource/Applications/spiff/spiff: 7.09% (1.0160 => 1.0880, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.8440 => 1.9600, std.dev.: 0.0205) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 5.61% (1.7841 => 1.8841, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.29% (1.6641 => 1.7521, std.dev.: 0.0104) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.19% (0.6160 => 0.6480, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.80% (5.8281 => 6.1081, std.dev.: 0.0339) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (9.6042 => 10.0522, std.dev.: 0.0368) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (1.0840 => 1.1320, std.dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.8280 => 0.8640, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 4.34% (10.2283 => 10.6724, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.28% (2.3401 => 2.4402, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0234) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (6.5320 => 6.8000, std.dev.: 0.0420) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0308) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0161) MultiSource/Applications/hbd/hbd: 3.70% (1.7280 => 1.7920, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3360 => 0.3480, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 3.50% (18.5284 => 19.1766, std.dev.: 0.0336) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (5.3960 => 5.5840, std.dev.: 0.0570) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.40% (3.0562 => 3.1602, std.dev.: 0.0090) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (2.1600 => 2.2320, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.18% (6.5360 => 6.7440, std.dev.: 0.0542) MultiSource/Applications/JM/lencod/lencod: 3.04% (22.2206 => 22.8967, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (16.3003 => 16.7683, std.dev.: 0.0586) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (4.2243 => 4.3363, std.dev.: 0.0165) MultiSource/Applications/siod/siod: 2.33% (2.7522 => 2.8162, std.dev.: 0.0143) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0302) MultiSource/Benchmarks/Bullet/bullet: 2.10% (38.6366 => 39.4486, std.dev.: 0.0872) MultiSource/Applications/kimwitu++/kc: 2.02% (19.8291 => 20.2291, std.dev.: 0.0453) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (6.1484 => 6.2204, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.66% (2.1201 => 2.4522, std.dev.: 0.0430) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6561 => 1.7201, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 3.15% (6.5964 => 6.8044, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.92% (3.5642 => 3.6682, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.53% (11.4967 => 11.6727, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.42% (4.8043 => 4.8723, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.42% (10.4007 => 2.0361, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.28% (2.9562 => 0.9080, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.94% (94.8339 => 49.3751, std.dev.: 10.4979) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.13% (49.9431 => 32.8981, std.dev.: 0.2118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.37% (25.7136 => 17.1331, std.dev.: 0.0727) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.70% (3.0722 => 2.3441, std.dev.: 0.1108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.16% (37.0863 => 28.8698, std.dev.: 0.4021) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.02% (2.7482 => 2.5002, std.dev.: 0.0903) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3521 => 2.3041, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 21:14:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 23:14:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140425041414.9DFDE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24938?compare_to=24928&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24938, Order: 207156, Start Time: 2014-04-24 23:37:31, End Time: 2014-04-25 04:20:48 To: 24928, Order: 207130, Start Time: 2014-04-24 18:44:11, End Time: 2014-04-24 23:27:37 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 19 (163 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-06-IntOverflow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C/badidx: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/UnitTests/2003-08-11-VaListArg: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 13.73% (0.2040 => 0.2320, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 13.19% (0.3640 => 0.4120, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (0.9001 => 0.9201, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.78% (1.3521 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.71% (1.4001 => 1.4241, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (12.2920 => 12.4520, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.03% (1.5521 => 1.5681, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.03% (1.5561 => 1.5721, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -6.41% (0.6240 => 0.5840, std.dev.: 0.0136) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2412.81% (0.0320 => 0.8041, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0067) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 979.08% (0.0760 => 0.8201, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0086) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 196.83% (0.2520 => 0.7480, std.dev.: 0.0177) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0057) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0054) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0048) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0187) MultiSource/Applications/obsequi/Obsequi: 45.98% (1.3920 => 2.0320, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Perm: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.61% (1.2160 => 1.5761, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.27% (1.2321 => 1.5681, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.77% (1.2401 => 1.5721, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.00% (1.2001 => 1.4761, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 22.15% (1.3001 => 1.5881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.50% (1.1721 => 1.4241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.38% (1.1601 => 1.4081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.12% (1.1361 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.05% (0.1520 => 0.1840, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (1.1441 => 1.3841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.45% (1.2521 => 1.5081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.00% (1.2001 => 1.4401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.81% (1.2521 => 1.5001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.80% (1.2321 => 1.4761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0148) MultiSource/Applications/JM/ldecod/ldecod: 19.21% (8.5802 => 10.2283, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 15.70% (19.5406 => 22.6087, std.dev.: 0.0544) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.32% (5.3360 => 6.1001, std.dev.: 0.0475) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 11.61% (0.4480 => 0.5000, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.03% (1.7400 => 1.9320, std.dev.: 0.0246) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (11.3843 => 12.4803, std.dev.: 0.0312) MultiSource/Applications/oggenc/oggenc: 9.23% (6.2844 => 6.8644, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.15% (5.7280 => 6.2520, std.dev.: 0.0280) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.81% (11.4440 => 12.4520, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (5.6680 => 6.1440, std.dev.: 0.0517) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.24% (0.6800 => 0.7360, std.dev.: 0.0197) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.9800 => 1.0600, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (9.5802 => 10.2322, std.dev.: 0.0397) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (1.4760 => 1.5600, std.dev.: 0.0282) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 5.34% (1.0480 => 1.1040, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.63% (6.8280 => 7.1440, std.dev.: 0.0395) MultiSource/Applications/lua/lua: 4.53% (4.7720 => 4.9880, std.dev.: 0.0348) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.1480 => 1.1960, std.dev.: 0.0155) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.18% (1.3400 => 1.3960, std.dev.: 0.0156) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.83% (49.1529 => 51.0369, std.dev.: 0.0805) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.63% (1.3240 => 1.3720, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (2.2081 => 2.2881, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.6961 => 1.7561, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 3.16% (19.2243 => 19.8324, std.dev.: 0.0664) MultiSource/Applications/sqlite3/sqlite3: 3.02% (24.7575 => 25.5055, std.dev.: 0.0670) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (2.0920 => 2.1480, std.dev.: 0.0202) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5800 => 0.5920, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 1.92% (19.7491 => 20.1291, std.dev.: 0.0626) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.0124 => 6.1244, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (3.0402 => 3.0882, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 1.39% (39.0726 => 39.6166, std.dev.: 0.0826) MultiSource/Applications/SPASS/SPASS: 1.17% (18.7966 => 19.0165, std.dev.: 0.0623) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.16% (29.3298 => 29.6699, std.dev.: 0.0502) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.81% (1.2401 => 1.4361, std.dev.: 0.0138) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0186) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.28% (0.8281 => 0.8801, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0148) MultiSource/Applications/minisat/minisat: 4.16% (6.8204 => 7.1044, std.dev.: 0.0352) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0064) MultiSource/Applications/siod/siod: 4.02% (2.9842 => 3.1042, std.dev.: 0.0171) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0203 => 5.1643, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 2.67% (5.0963 => 5.2323, std.dev.: 0.0200) MultiSource/Applications/sqlite3/sqlite3: 2.47% (4.0563 => 4.1563, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (25.4536 => 25.8696, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.52% (11.0207 => 2.0361, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.35% (21.6534 => 17.8971, std.dev.: 0.0526) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -9.33% (3.4722 => 3.1482, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0762) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -1.07% (11.5567 => 11.4327, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.01% (2.7802 => 2.7522, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 24 21:20:40 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 24 Apr 2014 21:20:40 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425042114.6FC654FEEC1F@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14791 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207167 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17832 of 17833) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17833 of 17833) 1 warning(s) in tests. Testing Time: 418.14s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207167) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Thu Apr 24 21:19:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 23:19:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425041946.65A5E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24939?compare_to=24929&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24939, Order: 207157, Start Time: 2014-04-24 23:39:55, End Time: 2014-04-25 04:26:26 To: 24929, Order: 207130, Start Time: 2014-04-24 18:43:44, End Time: 2014-04-24 23:30:01 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 19 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1092 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 31.25% (0.0640 => 0.0840, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.78% (0.0720 => 0.0920, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 21.43% (0.1120 => 0.1360, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.74% (0.3560 => 0.3800, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.31% (0.4640 => 0.4840, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 2.46% (1.1360 => 1.1640, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: 1.86% (1.5081 => 1.5361, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.9161 => 0.9321, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.31% (4.2803 => 4.3363, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 1.00% (2.7962 => 2.8242, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4721 => 1.4881, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -14.81% (0.1080 => 0.0920, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0148) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 24 21:54:03 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 24 Apr 2014 21:54:03 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425045419.EDFEF4FEF3C8@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14792 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207171 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17832 of 17833) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17833 of 17833) 1 warning(s) in tests. Testing Time: 348.64s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207171) ^ :1:29: note: possible intended match here clang version 3.5.0 (trunk 207171) ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Thu Apr 24 21:52:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Apr 2014 23:52:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140425045234.452592A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24940?compare_to=24930&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24940, Order: 207158, Start Time: 2014-04-25 00:11:02, End Time: 2014-04-25 04:59:07 To: 24930, Order: 207136, Start Time: 2014-04-24 19:09:34, End Time: 2014-04-24 23:57:51 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (143 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 20.00% (0.1000 => 0.1200, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 12.50% (0.1280 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: 7.69% (0.1560 => 0.1680, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.00% (0.2000 => 0.2120, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.97% (2.2361 => 2.2801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.88% (2.1321 => 2.1721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.35% (2.0801 => 2.1081, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (1.7241 => 1.7441, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.13% (1.0601 => 1.0721, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 1.09% (20.5445 => 20.7685, std.dev.: 0.0682) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.63% (0.1720 => 0.1920, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0090) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0074) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/Vector/simple: 80.00% (0.0200 => 0.0360, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.71% (1.7321 => 2.1081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 21.51% (1.6921 => 2.0561, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/dt: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.28% (1.6921 => 2.0521, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.20% (1.7921 => 2.1721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.11% (1.8001 => 2.1801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.08% (1.7081 => 2.0681, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.92% (1.7401 => 2.1041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.81% (1.7681 => 2.1361, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.13% (1.8881 => 2.2681, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.92% (1.9881 => 2.3841, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.81% (1.6761 => 2.0081, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.50% (1.9081 => 2.2801, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.77% (1.9601 => 2.3281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.41% (1.9761 => 2.3201, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 10.53% (0.1520 => 0.1680, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.42% (0.1920 => 0.2120, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.15% (0.6120 => 0.6680, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2080 => 0.2240, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.90% (6.7200 => 7.1840, std.dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (3.5002 => 3.7362, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (11.7880 => 12.5240, std.dev.: 0.0706) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.7800 => 0.8280, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 5.71% (1.8201 => 1.9241, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (1.7280 => 1.8240, std.dev.: 0.0164) MultiSource/Applications/lua/lua: 5.34% (4.7920 => 5.0480, std.dev.: 0.0329) MultiSource/Applications/Burg/burg: 5.13% (1.5600 => 1.6400, std.dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (9.9842 => 10.4562, std.dev.: 0.0534) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.5240 => 1.5960, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0138) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0196) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 4.34% (6.9124 => 7.2124, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 4.19% (10.3203 => 10.7523, std.dev.: 0.0199) MultiSource/Applications/d/make_dparser: 4.14% (3.9641 => 4.1281, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (6.8321 => 7.1001, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (2.0680 => 2.1480, std.dev.: 0.0279) MultiSource/Applications/SPASS/SPASS: 3.83% (18.4924 => 19.2006, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.47% (1.0361 => 1.0721, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 3.33% (0.3600 => 0.3720, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 2.90% (22.6287 => 23.2847, std.dev.: 0.0757) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.5480 => 5.7000, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (4.2203 => 4.3323, std.dev.: 0.0093) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.63% (51.1089 => 52.4529, std.dev.: 0.0940) MultiSource/Applications/ClamAV/clamscan: 2.59% (20.2445 => 20.7685, std.dev.: 0.0682) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (16.5963 => 16.9683, std.dev.: 0.0423) MultiSource/Applications/kimwitu++/kc: 2.21% (19.7371 => 20.1731, std.dev.: 0.0518) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (2.2721 => 2.3201, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 2.03% (25.1895 => 25.7016, std.dev.: 0.0544) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0158) MultiSource/Benchmarks/PAQ8p/paq8p: 1.88% (2.7722 => 2.8242, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.79% (6.0244 => 6.1324, std.dev.: 0.0229) MultiSource/Benchmarks/Bullet/bullet: 1.55% (38.9366 => 39.5406, std.dev.: 0.0827) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 19.39% (0.9281 => 1.1081, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.93% (1.2681 => 1.4321, std.dev.: 0.0445) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.26% (1.2121 => 1.3001, std.dev.: 0.0273) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 2.07% (21.6534 => 22.1014, std.dev.: 0.1057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.89% (4.0203 => 4.0963, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0229) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (1.3681 => 1.3921, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 1.63% (5.1603 => 5.2443, std.dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.48% (5.9604 => 6.0484, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.0923 => 4.1523, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.34% (4.4883 => 4.5483, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.26% (6.2884 => 0.8640, std.dev.: 0.0158) SingleSource/UnitTests/Vector/constpool: -81.30% (10.9087 => 2.0401, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0075) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.04% (7.4801 => 6.2800, std.dev.: 0.0346) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.78% (7.5041 => 6.3200, std.dev.: 0.0614) SingleSource/UnitTests/Vector/multiplies: -14.63% (0.1640 => 0.1400, std.dev.: 0.0069) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -2.45% (13.5243 => 13.1923, std.dev.: 0.0334) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.66% (21.6534 => 17.8291, std.dev.: 0.0702) MultiSource/Benchmarks/McCat/18-imp/imp: -15.79% (0.0760 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -15.69% (7.8005 => 6.5764, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -8.30% (3.4682 => 3.1802, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.22% (29.4578 => 28.2138, std.dev.: 0.4219) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9202 => 2.8282, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.44% (2.6202 => 2.5562, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: -2.31% (8.3085 => 8.1165, std.dev.: 0.0172) MultiSource/Applications/hexxagon/hexxagon: -1.75% (11.6527 => 11.4487, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7603 => 4.6803, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -1.10% (2.9122 => 2.8802, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Apr 24 22:22:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 00:22:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425052239.2684B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24941?compare_to=24936&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24941, Order: 207162, Start Time: 2014-04-25 00:44:53, End Time: 2014-04-25 05:29:20 To: 24936, Order: 207151, Start Time: 2014-04-24 23:02:36, End Time: 2014-04-25 03:42:44 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (109 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/short_circuit_dtor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/objinst: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3560 => 0.3680, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.51% (0.7960 => 0.8160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.94% (1.2361 => 1.2601, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.9001 => 0.9161, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.76% (1.3641 => 1.3881, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.55% (1.2881 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.54% (1.3001 => 1.3201, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5842 => 2.6202, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 1.23% (2.6121 => 2.6441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.20% (1.3361 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.19% (1.3481 => 1.3641, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.08% (1.4761 => 1.4921, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.07% (1.1601 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.50% (1.1481 => 1.2801, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.75% (1.2281 => 1.3601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.06% (1.3681 => 1.4921, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (10.6960 => 11.5120, std.dev.: 0.0599) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0390) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0479) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0279) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0167) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0197) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.9200 => 5.1280, std.dev.: 0.0402) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0358) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0298) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0139) MultiSource/Applications/JM/lencod/lencod: 3.38% (17.6165 => 18.2125, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.8322 => 2.9162, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0362) MultiSource/Applications/siod/siod: 2.80% (2.5721 => 2.6441, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0435) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.45% (48.1088 => 49.2890, std.dev.: 0.0730) MultiSource/Applications/sqlite3/sqlite3: 2.31% (23.7574 => 24.3055, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0387) MultiSource/Benchmarks/Bullet/bullet: 2.26% (37.0925 => 37.9326, std.dev.: 0.0546) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0137) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1491, std.dev.: 0.0646) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0105) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0355) MultiSource/Applications/ClamAV/clamscan: 1.10% (17.4082 => 17.6002, std.dev.: 0.0373) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 7.86% (1.0681 => 1.1521, std.dev.: 0.0323) MultiSource/Applications/lua/lua: 4.78% (21.1533 => 22.1654, std.dev.: 0.0869) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (25.8896 => 26.7897, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: 1.12% (5.0123 => 5.0683, std.dev.: 0.0183) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0115) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.5522 => 3.5122, std.dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 24 22:45:47 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 24 Apr 2014 22:45:47 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425054620.917184FEFBAB@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14793 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207172 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17832 of 17833) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17833 of 17833) 1 warning(s) in tests. Testing Time: 355.31s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207172) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Thu Apr 24 23:17:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 01:17:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425061730.DD9C02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24942?compare_to=24941&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24942, Order: 207167, Start Time: 2014-04-25 01:42:22, End Time: 2014-04-25 06:24:12 To: 24941, Order: 207162, Start Time: 2014-04-25 00:44:53, End Time: 2014-04-25 05:29:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (93 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 8.33% (0.3360 => 0.3640, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 15.15% (0.2640 => 0.3040, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: 2.05% (0.5840 => 0.5960, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -2.71% (2.5080 => 2.4400, std.dev.: 0.0260) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0483) MultiSource/Benchmarks/Olden/bh/bh: 7.06% (0.3400 => 0.3640, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0396) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0194) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0472) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0191) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0551) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0303) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0329) MultiSource/Applications/JM/lencod/lencod: 2.63% (17.6165 => 18.0805, std.dev.: 0.0658) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0124) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0041) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.27% (48.1088 => 49.2010, std.dev.: 0.0573) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 2.02% (23.7574 => 24.2375, std.dev.: 0.0328) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8206, std.dev.: 0.0826) MultiSource/Applications/kimwitu++/kc: 1.70% (18.8170 => 19.1371, std.dev.: 0.0500) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0465) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/bigfib: 8.57% (0.2800 => 0.3040, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 4.84% (21.1533 => 22.1774, std.dev.: 0.0815) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0290) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (5.0123 => 5.0923, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0026) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0103) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -50.00% (0.0240 => 0.0120, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: -18.18% (0.0880 => 0.0720, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.22% (1.2601 => 1.2321, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/fldry: -1.97% (0.6080 => 0.5960, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Thu Apr 24 23:38:25 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Thu, 24 Apr 2014 23:38:25 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425063850.113364FF01C8@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14794 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207173 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17832 of 17833) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17833 of 17833) 1 warning(s) in tests. Testing Time: 362.60s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207173) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 00:05:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 02:05:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425070546.7DE0C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24943?compare_to=24942&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24943, Order: 207171, Start Time: 2014-04-25 02:30:49, End Time: 2014-04-25 07:12:27 To: 24942, Order: 207167, Start Time: 2014-04-25 01:42:22, End Time: 2014-04-25 06:24:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (104 on baseline) Performance Improvements: 1 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 5.77% (0.4160 => 0.4400, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 1.66% (0.9640 => 0.9800, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/minisat/minisat: -1.95% (0.8200 => 0.8040, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.75% (1.2281 => 1.3601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0404) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.3200 => 0.3400, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0785) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.84% (0.2480 => 0.2600, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0511) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0153) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0280) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0383) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0448) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0407) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0147) MultiSource/Applications/JM/lencod/lencod: 2.52% (17.6165 => 18.0605, std.dev.: 0.0599) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0095) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0154) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.05% (48.1088 => 49.0929, std.dev.: 0.1000) MultiSource/Benchmarks/Bullet/bullet: 1.82% (37.0925 => 37.7685, std.dev.: 0.0927) MultiSource/Applications/sqlite3/sqlite3: 1.82% (23.7574 => 24.1895, std.dev.: 0.0605) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1250, std.dev.: 0.0511) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 4.73% (21.1533 => 22.1534, std.dev.: 0.0892) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.80% (6.6564 => 6.7764, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (2.5602 => 2.5882, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.28% (10.8967 => 2.0401, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: -15.91% (0.1760 => 0.1480, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.66% (4.4683 => 4.2603, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 00:41:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 02:41:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425074108.B69752A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24944?compare_to=24943&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24944, Order: 207172, Start Time: 2014-04-25 03:07:49, End Time: 2014-04-25 07:47:40 To: 24943, Order: 207171, Start Time: 2014-04-25 02:30:49, End Time: 2014-04-25 07:12:27 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (106 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 133.33% (0.0120 => 0.0280, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.50% (0.1600 => 0.1800, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.65% (0.5480 => 0.5680, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 1.99% (5.0160 => 5.1160, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (11.3600 => 11.5000, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.22% (1.3081 => 1.3241, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 1.17% (17.4202 => 17.6242, std.dev.: 0.0547) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 5.52% (0.5800 => 0.6120, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.14% (3.8962 => 4.0963, std.dev.: 0.0235) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.92% (1.2081 => 1.3521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.09% (1.3641 => 1.4881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0490) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0387) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (1.7360 => 1.8240, std.dev.: 0.0213) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0209) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.41% (0.5440 => 0.5680, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.03% (8.1441 => 8.4721, std.dev.: 0.0581) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/lists1: 3.41% (0.3520 => 0.3640, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0441) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0471) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0333) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0378) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0316) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.48% (48.1088 => 49.3009, std.dev.: 0.0732) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0438) MultiSource/Applications/sqlite3/sqlite3: 2.31% (23.7574 => 24.3055, std.dev.: 0.0518) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0152) MultiSource/Benchmarks/Bullet/bullet: 2.18% (37.0925 => 37.9006, std.dev.: 0.0520) MultiSource/Applications/kimwitu++/kc: 1.89% (18.8170 => 19.1731, std.dev.: 0.0581) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0171) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0401) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 1.24% (17.4082 => 17.6242, std.dev.: 0.0547) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (15.2282 => 15.3922, std.dev.: 0.0433) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 5.12% (21.1533 => 22.2374, std.dev.: 0.1601) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.79% (4.6843 => 4.7683, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.79% (4.0243 => 4.0963, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 1.44% (6.6564 => 6.7524, std.dev.: 0.0207) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0648) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.28% (10.8967 => 2.0401, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.18% (0.1760 => 0.1440, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0063) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 01:06:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 03:06:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425080638.660D92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24945?compare_to=24935&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24945, Order: 207173, Start Time: 2014-04-25 03:30:02, End Time: 2014-04-25 08:13:12 To: 24935, Order: 207147, Start Time: 2014-04-24 22:38:57, End Time: 2014-04-25 03:21:43 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 10 (154 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (930 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/FloatPrecision: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 28.57% (0.0560 => 0.0720, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.36% (0.2240 => 0.2360, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 1.73% (2.7802 => 2.8282, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.55% (1.5521 => 1.5761, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: 1.39% (2.0121 => 2.0401, std.dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 1.18% (19.3844 => 19.6124, std.dev.: 0.0668) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.43% (11.3687 => 3.0202, std.dev.: 0.0154) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0097) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0109) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0052) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0032) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 47.06% (0.0680 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0059) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0180) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.4401 => 1.6041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.26% (1.4561 => 1.6201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.14% (1.6521 => 1.8361, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.11% (0.1440 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.53% (0.2280 => 0.2520, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.16% (1.4961 => 1.6481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.77% (1.0240 => 1.1240, std.dev.: 0.0225) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.46% (1.7761 => 1.9441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.42% (1.5281 => 1.6721, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.26% (0.2160 => 0.2360, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.18% (1.6121 => 1.7601, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.84% (1.4481 => 1.5761, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: 8.57% (1.8680 => 2.0280, std.dev.: 0.0235) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.49% (0.4240 => 0.4600, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.80% (1.4361 => 1.5481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (0.2200 => 0.2360, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.90% (0.3480 => 0.3720, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (11.6440 => 12.4320, std.dev.: 0.0388) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.67% (1.7400 => 1.8560, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.95% (9.4842 => 10.0482, std.dev.: 0.0327) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (6.4680 => 6.8440, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (5.8121 => 6.1361, std.dev.: 0.0321) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (6.5440 => 6.8720, std.dev.: 0.0523) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.97% (0.7240 => 0.7600, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.86% (6.5080 => 6.8240, std.dev.: 0.0301) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.64% (2.3281 => 2.4362, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.0443 => 10.5043, std.dev.: 0.0360) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 4.55% (5.3600 => 5.6040, std.dev.: 0.0502) MultiSource/Applications/JM/lencod/lencod: 4.26% (21.9606 => 22.8968, std.dev.: 0.0669) MultiSource/Applications/siod/siod: 4.12% (2.7162 => 2.8282, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (3.0282 => 3.1482, std.dev.: 0.0151) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0090) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.84% (50.0290 => 51.9490, std.dev.: 0.1419) MultiSource/Applications/lua/lua: 3.76% (4.7880 => 4.9680, std.dev.: 0.0310) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 3.56% (18.4404 => 19.0966, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0163) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.7921 => 1.8481, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0186) MultiSource/Applications/ClamAV/clamscan: 2.98% (19.0444 => 19.6124, std.dev.: 0.0668) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 2.94% (38.4046 => 39.5326, std.dev.: 0.0926) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (16.3483 => 16.8283, std.dev.: 0.0622) MultiSource/Benchmarks/nbench/nbench: 2.93% (1.7721 => 1.8241, std.dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 2.66% (19.6891 => 20.2131, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 1.88% (1.4881 => 1.5161, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (13.0563 => 13.2683, std.dev.: 0.0257) MultiSource/Applications/sqlite3/sqlite3: 1.12% (25.6856 => 25.9736, std.dev.: 0.0555) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (29.3338 => 29.6419, std.dev.: 0.0478) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.1200 => 0.1400, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0459) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.26% (3.7122 => 3.7962, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 2.16% (6.6684 => 6.8124, std.dev.: 0.0330) MultiSource/Applications/hexxagon/hexxagon: 1.77% (11.5087 => 11.7127, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1921 => 2.2241, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (2.9322 => 2.9722, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1245 => 8.2125, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.80% (10.6247 => 2.0401, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.21% (91.8497 => 49.4031, std.dev.: 10.7072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.57% (26.0616 => 17.0531, std.dev.: 0.0912) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.09% (50.3031 => 33.1541, std.dev.: 0.1349) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.25% (42.1466 => 28.5538, std.dev.: 0.3584) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1109) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.06% (0.3400 => 0.3160, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.09% (1.2481 => 1.1721, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -2.02% (5.1563 => 5.0523, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.02% (5.1563 => 5.0523, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.45% (1.3761 => 1.3561, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.36% (4.1243 => 4.0683, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 01:25:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 03:25:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425082510.2800E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24946?compare_to=24944&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24946, Order: 207173, Start Time: 2014-04-25 03:51:02, End Time: 2014-04-25 08:31:51 To: 24944, Order: 207172, Start Time: 2014-04-25 03:07:49, End Time: 2014-04-25 07:47:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (112 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.12% (0.1320 => 0.1480, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0061) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.96% (1.2160 => 1.2520, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0128) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.74% (1.2321 => 1.3521, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0532) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0342) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0253) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0468) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3800 => 1.4400, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (4.9200 => 5.1240, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0316) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0480) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0244) MultiSource/Applications/JM/lencod/lencod: 3.18% (17.6165 => 18.1765, std.dev.: 0.0499) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.8322 => 2.9162, std.dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0427) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.62% (1.2200 => 1.2520, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0303) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.43% (48.1088 => 49.2770, std.dev.: 0.1051) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: 2.16% (23.7574 => 24.2695, std.dev.: 0.0392) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 2.01% (37.0925 => 37.8366, std.dev.: 0.0617) MultiSource/Applications/kimwitu++/kc: 1.96% (18.8170 => 19.1851, std.dev.: 0.0421) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0183) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0524) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (15.2282 => 15.4002, std.dev.: 0.0638) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0100) MultiSource/Applications/lua/lua: 4.88% (21.1533 => 22.1854, std.dev.: 0.1402) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (25.8896 => 26.7817, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0048) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4842 => 3.5442, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5602 => 2.5922, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.28% (10.8967 => 2.0401, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -44.44% (0.0360 => 0.0200, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 02:03:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 04:03:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140425090333.E84A12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24947?compare_to=24937&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24947, Order: 207174, Start Time: 2014-04-25 04:24:20, End Time: 2014-04-25 09:10:13 To: 24937, Order: 207155, Start Time: 2014-04-24 23:29:44, End Time: 2014-04-25 04:16:02 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 11 (151 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR640: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: 33.33% (0.0600 => 0.0800, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.78% (0.2360 => 0.2520, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.76% (0.2520 => 0.2640, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.00% (0.3000 => 0.3120, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (1.7520 => 1.8000, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.13% (2.1201 => 2.1441, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.71% (0.3400 => 0.3560, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.83% (0.7320 => 0.7600, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.45% (17.6723 => 19.6963, std.dev.: 0.0537) MultiSource/Applications/sqlite3/sqlite3: 1425.65% (1.7001 => 25.9376, std.dev.: 0.0367) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.38% (50.1010 => 51.7930, std.dev.: 0.1058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (1.0520 => 1.0880, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (11.3920 => 12.3560, std.dev.: 0.0718) SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3407 => 3.0242, std.dev.: 0.0109) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0443, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0105) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0078) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) SingleSource/Regression/C/PR640: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 33.33% (0.0600 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: 31.25% (0.0640 => 0.0840, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.62% (1.8601 => 2.1321, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0124) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.76% (1.9121 => 2.1561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.19% (1.7721 => 1.9881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.00% (0.1000 => 0.1120, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.67% (1.9201 => 2.1441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.50% (1.8441 => 2.0561, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (0.1800 => 0.2000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0110) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.8760 => 2.0560, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0074) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.70% (0.1840 => 0.2000, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (1.0880 => 1.1760, std.dev.: 0.0251) MultiSource/Applications/spiff/spiff: 7.48% (1.0160 => 1.0920, std.dev.: 0.0213) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.3760 => 0.4040, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.45% (0.2480 => 0.2640, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (6.4800 => 6.8800, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.09% (0.7880 => 0.8360, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0251) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (1.6641 => 1.7481, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (0.4760 => 0.5000, std.dev.: 0.0080) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (9.6042 => 10.0482, std.dev.: 0.0412) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.9960 => 1.0400, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (5.8281 => 6.0801, std.dev.: 0.0386) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (1.2120 => 1.2600, std.dev.: 0.0143) MultiSource/Applications/lua/lua: 3.92% (4.7920 => 4.9800, std.dev.: 0.0333) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (6.5360 => 6.7840, std.dev.: 0.0431) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (5.3960 => 5.5960, std.dev.: 0.0303) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.2283 => 10.6044, std.dev.: 0.0345) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0099) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0214) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.38% (1.3000 => 1.3440, std.dev.: 0.0169) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (6.5320 => 6.7480, std.dev.: 0.0512) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0100) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.25% (0.6160 => 0.6360, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (2.1600 => 2.2280, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (16.3003 => 16.8083, std.dev.: 0.0376) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.5040 => 1.5480, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0110) MultiSource/Applications/oggenc/oggenc: 2.67% (7.0524 => 7.2405, std.dev.: 0.0161) MultiSource/Applications/SPASS/SPASS: 2.57% (18.5284 => 19.0046, std.dev.: 0.0628) MultiSource/Applications/d/make_dparser: 2.52% (3.9761 => 4.0761, std.dev.: 0.0199) MultiSource/Benchmarks/Bullet/bullet: 2.41% (38.6366 => 39.5686, std.dev.: 0.1117) MultiSource/Applications/JM/lencod/lencod: 2.38% (22.2206 => 22.7487, std.dev.: 0.0647) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2243 => 4.3243, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 2.03% (2.7522 => 2.8082, std.dev.: 0.0159) MultiSource/Applications/kimwitu++/kc: 1.63% (19.8291 => 20.1531, std.dev.: 0.0367) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.15% (2.1201 => 2.4202, std.dev.: 0.0562) MultiSource/Applications/siod/siod: 10.47% (2.8642 => 3.1642, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.3725 => 7.6765, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (3.4122 => 3.5362, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.26% (5.0243 => 5.1883, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 3.09% (6.5964 => 6.8004, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (3.7122 => 3.8242, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.70% (0.7400 => 0.7600, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.77% (11.4967 => 11.7007, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.70% (5.4163 => 5.5083, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.58% (4.8043 => 4.8803, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.50% (4.0003 => 4.0603, std.dev.: 0.0222) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.17% (94.8339 => 49.1511, std.dev.: 10.1584) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.09% (49.9431 => 32.9181, std.dev.: 0.2044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.73% (25.7136 => 17.0411, std.dev.: 0.0983) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.97% (37.0863 => 28.5658, std.dev.: 0.4220) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.57% (2.8002 => 2.7562, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 02:05:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 04:05:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140425090545.275352A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24948?compare_to=24938&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24948, Order: 207174, Start Time: 2014-04-25 04:29:15, End Time: 2014-04-25 09:12:19 To: 24938, Order: 207156, Start Time: 2014-04-24 23:37:31, End Time: 2014-04-25 04:20:48 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 14 (159 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Treesort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.05% (0.0840 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 19.05% (0.0840 => 0.1000, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.33% (0.1800 => 0.2040, std.dev.: 0.0075) SingleSource/UnitTests/Vectorizer/gcc-loops: 6.85% (0.5840 => 0.6240, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: 5.41% (0.2960 => 0.3120, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.3600 => 0.3760, std.dev.: 0.0061) MultiSource/Applications/hbd/hbd: 4.09% (1.7600 => 1.8320, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.45% (1.3761 => 1.3961, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 12.50% (0.0960 => 0.1080, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 6.93% (1.0961 => 1.1721, std.dev.: 0.0291) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -9.09% (0.1320 => 0.1200, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2362.50% (0.0320 => 0.7880, std.dev.: 0.0132) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0081) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0091) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 195.24% (0.2520 => 0.7440, std.dev.: 0.0168) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0050) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 85.00% (0.0800 => 0.1480, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0059) SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0070) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0069) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0244) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: 34.62% (0.1040 => 0.1400, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 25.32% (1.2481 => 1.5641, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.13% (1.1761 => 1.4481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.00% (1.2001 => 1.4761, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.45% (1.1401 => 1.3961, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.11% (1.1761 => 1.4361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.71% (1.2161 => 1.4801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.54% (1.3001 => 1.5801, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (1.1441 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.78% (1.2321 => 1.4881, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.52% (1.2281 => 1.4801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.13% (1.2521 => 1.5041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.86% (1.1881 => 1.4241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.49% (1.2521 => 1.4961, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.25% (1.2881 => 1.5361, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0144) MultiSource/Applications/JM/ldecod/ldecod: 18.70% (8.5802 => 10.1843, std.dev.: 0.0530) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.91% (0.1760 => 0.2040, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 15.50% (19.5406 => 22.5687, std.dev.: 0.0545) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (5.3360 => 6.0961, std.dev.: 0.0392) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.7400 => 1.9560, std.dev.: 0.0279) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.23% (0.5560 => 0.6240, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.59% (0.2920 => 0.3200, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 9.35% (11.3843 => 12.4483, std.dev.: 0.0333) MultiSource/Applications/oggenc/oggenc: 9.04% (6.2844 => 6.8524, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (5.6680 => 6.1440, std.dev.: 0.0613) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.10% (5.7280 => 6.1920, std.dev.: 0.0387) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.05% (0.3480 => 0.3760, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (11.4440 => 12.3120, std.dev.: 0.0910) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0070) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.72% (9.5802 => 10.2242, std.dev.: 0.0485) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.65% (1.6240 => 1.7320, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.97% (0.8040 => 0.8520, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 4.90% (5.3840 => 5.6480, std.dev.: 0.0501) MultiSource/Applications/lua/lua: 4.78% (4.7720 => 5.0000, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.50% (0.8000 => 0.8360, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0122) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (6.8280 => 7.0880, std.dev.: 0.0468) SingleSource/Benchmarks/Misc-C++/bigfib: 3.76% (0.7440 => 0.7720, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0053) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.47% (49.1529 => 50.8569, std.dev.: 0.1120) MultiSource/Applications/sqlite3/sqlite3: 3.25% (24.7575 => 25.5616, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.7600 => 1.8160, std.dev.: 0.0172) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.6961 => 1.7481, std.dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 3.06% (19.2243 => 19.8124, std.dev.: 0.0453) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0122) MultiSource/Applications/hbd/hbd: 2.69% (1.7840 => 1.8320, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (2.0920 => 2.1480, std.dev.: 0.0181) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: 2.25% (19.7491 => 20.1931, std.dev.: 0.0678) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: 1.77% (39.0726 => 39.7646, std.dev.: 0.1018) MultiSource/Applications/SPASS/SPASS: 1.62% (18.7966 => 19.1006, std.dev.: 0.0521) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0124 => 6.1004, std.dev.: 0.0283) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (3.0402 => 3.0802, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (16.7083 => 16.9083, std.dev.: 0.0349) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.84% (1.2401 => 1.4241, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.43% (3.9842 => 4.2803, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.92% (3.3122 => 3.5082, std.dev.: 0.0550) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 4.42% (2.9842 => 3.1162, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 3.87% (6.8204 => 7.0844, std.dev.: 0.0436) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0203 => 5.1643, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 2.75% (5.0963 => 5.2363, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.17% (4.0563 => 4.1443, std.dev.: 0.0225) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (25.4536 => 25.9056, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0105) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -19.12% (8.9566 => 7.2445, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.59% (21.6534 => 17.8451, std.dev.: 0.0475) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0914) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.93% (4.7643 => 4.6723, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0114) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 02:14:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 04:14:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425091402.ABE7D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24949?compare_to=24939&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24949, Order: 207174, Start Time: 2014-04-25 04:34:42, End Time: 2014-04-25 09:20:43 To: 24939, Order: 207157, Start Time: 2014-04-24 23:39:55, End Time: 2014-04-25 04:26:26 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1103 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: 12.00% (0.2000 => 0.2240, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.20% (0.3920 => 0.4320, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 1.69% (1.8881 => 1.9201, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.08% (1.8521 => 1.8721, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.96% (0.2160 => 0.2440, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.13% (0.4840 => 0.4640, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0156) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 4.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 02:29:25 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 02:29:25 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425093020.2DA074FF164D@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14795 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207174 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17832 of 17833) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17833 of 17833) 1 warning(s) in tests. Testing Time: 442.83s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207174) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 02:45:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 04:45:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140425094550.4D2A32A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24950?compare_to=24940&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24950, Order: 207195, Start Time: 2014-04-25 05:04:09, End Time: 2014-04-25 09:52:29 To: 24940, Order: 207158, Start Time: 2014-04-25 00:11:02, End Time: 2014-04-25 04:59:07 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (124 on baseline) Performance Improvements: 4 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (950 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/div: 80.00% (0.0200 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 31.25% (0.0640 => 0.0840, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 11.76% (0.1360 => 0.1520, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 3.39% (0.4720 => 0.4880, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.05% (2.1480 => 2.1920, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.03% (2.3201 => 2.3441, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 9.06% (3.1802 => 3.4682, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.24% (5.4843 => 5.5523, std.dev.: 0.0247) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.70% (2.8242 => 2.7762, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -4.50% (5.2443 => 5.0083, std.dev.: 0.0245) MultiSource/Applications/sqlite3/sqlite3: -1.83% (4.1523 => 4.0763, std.dev.: 0.0248) MultiSource/Applications/lua/lua: -1.50% (22.1014 => 21.7694, std.dev.: 0.0834) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0045) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0035) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 23.53% (0.0680 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.58% (1.6681 => 2.0281, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.89% (1.8001 => 2.1761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.70% (1.7201 => 2.0761, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.52% (1.6761 => 2.0201, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.34% (1.8881 => 2.2721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.18% (1.7241 => 2.0721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.91% (1.7481 => 2.0961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.62% (1.9761 => 2.3441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (1.9601 => 2.3241, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.97% (1.9801 => 2.3161, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0185) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.11% (0.1480 => 0.1600, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0075) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (6.7200 => 7.1680, std.dev.: 0.0404) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.67% (0.7200 => 0.7680, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.31% (11.7880 => 12.5320, std.dev.: 0.0670) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.25% (1.7280 => 1.8360, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.10% (0.3280 => 0.3480, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.00% (2.0680 => 2.1920, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.99% (1.5240 => 1.6000, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 4.62% (1.5600 => 1.6320, std.dev.: 0.0201) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0198) MultiSource/Applications/lua/lua: 4.34% (4.7920 => 5.0000, std.dev.: 0.0388) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (9.9842 => 10.4162, std.dev.: 0.0515) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.11% (2.0440 => 2.1280, std.dev.: 0.0159) MultiSource/Applications/d/make_dparser: 4.04% (3.9641 => 4.1241, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.86% (6.8321 => 7.0961, std.dev.: 0.0224) MultiSource/Applications/oggenc/oggenc: 3.70% (6.9124 => 7.1684, std.dev.: 0.0153) MultiSource/Applications/treecc/treecc: 3.66% (2.6200 => 2.7160, std.dev.: 0.0192) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 3.53% (10.3203 => 10.6843, std.dev.: 0.0355) MultiSource/Applications/SPASS/SPASS: 3.37% (18.4924 => 19.1165, std.dev.: 0.0410) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0087) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.69% (51.1089 => 52.4849, std.dev.: 0.0745) MultiSource/Applications/ClamAV/clamscan: 2.57% (20.2445 => 20.7645, std.dev.: 0.0511) MultiSource/Applications/kimwitu++/kc: 2.51% (19.7371 => 20.2331, std.dev.: 0.0501) MultiSource/Applications/JM/lencod/lencod: 2.51% (22.6287 => 23.1967, std.dev.: 0.0640) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 2.18% (2.7562 => 2.8162, std.dev.: 0.0152) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (16.5963 => 16.9363, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 1.67% (38.9366 => 39.5886, std.dev.: 0.0905) MultiSource/Applications/sqlite3/sqlite3: 1.59% (25.1895 => 25.5896, std.dev.: 0.0645) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0244 => 6.1164, std.dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 17.67% (0.9281 => 1.0921, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.51% (1.2681 => 1.4521, std.dev.: 0.0101) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0159) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1761 => 2.2521, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (3.4402 => 3.5322, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.76% (5.4563 => 5.5523, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0434) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (4.4883 => 4.5523, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.42% (1.4041 => 1.4241, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0140) SingleSource/UnitTests/Vector/constpool: -81.34% (10.9087 => 2.0361, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.45% (1.5881 => 1.1681, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: -21.45% (2.6481 => 2.0800, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.63% (7.4801 => 6.2360, std.dev.: 0.0650) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.73% (7.5041 => 6.3240, std.dev.: 0.0410) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0053) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -2.43% (13.5243 => 13.1963, std.dev.: 0.0319) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.48% (21.6534 => 17.8691, std.dev.: 0.0379) SingleSource/Benchmarks/Linpack/linpack-pc: -15.69% (7.8005 => 6.5764, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0088) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -2.95% (5.1603 => 5.0083, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -2.17% (8.3085 => 8.1285, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.14% (2.6202 => 2.5642, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -1.85% (11.6527 => 11.4367, std.dev.: 0.0131) MultiSource/Applications/aha/aha: -1.24% (2.9122 => 2.8762, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 03:11:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 05:11:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425101151.B12A22A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24951?compare_to=24946&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24951, Order: 207195, Start Time: 2014-04-25 05:34:09, End Time: 2014-04-25 10:18:31 To: 24946, Order: 207173, Start Time: 2014-04-25 03:51:02, End Time: 2014-04-25 08:31:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (103 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Oscar: 28.57% (0.0560 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 19.05% (0.0840 => 0.1000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/moments: 3.74% (0.4280 => 0.4440, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.53% (1.3081 => 1.3281, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 2.72% (0.5880 => 0.6040, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0093) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0646) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0417) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0156) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0492) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0364) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0207) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0507) MultiSource/Applications/siod/siod: 2.80% (2.5721 => 2.6441, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: 2.78% (0.4320 => 0.4440, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0490) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.9640 => 2.0160, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.5480 => 1.5880, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 2.50% (17.6165 => 18.0565, std.dev.: 0.0628) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0532) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0087) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.28% (48.1088 => 49.2049, std.dev.: 0.0765) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0390) MultiSource/Benchmarks/Bullet/bullet: 1.88% (37.0925 => 37.7886, std.dev.: 0.0625) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.80% (4.9000 => 4.9880, std.dev.: 0.0341) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0487) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1251, std.dev.: 0.0543) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0532) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0517) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.76% (1.0921 => 1.1441, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.55% (25.8896 => 26.8097, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0127) MultiSource/Applications/lua/lua: 2.93% (21.1533 => 21.7734, std.dev.: 0.1681) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.74% (4.5203 => 4.6443, std.dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.5522 => 3.5042, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 03:27:06 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 03:27:06 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425102742.13C054FF1DD2@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14796 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207181 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17832 of 17833) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17833 of 17833) 1 warning(s) in tests. Testing Time: 397.66s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207181) ^ :1:29: note: possible intended match here clang version 3.5.0 (trunk 207181) ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 04:04:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 06:04:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425110454.693432A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24952?compare_to=24951&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24952, Order: 207197, Start Time: 2014-04-25 06:29:58, End Time: 2014-04-25 11:11:34 To: 24951, Order: 207195, Start Time: 2014-04-25 05:34:09, End Time: 2014-04-25 10:18:31 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (102 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Regression/C++/EH/class_hierarchy: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.00% (0.3000 => 0.3360, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.71% (0.2240 => 0.2480, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.89% (1.0601 => 1.0801, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 1.14% (3.5042 => 3.5442, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -57.14% (0.0280 => 0.0120, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.99% (0.6040 => 0.5920, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0118) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0640) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.05% (0.6240 => 0.6680, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.71% (1.1921 => 1.2721, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0331) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0300) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0194) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0379) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0604) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: 2.59% (17.6165 => 18.0725, std.dev.: 0.0485) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1929, std.dev.: 0.1148) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0405) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0273) MultiSource/Benchmarks/Bullet/bullet: 1.84% (37.0925 => 37.7765, std.dev.: 0.1039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0146) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0164) MultiSource/Applications/kimwitu++/kc: 1.49% (18.8170 => 19.0970, std.dev.: 0.0574) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0490) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0188) MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1560 => 0.1680, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout/lists: 3.71% (5.8164 => 6.0324, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.49% (25.8896 => 26.7937, std.dev.: 0.0389) MultiSource/Applications/lua/lua: 2.89% (21.1533 => 21.7654, std.dev.: 0.1006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 1.56% (6.6564 => 6.7604, std.dev.: 0.0218) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4842 => 3.5322, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.0123 => 5.0803, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0643 => 4.1163, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 04:38:00 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 04:38:00 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425113836.128C44FF265D@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14797 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207195 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17833 of 17834) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17834) 1 warning(s) in tests. Testing Time: 422.89s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17684 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207195) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 04:52:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 06:52:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425115233.C3AAC2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24953?compare_to=24952&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24953, Order: 207202, Start Time: 2014-04-25 07:18:15, End Time: 2014-04-25 11:59:10 To: 24952, Order: 207197, Start Time: 2014-04-25 06:29:58, End Time: 2014-04-25 11:11:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (106 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_shift: 40.00% (0.0400 => 0.0560, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.03% (0.3960 => 0.4080, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.52% (1.2721 => 1.3041, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0024) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: 36.36% (0.0440 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.38% (1.1561 => 1.2761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0122) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0415) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0397) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0526) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0039) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0173) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (10.4082 => 10.8282, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0381) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0178) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0392) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0495) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0329) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0105) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.00% (48.1088 => 49.0729, std.dev.: 0.0890) MultiSource/Benchmarks/Bullet/bullet: 1.88% (37.0925 => 37.7886, std.dev.: 0.0450) MultiSource/Applications/sqlite3/sqlite3: 1.77% (23.7574 => 24.1775, std.dev.: 0.0360) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0423) MultiSource/Applications/kimwitu++/kc: 1.15% (18.8170 => 19.0330, std.dev.: 0.0711) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0253) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 2.76% (21.1533 => 21.7374, std.dev.: 0.1827) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.62% (6.6564 => 6.7644, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 05:27:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 07:27:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425122755.E5EE12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24954?compare_to=24953&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24954, Order: 207203, Start Time: 2014-04-25 07:54:41, End Time: 2014-04-25 12:34:35 To: 24953, Order: 207202, Start Time: 2014-04-25 07:18:15, End Time: 2014-04-25 11:59:10 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (94 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.17% (0.2360 => 0.2600, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4480 => 0.4640, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.24% (1.2881 => 1.3041, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.28% (0.1720 => 0.2000, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0022) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0634) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0174) MultiSource/Benchmarks/sim/sim: 5.88% (0.3400 => 0.3600, std.dev.: 0.0047) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0399) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0200) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0282) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0424) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.9200 => 5.1040, std.dev.: 0.0318) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0438) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0154) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0313) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0485) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0547) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.89% (48.1088 => 49.0169, std.dev.: 0.1052) MultiSource/Benchmarks/Bullet/bullet: 1.89% (37.0925 => 37.7926, std.dev.: 0.0839) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0111) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0851, std.dev.: 0.0375) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0330) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0343) MultiSource/Applications/lua/lua: 3.04% (21.1533 => 21.7974, std.dev.: 0.0641) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0643 => 4.1163, std.dev.: 0.0190) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0060) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -28.57% (0.0560 => 0.0400, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 05:20:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 05:20:42 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425125204.EEB1B4FF2E7E@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14798 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207197 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17833 of 17834) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17834 of 17834) 1 warning(s) in tests. Testing Time: 409.07s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17684 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207197) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 05:55:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 07:55:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425125503.73B772A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24955?compare_to=24945&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24955, Order: 207203, Start Time: 2014-04-25 08:19:19, End Time: 2014-04-25 13:01:47 To: 24945, Order: 207173, Start Time: 2014-04-25 03:30:02, End Time: 2014-04-25 08:13:12 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 18 (149 on baseline) Performance Improvements: 5 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 300.00% (0.0040 => 0.0160, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.33% (0.7200 => 0.7800, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.92% (0.4880 => 0.5120, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 4.18% (1.0520 => 1.0960, std.dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: 3.21% (0.6240 => 0.6440, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (0.5120 => 0.5240, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.8481 => 1.8801, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 1.09% (4.0401 => 4.0841, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 16.67% (0.0960 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.12% (0.9361 => 1.0121, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.0042 => 4.0683, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.31% (2.7762 => 2.7122, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (2.9722 => 2.9122, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.00% (3.7962 => 3.7202, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.18% (4.0683 => 4.0203, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8082 => 2.7762, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0115) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7444, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 400.00% (0.0040 => 0.0200, std.dev.: 0.0018) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0076) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0062) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.56% (0.2360 => 0.2680, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.30% (0.4600 => 0.5120, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.28% (1.5601 => 1.7361, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.97% (0.6200 => 0.6880, std.dev.: 0.0228) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.84% (0.3320 => 0.3680, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.43% (1.4961 => 1.6521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0127) MultiSource/Applications/sgefa/sgefa: 10.27% (0.5840 => 0.6440, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.24% (1.5241 => 1.6801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.05% (1.5521 => 1.7081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0087) MultiSource/Applications/obsequi/Obsequi: 9.64% (1.8680 => 2.0480, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.30% (1.5481 => 1.6921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.7761 => 1.9401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 8.73% (1.0080 => 1.0960, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0212) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.29% (1.4481 => 1.5681, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.9800 => 1.0600, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.82% (1.4841 => 1.6001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.03% (1.0240 => 1.0960, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (6.4680 => 6.9000, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.42% (11.6440 => 12.3920, std.dev.: 0.0695) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0112) SingleSource/Benchmarks/Linpack/linpack-pc: 6.17% (0.3240 => 0.3440, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0096) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.95% (9.4842 => 10.0482, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.64% (5.8121 => 6.1401, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (1.7921 => 1.8801, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0224) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 4.45% (21.9606 => 22.9368, std.dev.: 0.0533) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0111) MultiSource/Applications/lua/lua: 4.26% (4.7880 => 4.9920, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (6.5080 => 6.7800, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5440 => 6.8160, std.dev.: 0.0518) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 4.10% (10.0443 => 10.4563, std.dev.: 0.0390) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 3.92% (1.7360 => 1.8040, std.dev.: 0.0163) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.1280 => 1.1720, std.dev.: 0.0135) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0205) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.70% (50.0290 => 51.8810, std.dev.: 0.0705) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.66% (1.3120 => 1.3600, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6601 => 1.7201, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.54% (4.1843 => 4.3323, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0211) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (5.3600 => 5.5360, std.dev.: 0.0481) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 3.15% (18.4404 => 19.0206, std.dev.: 0.0435) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (16.3483 => 16.8443, std.dev.: 0.0313) MultiSource/Benchmarks/Bullet/bullet: 2.98% (38.4046 => 39.5486, std.dev.: 0.0843) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0135) MultiSource/Applications/d/make_dparser: 2.92% (3.9681 => 4.0841, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.74% (1.0201 => 1.0481, std.dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 2.29% (19.0444 => 19.4803, std.dev.: 0.0727) MultiSource/Applications/kimwitu++/kc: 1.77% (19.6891 => 20.0371, std.dev.: 0.0628) MultiSource/Benchmarks/mafft/pairlocalalign: 1.19% (13.0563 => 13.2123, std.dev.: 0.0472) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.90% (2.1401 => 2.4162, std.dev.: 0.0639) MultiSource/Applications/siod/siod: 10.35% (2.8602 => 3.1562, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.51% (4.5603 => 4.7203, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0323) MultiSource/Applications/sqlite3/sqlite3: 2.11% (3.9842 => 4.0683, std.dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: 1.77% (11.5087 => 11.7127, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 1.28% (8.1245 => 8.2285, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.43% (2.9442 => 0.9000, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.20% (91.8497 => 49.4191, std.dev.: 10.4396) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.78% (26.0616 => 16.9971, std.dev.: 0.1568) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.45% (50.3031 => 32.9741, std.dev.: 0.2133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.62% (42.1466 => 28.8178, std.dev.: 0.2713) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1192) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.88% (0.3400 => 0.3200, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.52% (4.1243 => 4.0203, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/five11/five11: -2.04% (2.3561 => 2.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.47% (5.1563 => 5.0803, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.17% (2.7442 => 2.7122, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.11% (26.6977 => 26.4017, std.dev.: 0.0244) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 06:54:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 08:54:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140425135429.389772A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24956?compare_to=24948&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24956, Order: 207203, Start Time: 2014-04-25 09:18:28, End Time: 2014-04-25 14:01:12 To: 24948, Order: 207174, Start Time: 2014-04-25 04:29:15, End Time: 2014-04-25 09:12:19 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 14 (166 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2005-05-12-Int64ToFP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/2003-05-07-VarArgs: 133.33% (0.0120 => 0.0280, std.dev.: 0.0060) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.04% (0.1840 => 0.2080, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.11% (0.1440 => 0.1600, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 9.68% (0.1240 => 0.1360, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.84% (0.7440 => 0.7800, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 25.00% (0.1120 => 0.1400, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.36% (0.1760 => 0.1960, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.93% (2.3441 => 2.4362, std.dev.: 0.0342) MultiSource/Benchmarks/Olden/tsp/tsp: 3.44% (1.2801 => 1.3241, std.dev.: 0.0128) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -22.50% (0.1600 => 0.1240, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -4.43% (5.2363 => 5.0043, std.dev.: 0.0188) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0103) SingleSource/Regression/C/sumarray2d: 1033.33% (0.0360 => 0.4080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0078) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 190.48% (0.2520 => 0.7320, std.dev.: 0.0246) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0072) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0067) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0064) SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0062) SingleSource/Regression/C++/pointer_method2: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0061) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0062) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.27% (1.2321 => 1.5681, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.93% (0.1080 => 0.1360, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0152) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 25.00% (1.2481 => 1.5601, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: 23.40% (0.3760 => 0.4640, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.33% (1.2001 => 1.4801, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.81% (1.1401 => 1.4001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 22.22% (0.1080 => 0.1320, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 22.04% (1.2161 => 1.4841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.84% (1.1721 => 1.4281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.77% (1.1761 => 1.4321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.69% (1.1601 => 1.4001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.81% (1.2521 => 1.5001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.94% (1.2881 => 1.5321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0137) MultiSource/Applications/JM/ldecod/ldecod: 18.79% (8.5802 => 10.1923, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.3841 => 1.6321, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.65% (0.1360 => 0.1600, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 16.07% (0.4480 => 0.5200, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 15.66% (19.5406 => 22.6007, std.dev.: 0.0446) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 14.79% (1.3521 => 1.5521, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.65% (5.3360 => 6.0641, std.dev.: 0.0463) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1760 => 0.2000, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.10% (1.7400 => 1.9680, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.66% (0.3160 => 0.3560, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 9.59% (11.3843 => 12.4763, std.dev.: 0.0250) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.22% (5.7280 => 6.2560, std.dev.: 0.0322) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.17% (5.6680 => 6.1880, std.dev.: 0.0332) MultiSource/Applications/oggenc/oggenc: 8.97% (6.2844 => 6.8484, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.11% (0.1480 => 0.1600, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.07% (11.4440 => 12.3680, std.dev.: 0.0676) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (9.5802 => 10.2482, std.dev.: 0.0467) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.40% (1.6240 => 1.7280, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.98% (0.7360 => 0.7800, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.53% (1.3240 => 1.3840, std.dev.: 0.0206) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0381) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.28% (6.8280 => 7.1200, std.dev.: 0.0370) MultiSource/Benchmarks/MallocBench/gs/gs: 3.86% (5.3840 => 5.5920, std.dev.: 0.0593) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.67% (0.8721 => 0.9041, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.59% (49.1529 => 50.9169, std.dev.: 0.0965) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.6961 => 1.7561, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (1.7600 => 1.8200, std.dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 3.37% (19.2243 => 19.8724, std.dev.: 0.0335) SingleSource/Benchmarks/Shootout-C++/hash2: 3.23% (0.4960 => 0.5120, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (0.3760 => 0.3880, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 2.89% (24.7575 => 25.4735, std.dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.4320 => 1.4720, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0156) MultiSource/Applications/kimwitu++/kc: 2.13% (19.7491 => 20.1691, std.dev.: 0.0557) MultiSource/Benchmarks/Bullet/bullet: 1.72% (39.0726 => 39.7446, std.dev.: 0.0499) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.40% (6.0124 => 6.0964, std.dev.: 0.0179) MultiSource/Applications/SPASS/SPASS: 1.19% (18.7966 => 19.0205, std.dev.: 0.0587) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (29.3298 => 29.6259, std.dev.: 0.0482) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0159) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 4.40% (6.8204 => 7.1204, std.dev.: 0.0230) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0184) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0145) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (25.4536 => 25.8816, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/oourafft: 1.68% (7.3965 => 7.5205, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0563 => 4.1083, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0128) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.82% (11.0207 => 2.0041, std.dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.27% (21.6534 => 17.9131, std.dev.: 0.0249) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -9.22% (3.4722 => 3.1522, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0905) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.05% (4.5123 => 4.2843, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.81% (5.0963 => 5.0043, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: -1.04% (4.9963 => 4.9443, std.dev.: 0.0147) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 06:55:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 08:55:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140425135531.E9E3A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24957?compare_to=24947&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24957, Order: 207203, Start Time: 2014-04-25 09:16:23, End Time: 2014-04-25 14:02:14 To: 24947, Order: 207174, Start Time: 2014-04-25 04:24:20, End Time: 2014-04-25 09:10:13 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (137 on baseline) Performance Improvements: 4 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/FloatMM: 44.44% (0.0360 => 0.0520, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.1120 => 0.1280, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/mst/mst: 14.29% (0.1400 => 0.1600, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.11% (0.1480 => 0.1600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 7.89% (0.1520 => 0.1640, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.33% (0.3000 => 0.3160, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: 4.40% (0.3640 => 0.3800, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.68% (1.0880 => 1.1280, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 3.33% (0.4800 => 0.4960, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.56% (4.8803 => 4.9563, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 1.21% (0.9881 => 1.0001, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/perlin: -15.00% (0.0800 => 0.0680, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.72% (3.8242 => 3.7202, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.02% (2.7762 => 2.7202, std.dev.: 0.0030) MultiSource/Applications/lua/lua: -1.27% (22.0334 => 21.7534, std.dev.: 0.0821) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.50% (17.6723 => 19.7044, std.dev.: 0.0452) MultiSource/Applications/sqlite3/sqlite3: 1417.65% (1.7001 => 25.8016, std.dev.: 0.0519) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.35% (50.1010 => 51.7770, std.dev.: 0.1097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.22% (1.0520 => 1.1280, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.78% (11.3920 => 12.3920, std.dev.: 0.0577) SingleSource/Benchmarks/Misc/oourafft: -73.19% (11.3407 => 3.0402, std.dev.: 0.0107) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0203, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0053) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0086) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0042) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0030) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/FloatMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.00% (0.1920 => 0.2400, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ffbench: 19.23% (0.1040 => 0.1240, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/mst/mst: 17.65% (0.1360 => 0.1600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 17.14% (0.1400 => 0.1640, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.41% (1.8281 => 2.1281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.93% (1.8081 => 2.0961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.69% (1.8361 => 2.1241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.27% (1.8601 => 2.1441, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.21% (1.9721 => 2.2721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.19% (2.0281 => 2.3361, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.17% (2.1361 => 2.4602, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.75% (1.9521 => 2.2401, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.1120 => 0.1280, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 14.29% (0.1400 => 0.1600, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.74% (1.8921 => 2.1521, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.26% (2.1121 => 2.3921, std.dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.90% (0.1240 => 0.1400, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.69% (2.1441 => 2.4162, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.61% (1.8081 => 2.0361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.21% (1.9001 => 2.1321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.60% (2.1041 => 2.3481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.35% (0.7400 => 0.8240, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.33% (1.8361 => 2.0441, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.09% (1.9481 => 2.1641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.14% (2.0521 => 2.2601, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/09-vor/vor: 9.57% (0.3760 => 0.4120, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.21% (0.3040 => 0.3320, std.dev.: 0.0095) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0096) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0234) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.24% (0.3400 => 0.3680, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.05% (0.3480 => 0.3760, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.78% (0.7080 => 0.7560, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.86% (6.4800 => 6.8600, std.dev.: 0.0586) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.9960 => 1.0520, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3600 => 0.3800, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.00% (0.2400 => 0.2520, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.81% (1.7480 => 1.8320, std.dev.: 0.0185) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0090) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (9.6042 => 10.0522, std.dev.: 0.0284) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (5.8281 => 6.0961, std.dev.: 0.0350) MultiSource/Applications/sgefa/sgefa: 4.55% (0.6160 => 0.6440, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.48% (1.6960 => 1.7720, std.dev.: 0.0193) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.2283 => 10.6604, std.dev.: 0.0302) MultiSource/Applications/Burg/burg: 4.19% (1.5280 => 1.5920, std.dev.: 0.0221) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (6.5320 => 6.7840, std.dev.: 0.0526) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 3.84% (4.7920 => 4.9760, std.dev.: 0.0332) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.81% (1.5760 => 1.6360, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (6.5360 => 6.7720, std.dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (5.3960 => 5.5800, std.dev.: 0.0443) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.15% (2.1600 => 2.2280, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (16.3003 => 16.7763, std.dev.: 0.0457) MultiSource/Applications/JM/lencod/lencod: 2.92% (22.2206 => 22.8687, std.dev.: 0.0492) MultiSource/Applications/oggenc/oggenc: 2.67% (7.0524 => 7.2405, std.dev.: 0.0193) MultiSource/Benchmarks/Bullet/bullet: 2.66% (38.6366 => 39.6646, std.dev.: 0.0724) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (4.2243 => 4.3323, std.dev.: 0.0075) MultiSource/Applications/SPASS/SPASS: 2.50% (18.5284 => 18.9925, std.dev.: 0.0529) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (3.0562 => 3.1202, std.dev.: 0.0146) MultiSource/Applications/d/make_dparser: 2.01% (3.9761 => 4.0561, std.dev.: 0.0253) MultiSource/Applications/siod/siod: 1.74% (2.7522 => 2.8002, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 1.55% (19.8291 => 20.1371, std.dev.: 0.0477) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.53% (2.1201 => 2.4282, std.dev.: 0.0344) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0159) MultiSource/Applications/minisat/minisat: 3.64% (6.5964 => 6.8364, std.dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.16% (4.8043 => 4.9563, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.79% (5.0243 => 5.1643, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 2.04% (0.9801 => 1.0001, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.88% (11.4967 => 11.7127, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.3801 => 1.4001, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.69% (10.4007 => 2.0081, std.dev.: 0.0133) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.20% (94.8339 => 49.1231, std.dev.: 10.4367) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.96% (49.9431 => 32.9821, std.dev.: 0.2140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.84% (25.7136 => 17.0131, std.dev.: 0.1334) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.54% (37.0863 => 28.3578, std.dev.: 0.3986) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1053) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0056) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.75% (4.1123 => 4.0403, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 06:59:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 08:59:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425135901.DFE6D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24958?compare_to=24954&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24958, Order: 207213, Start Time: 2014-04-25 09:24:50, End Time: 2014-04-25 14:05:38 To: 24954, Order: 207203, Start Time: 2014-04-25 07:54:41, End Time: 2014-04-25 12:34:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 5 (105 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1107 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.91% (0.6280 => 0.6400, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1560 => 0.1680, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.65% (2.4122 => 2.5002, std.dev.: 0.0293) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0049) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (1.1921 => 1.3241, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0509) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.67% (1.2601 => 1.3441, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0347) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0394) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (8.1441 => 8.4521, std.dev.: 0.0540) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0222) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0314) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (5.8000 => 5.9720, std.dev.: 0.0545) MultiSource/Applications/JM/lencod/lencod: 2.79% (17.6165 => 18.1085, std.dev.: 0.0541) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0513) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0444) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0371) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.05% (48.1088 => 49.0969, std.dev.: 0.0861) MultiSource/Benchmarks/Bullet/bullet: 1.98% (37.0925 => 37.8286, std.dev.: 0.0725) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0313) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0599) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0160) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0399) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1560 => 0.1680, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.5040 => 0.5360, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0133) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 2.99% (21.1533 => 21.7854, std.dev.: 0.1367) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0115) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4842 => 3.5322, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (0.1200 => 0.1040, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0068) MultiSource/Applications/aha/aha: -1.79% (2.6762 => 2.6282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 07:06:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 09:06:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425140646.BAF762A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24959?compare_to=24949&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24959, Order: 207213, Start Time: 2014-04-25 09:26:48, End Time: 2014-04-25 14:13:27 To: 24949, Order: 207174, Start Time: 2014-04-25 04:34:42, End Time: 2014-04-25 09:20:43 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1097 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/2010-12-08-tls: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/printargs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 19.05% (0.0840 => 0.1000, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: 11.54% (0.1040 => 0.1160, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.87% (0.1840 => 0.2040, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.53% (0.1520 => 0.1680, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.69% (0.2560 => 0.2680, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.52% (2.1081 => 2.1401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.50% (1.8681 => 1.8961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.42% (1.6961 => 1.7201, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.39% (1.7281 => 1.7521, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.19% (2.0161 => 2.0401, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -3.84% (5.2083 => 5.0083, std.dev.: 0.0223) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0121) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 07:40:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 09:40:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140425144036.BBDBC2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24960?compare_to=24950&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24960, Order: 207214, Start Time: 2014-04-25 09:58:21, End Time: 2014-04-25 14:47:18 To: 24950, Order: 207195, Start Time: 2014-04-25 05:04:09, End Time: 2014-04-25 09:52:29 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (127 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.33% (0.1200 => 0.1360, std.dev.: 0.0024) SingleSource/Regression/C/sumarraymalloc: 13.04% (0.0920 => 0.1040, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.73% (0.7760 => 0.8360, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 5.80% (0.2760 => 0.2920, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3240 => 0.3400, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 4.26% (0.5640 => 0.5880, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.24% (0.9881 => 1.0201, std.dev.: 0.0104) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0090) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/04-bisect/bisect: 31.43% (0.1400 => 0.1840, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.43% (0.0920 => 0.1200, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.39% (0.1640 => 0.2040, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.64% (1.6961 => 2.0801, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.40% (1.7321 => 2.1201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.82% (1.6681 => 2.0321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.78% (1.7081 => 2.0801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.75% (1.6921 => 2.0601, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.56% (1.6881 => 2.0521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (1.6761 => 2.0321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 21.23% (1.6961 => 2.0561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.20% (1.7921 => 2.1721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.16% (1.7201 => 2.0841, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.89% (1.8001 => 2.1761, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.88% (1.7241 => 2.0841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.69% (1.7401 => 2.1001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.57% (1.8081 => 2.1801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.55% (1.8881 => 2.2761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.36% (1.7481 => 2.1041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.18% (1.8041 => 2.1681, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.98% (1.9601 => 2.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.53% (1.9641 => 2.3281, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0113) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 17.24% (0.1160 => 0.1360, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.03% (0.6120 => 0.7040, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.30% (0.1720 => 0.1880, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.32% (0.3280 => 0.3520, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (6.7200 => 7.1680, std.dev.: 0.0409) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.7800 => 0.8320, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.51% (3.5002 => 3.7282, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/oourafft: 6.25% (0.3200 => 0.3400, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.07% (1.6481 => 1.7481, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (1.5240 => 1.6160, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (11.7880 => 12.4720, std.dev.: 0.0776) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 5.71% (1.8201 => 1.9241, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.42% (2.0680 => 2.1800, std.dev.: 0.0184) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0240) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.77% (9.9842 => 10.4602, std.dev.: 0.0472) MultiSource/Applications/lua/lua: 4.59% (4.7920 => 5.0120, std.dev.: 0.0279) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.52% (1.2400 => 1.2960, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.44% (0.7200 => 0.7520, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0101) MultiSource/Applications/Burg/burg: 4.36% (1.5600 => 1.6280, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0095) MultiSource/Applications/d/make_dparser: 4.14% (3.9641 => 4.1281, std.dev.: 0.0304) MultiSource/Applications/oggenc/oggenc: 3.99% (6.9124 => 7.1884, std.dev.: 0.0188) MultiSource/Applications/JM/ldecod/ldecod: 3.80% (10.3203 => 10.7124, std.dev.: 0.0365) MultiSource/Applications/SPASS/SPASS: 3.70% (18.4924 => 19.1766, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (6.8321 => 7.0641, std.dev.: 0.0294) MultiSource/Applications/JM/lencod/lencod: 3.29% (22.6287 => 23.3727, std.dev.: 0.0570) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 2.90% (2.7562 => 2.8362, std.dev.: 0.0135) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.82% (51.1089 => 52.5489, std.dev.: 0.0889) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 2.76% (19.7371 => 20.2811, std.dev.: 0.0453) MultiSource/Applications/ClamAV/clamscan: 2.69% (20.2445 => 20.7885, std.dev.: 0.0523) MultiSource/Benchmarks/Bullet/bullet: 2.53% (38.9366 => 39.9206, std.dev.: 0.0569) MultiSource/Benchmarks/MallocBench/gs/gs: 2.38% (5.5480 => 5.6800, std.dev.: 0.0507) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2203 => 4.3203, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.34% (16.5963 => 16.9843, std.dev.: 0.0857) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (2.2721 => 2.3201, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 2.06% (25.1895 => 25.7096, std.dev.: 0.0300) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0219) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 24.36% (7.3405 => 9.1286, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0137) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (4.4883 => 4.5563, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.83% (6.2884 => 0.8280, std.dev.: 0.0214) SingleSource/UnitTests/Vector/constpool: -81.59% (10.9087 => 2.0081, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: -22.63% (0.7600 => 0.5880, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.83% (7.4801 => 6.2960, std.dev.: 0.0271) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.09% (7.5041 => 6.3720, std.dev.: 0.0280) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: -2.45% (13.5243 => 13.1923, std.dev.: 0.0451) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -46.67% (0.0600 => 0.0320, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/18-imp/imp: -26.32% (0.0760 => 0.0560, std.dev.: 0.0069) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.31% (21.6534 => 17.9051, std.dev.: 0.0357) SingleSource/Benchmarks/Linpack/linpack-pc: -15.69% (7.8005 => 6.5764, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2560 => 0.2400, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (5.1603 => 5.0003, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.52% (4.6083 => 4.4923, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: -2.21% (8.3085 => 8.1245, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -1.85% (11.6527 => 11.4367, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -1.24% (2.9122 => 2.8762, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 08:02:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 10:02:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425150206.BC61E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24961?compare_to=24958&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24961, Order: 207217, Start Time: 2014-04-25 10:24:32, End Time: 2014-04-25 15:08:48 To: 24958, Order: 207213, Start Time: 2014-04-25 09:24:50, End Time: 2014-04-25 14:05:38 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (93 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (1000 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Quicksort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.2920 => 0.3080, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.92% (0.2440 => 0.2560, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.08% (0.5200 => 0.5360, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.09% (1.3401 => 1.3681, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.30% (0.9241 => 0.9361, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.28% (1.2521 => 1.2681, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (8.4521 => 8.5441, std.dev.: 0.0264) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.48% (3.9322 => 4.1083, std.dev.: 0.0625) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/family/family: -33.33% (0.0480 => 0.0320, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.26% (1.2521 => 1.3681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0500) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0264) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0248) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0387) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0481) MultiSource/Applications/JM/lencod/lencod: 3.07% (17.6165 => 18.1565, std.dev.: 0.0359) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0343) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0314) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0356) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1889, std.dev.: 0.0570) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 1.86% (37.0925 => 37.7806, std.dev.: 0.0885) MultiSource/Applications/sqlite3/sqlite3: 1.70% (23.7574 => 24.1615, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0155) MultiSource/Applications/treecc/treecc: 1.63% (2.4480 => 2.4880, std.dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: 1.60% (17.5484 => 17.8284, std.dev.: 0.0276) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0810, std.dev.: 0.0482) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 12.36% (2.8802 => 3.2362, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0268) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.74% (4.5203 => 4.6443, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 06:37:10 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 06:37:10 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425153340.696574FF40ED@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14799 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207198 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17833 of 17834) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17834) 1 warning(s) in tests. Testing Time: 365.93s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17684 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207198) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 08:50:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 10:50:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425155038.8FCEE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24962?compare_to=24961&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24962, Order: 207221, Start Time: 2014-04-25 11:15:31, End Time: 2014-04-25 15:57:20 To: 24961, Order: 207217, Start Time: 2014-04-25 10:24:32, End Time: 2014-04-25 15:08:48 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (111 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2007-03-02-VaCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Treesort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.65% (0.7400 => 0.8040, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.71% (1.4000 => 1.4520, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.15% (1.3001 => 1.3281, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.36% (1.4721 => 1.4921, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -5.19% (0.3080 => 0.2920, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.00% (0.6000 => 0.5880, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (1.1241 => 1.2721, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.04% (1.1961 => 1.3281, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0152) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.06% (1.3681 => 1.4921, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0160) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.36% (0.6520 => 0.7000, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0663) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0424) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (1.3760 => 1.4520, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0144) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (5.8000 => 6.0560, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0185) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0223) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0142) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0451) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0647) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0389) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0030) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.04% (48.1088 => 49.0889, std.dev.: 0.0587) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: 2.02% (37.0925 => 37.8405, std.dev.: 0.1060) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0474) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 1.36% (18.8170 => 19.0730, std.dev.: 0.0455) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0608) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.00% (0.1600 => 0.1760, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.01% (1.2561 => 1.3441, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 3.97% (0.5040 => 0.5240, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 2.95% (21.1533 => 21.7774, std.dev.: 0.1347) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0312) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0215) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0643 => 4.1163, std.dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.22% (1.2601 => 1.2321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0043) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 09:13:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 09:13:20 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425161349.906264FF4581@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14800 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207199 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17833 of 17834) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17834) 1 warning(s) in tests. Testing Time: 338.52s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17684 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207199) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 09:53:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 09:53:30 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425165353.F2A714FF4A31@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14801 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207202 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17833 of 17834) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17834) 1 warning(s) in tests. Testing Time: 330.31s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17684 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207202) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 09:57:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 11:57:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425165725.633782A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24963?compare_to=24962&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24963, Order: 207222, Start Time: 2014-04-25 12:22:52, End Time: 2014-04-25 17:04:06 To: 24962, Order: 207221, Start Time: 2014-04-25 11:15:31, End Time: 2014-04-25 15:57:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (105 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C/casts: 57.14% (0.0280 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.1080 => 0.1240, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1360 => 0.1480, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.64% (0.6040 => 0.6320, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 1.97% (1.6281 => 1.6601, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (5.0160 => 5.1120, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.27% (1.2601 => 1.2761, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 15.38% (0.2600 => 0.3000, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.30% (0.1720 => 0.1880, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -8.63% (1.3441 => 1.2281, std.dev.: 0.0360) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 29.17% (0.0960 => 0.1240, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0129) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.87% (0.1840 => 0.2040, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (6.0160 => 6.4520, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0692) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0455) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (4.9200 => 5.1120, std.dev.: 0.0361) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0314) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0466) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0172) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0557) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8726, std.dev.: 0.0755) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.97% (48.1088 => 49.0569, std.dev.: 0.1235) MultiSource/Applications/sqlite3/sqlite3: 1.92% (23.7574 => 24.2135, std.dev.: 0.0371) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0136) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0153) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0811, std.dev.: 0.0540) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0379) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 3.55% (25.8896 => 26.8097, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0643 => 4.1123, std.dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/bmm/bmm: -19.05% (0.0840 => 0.0680, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/d/make_dparser: -42.86% (0.0280 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -13.37% (7.7485 => 6.7124, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: -5.88% (0.4080 => 0.3840, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 10:42:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 12:42:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425174205.536D92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24964?compare_to=24955&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24964, Order: 207222, Start Time: 2014-04-25 13:05:31, End Time: 2014-04-25 17:48:49 To: 24955, Order: 207203, Start Time: 2014-04-25 08:19:19, End Time: 2014-04-25 13:01:47 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 10 (149 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/Threads/2010-12-08-tls: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.00% (0.1000 => 0.1200, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) MultiSource/Applications/aha/aha: 13.33% (0.1200 => 0.1360, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.41% (0.3400 => 0.3720, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.23% (0.6880 => 0.7240, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 8.04% (0.4480 => 0.4840, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.10% (0.3280 => 0.3480, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0101) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0112) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0108) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/UnitTests/Threads/2010-12-08-tls: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C/sumarray2d: 66.67% (0.0240 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/methcall: 57.14% (0.0280 => 0.0440, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.00% (0.0960 => 0.1200, std.dev.: 0.0063) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 16.77% (0.6200 => 0.7240, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.38% (0.1040 => 0.1200, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.19% (0.3640 => 0.4120, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.82% (0.3120 => 0.3520, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.77% (0.1880 => 0.2120, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.54% (1.4561 => 1.6241, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.02% (1.5601 => 1.7321, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.24% (1.5241 => 1.6801, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.17% (0.2360 => 0.2600, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.05% (1.5521 => 1.7081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.01% (1.4201 => 1.5481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0212) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0095) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.33% (0.2400 => 0.2600, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.08% (1.4361 => 1.5521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.95% (0.7040 => 0.7600, std.dev.: 0.0208) MultiSource/Applications/viterbi/viterbi: 7.84% (0.2040 => 0.2200, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.82% (1.4841 => 1.6001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0121) MultiSource/Applications/obsequi/Obsequi: 7.49% (1.8680 => 2.0080, std.dev.: 0.0297) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.4680 => 6.9280, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0137) MultiSource/Applications/Burg/burg: 6.90% (1.5080 => 1.6120, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.90% (1.7401 => 1.8601, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.63% (11.6440 => 12.4160, std.dev.: 0.0364) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (1.5600 => 1.6560, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.08% (0.7240 => 0.7680, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (9.4842 => 10.0202, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.8440 => 1.9480, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.53% (0.7960 => 0.8400, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (5.8121 => 6.1081, std.dev.: 0.0346) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 5.00% (5.3600 => 5.6280, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (10.0443 => 10.4763, std.dev.: 0.0367) MultiSource/Applications/JM/lencod/lencod: 4.19% (21.9606 => 22.8808, std.dev.: 0.0431) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0206) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (6.5080 => 6.7720, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (6.5440 => 6.8040, std.dev.: 0.0489) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0101) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.65% (50.0290 => 51.8570, std.dev.: 0.0862) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.44% (4.1843 => 4.3283, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 3.37% (38.4046 => 39.7006, std.dev.: 0.0693) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 3.15% (18.4404 => 19.0205, std.dev.: 0.0457) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (16.3483 => 16.7843, std.dev.: 0.0462) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5284, std.dev.: 0.0789) MultiSource/Applications/lua/lua: 2.51% (4.7880 => 4.9080, std.dev.: 0.0409) MultiSource/Applications/kimwitu++/kc: 2.42% (19.6891 => 20.1651, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (1.0201 => 1.0401, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (13.0563 => 13.2683, std.dev.: 0.0289) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0262) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.65% (2.1401 => 2.4322, std.dev.: 0.0498) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (3.9922 => 4.1003, std.dev.: 0.0197) MultiSource/Applications/minisat/minisat: 2.46% (6.6684 => 6.8324, std.dev.: 0.0409) MultiSource/Applications/sqlite3/sqlite3: 2.11% (3.9842 => 4.0683, std.dev.: 0.0189) MultiSource/Applications/hexxagon/hexxagon: 1.77% (11.5087 => 11.7127, std.dev.: 0.0160) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.87% (10.6247 => 2.0321, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.30% (91.8497 => 49.3231, std.dev.: 10.5039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.41% (26.0616 => 17.0931, std.dev.: 0.1245) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.27% (50.3031 => 33.0621, std.dev.: 0.1604) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.26% (42.1466 => 28.5498, std.dev.: 0.4404) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1142) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -12.28% (7.7845 => 6.8284, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0192) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.42% (4.1243 => 4.0243, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.79% (2.4602 => 2.4162, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.47% (5.1563 => 5.0803, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: -1.17% (26.6977 => 26.3856, std.dev.: 0.0312) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 10:49:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 12:49:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425174915.5EA302A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24965?compare_to=24963&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24965, Order: 207223, Start Time: 2014-04-25 13:16:25, End Time: 2014-04-25 17:55:56 To: 24963, Order: 207222, Start Time: 2014-04-25 12:22:52, End Time: 2014-04-25 17:04:06 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (94 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (1000 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/globalrefs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/pointer_method2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.72% (0.2880 => 0.3160, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.45% (0.3720 => 0.3960, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.52% (0.2520 => 0.2760, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/heapsort: 1.16% (3.4402 => 3.4802, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.77% (1.3681 => 1.4881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0807) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0210) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0230) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0507) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0192) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0175) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0489) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0490) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.0122 => 4.1003, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0047) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.12% (48.1088 => 49.1288, std.dev.: 0.0864) MultiSource/Benchmarks/Bullet/bullet: 1.94% (37.0925 => 37.8126, std.dev.: 0.0781) MultiSource/Applications/sqlite3/sqlite3: 1.84% (23.7574 => 24.1935, std.dev.: 0.0401) MultiSource/Applications/kimwitu++/kc: 1.23% (18.8170 => 19.0491, std.dev.: 0.0563) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (15.2282 => 15.3922, std.dev.: 0.0416) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 3.01% (21.1533 => 21.7894, std.dev.: 0.1271) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0401) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0107) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0090) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0405) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.92% (4.4683 => 4.2483, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.43% (3.9202 => 3.8642, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 11:09:54 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 11:09:54 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425181034.BCF544FF553E@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building compiler-rt. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14802 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207211 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.ModuleIsIn (17834 of 17835) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17835 of 17835) 1 warning(s) in tests. Testing Time: 351.13s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17685 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207211) ^ :1:28: note: possible intended match here clang version 3.5.0 (trunk 207211) ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 11:40:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 13:40:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140425184056.634472A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24966?compare_to=24956&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24966, Order: 207226, Start Time: 2014-04-25 14:05:01, End Time: 2014-04-25 18:47:38 To: 24956, Order: 207203, Start Time: 2014-04-25 09:18:28, End Time: 2014-04-25 14:01:12 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (154 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 25.81% (0.1240 => 0.1560, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.25% (0.1920 => 0.2040, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 3.29% (0.8520 => 0.8800, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.59% (0.4640 => 0.4760, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.82% (1.7560 => 1.7880, std.dev.: 0.0116) SingleSource/UnitTests/Vector/constpool: 1.20% (2.0041 => 2.0281, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0081) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0083) SingleSource/Regression/C/sumarray2d: 1022.22% (0.0360 => 0.4040, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0080) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0128) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 200.00% (0.2520 => 0.7560, std.dev.: 0.0142) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 88.46% (0.1040 => 0.1960, std.dev.: 0.0106) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0052) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 60.00% (0.0800 => 0.1280, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0193) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.00% (1.2001 => 1.4761, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.42% (1.1361 => 1.3681, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.69% (1.3001 => 1.5561, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 18.09% (8.5802 => 10.1323, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 15.09% (1.3521 => 1.5561, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 15.09% (19.5406 => 22.4887, std.dev.: 0.0587) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.39% (5.3360 => 6.1041, std.dev.: 0.0348) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.29% (0.0840 => 0.0960, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0058) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0219) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.87% (0.1840 => 0.2040, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (11.3843 => 12.4043, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.82% (0.1360 => 0.1480, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.6680 => 6.1480, std.dev.: 0.0366) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 8.15% (6.2844 => 6.7964, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.97% (11.4440 => 12.3560, std.dev.: 0.0532) SingleSource/UnitTests/Vectorizer/gcc-loops: 7.91% (0.5560 => 0.6000, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.75% (5.7280 => 6.1720, std.dev.: 0.0331) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.72% (9.5802 => 10.2242, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (1.4760 => 1.5600, std.dev.: 0.0171) MultiSource/Applications/minisat/minisat: 5.26% (0.8360 => 0.8800, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.22% (1.2320 => 1.2840, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.13% (0.8721 => 0.9081, std.dev.: 0.0081) MultiSource/Applications/lua/lua: 4.02% (4.7720 => 4.9640, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.4120 => 0.4280, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (6.8280 => 7.0920, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0116) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.12% (49.1529 => 50.6849, std.dev.: 0.0823) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 3.05% (5.3840 => 5.5480, std.dev.: 0.0445) MultiSource/Applications/ClamAV/clamscan: 2.60% (19.2243 => 19.7244, std.dev.: 0.0466) MultiSource/Applications/sqlite3/sqlite3: 2.41% (24.7575 => 25.3535, std.dev.: 0.0353) MultiSource/Benchmarks/Bullet/bullet: 1.81% (39.0726 => 39.7806, std.dev.: 0.0572) MultiSource/Applications/kimwitu++/kc: 1.80% (19.7491 => 20.1051, std.dev.: 0.0521) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.7282 => 2.7642, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.44% (6.6644 => 17.1571, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.48% (1.2401 => 1.4321, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0297) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0092) MultiSource/Applications/minisat/minisat: 3.93% (6.8204 => 7.0884, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/hash: 3.85% (0.5200 => 0.5400, std.dev.: 0.0072) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.3085 => 7.4805, std.dev.: 0.0226) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (25.4536 => 25.8656, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4041 => 1.4241, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.11% (3.2362 => 3.2722, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0200 => 0.0000, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -81.60% (11.0207 => 2.0281, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.70% (21.6534 => 17.8211, std.dev.: 0.0688) SingleSource/Benchmarks/Linpack/linpack-pc: -16.03% (7.8605 => 6.6004, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -8.52% (3.4722 => 3.1762, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0898) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.15% (2.9242 => 2.8322, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: -1.88% (5.0963 => 5.0003, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.5602 => 3.5122, std.dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0145) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 11:43:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 13:43:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425184359.D477C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24967?compare_to=24965&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24967, Order: 207226, Start Time: 2014-04-25 14:09:31, End Time: 2014-04-25 18:50:43 To: 24965, Order: 207223, Start Time: 2014-04-25 13:16:25, End Time: 2014-04-25 17:55:56 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (98 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.00% (0.1000 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 10.00% (0.2400 => 0.2640, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.70% (0.4320 => 0.4480, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.51% (0.4560 => 0.4720, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 2.46% (0.4880 => 0.5000, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.23% (1.4360 => 1.4680, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0588) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0503) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (5.8000 => 6.0560, std.dev.: 0.0340) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0193) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0223) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (8.1441 => 8.4481, std.dev.: 0.0684) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0218) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0291) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0508) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.75% (0.4360 => 0.4480, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0372) MultiSource/Applications/JM/lencod/lencod: 2.59% (17.6165 => 18.0725, std.dev.: 0.0483) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0244) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8205, std.dev.: 0.0734) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0105) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.75% (48.1088 => 48.9490, std.dev.: 0.0817) MultiSource/Applications/sqlite3/sqlite3: 1.48% (23.7574 => 24.1095, std.dev.: 0.0512) MultiSource/Applications/kimwitu++/kc: 1.23% (18.8170 => 19.0491, std.dev.: 0.0388) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (25.8896 => 26.7817, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 3.10% (21.1533 => 21.8094, std.dev.: 0.1292) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0104) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.86% (4.5043 => 4.5883, std.dev.: 0.0304) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.44% (6.6564 => 6.7524, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0118) MultiSource/Benchmarks/sim/sim: 1.20% (4.6843 => 4.7403, std.dev.: 0.0163) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: -14.29% (0.0840 => 0.0720, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0068) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 11:44:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 13:44:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140425184445.83D0E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24968?compare_to=24957&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24968, Order: 207226, Start Time: 2014-04-25 14:06:05, End Time: 2014-04-25 18:51:29 To: 24957, Order: 207203, Start Time: 2014-04-25 09:16:23, End Time: 2014-04-25 14:02:14 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 4 (142 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1108 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 30.43% (0.0920 => 0.1200, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.28% (0.9561 => 1.0161, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.93% (17.6723 => 19.6043, std.dev.: 0.0547) MultiSource/Applications/sqlite3/sqlite3: 1415.77% (1.7001 => 25.7696, std.dev.: 0.0410) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.15% (50.1010 => 51.6770, std.dev.: 0.0951) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 0.38% (1.0520 => 1.0560, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.29% (11.3920 => 12.3360, std.dev.: 0.0609) SingleSource/Benchmarks/Misc/oourafft: -73.37% (11.3407 => 3.0202, std.dev.: 0.0163) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0003, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0445) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0096) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0121) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0049) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0044) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 18.75% (0.0640 => 0.0760, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.97% (1.8281 => 2.1201, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.38% (0.4160 => 0.4800, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.16% (1.8361 => 2.0961, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.16% (1.8081 => 2.0641, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.86% (2.1361 => 2.4322, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.79% (1.8561 => 2.1121, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.53% (1.8921 => 2.1481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.07% (2.1121 => 2.3881, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.02% (1.8361 => 2.0201, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0141) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.47% (0.2360 => 0.2560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.99% (1.0880 => 1.1640, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.68% (6.4800 => 6.8480, std.dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: 5.50% (1.5280 => 1.6120, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0091) MultiSource/Applications/spiff/spiff: 5.12% (1.0160 => 1.0680, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.6960 => 1.7760, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 4.48% (1.7841 => 1.8641, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (6.5320 => 6.8200, std.dev.: 0.0422) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.29% (1.2120 => 1.2640, std.dev.: 0.0196) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0125) MultiSource/Applications/minisat/minisat: 4.25% (0.8480 => 0.8840, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 3.83% (10.2283 => 10.6204, std.dev.: 0.0333) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0330) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.67% (9.6042 => 9.9562, std.dev.: 0.0662) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0090) MultiSource/Applications/treecc/treecc: 3.55% (2.5880 => 2.6800, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (5.8281 => 6.0281, std.dev.: 0.0488) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.7480 => 1.8040, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (16.3003 => 16.7523, std.dev.: 0.0512) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.3960 => 5.5440, std.dev.: 0.0446) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.69% (6.5360 => 6.7120, std.dev.: 0.0471) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.2206 => 22.8087, std.dev.: 0.0510) MultiSource/Applications/SPASS/SPASS: 2.63% (18.5284 => 19.0164, std.dev.: 0.0402) MultiSource/Benchmarks/Bullet/bullet: 2.63% (38.6366 => 39.6526, std.dev.: 0.0904) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (4.2243 => 4.3323, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0198) MultiSource/Applications/oggenc/oggenc: 2.21% (7.0524 => 7.2085, std.dev.: 0.0264) MultiSource/Applications/siod/siod: 1.74% (2.7522 => 2.8002, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 1.49% (19.8291 => 20.1251, std.dev.: 0.0467) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.42% (2.1201 => 2.4682, std.dev.: 0.0399) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 3.64% (6.5964 => 6.8364, std.dev.: 0.0270) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.16% (4.8043 => 4.9563, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0243 => 5.1683, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.4967 => 11.7047, std.dev.: 0.0223) SingleSource/Benchmarks/Dhrystone/dry: 1.76% (0.6800 => 0.6920, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.69% (10.4007 => 2.0081, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.88% (2.9562 => 0.9200, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.20% (94.8339 => 49.1231, std.dev.: 9.6730) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.03% (49.9431 => 32.9461, std.dev.: 0.2192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.98% (25.7136 => 16.9771, std.dev.: 0.1328) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.49% (37.0863 => 28.3738, std.dev.: 0.3454) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1127) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.82% (7.8165 => 6.7364, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -10.92% (2.7482 => 2.4482, std.dev.: 0.0740) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -3.49% (2.7522 => 2.6562, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.88% (2.7722 => 2.7202, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 11:56:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 13:56:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425185631.A9B862A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24969?compare_to=24959&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24969, Order: 207226, Start Time: 2014-04-25 14:17:14, End Time: 2014-04-25 19:03:14 To: 24959, Order: 207213, Start Time: 2014-04-25 09:26:48, End Time: 2014-04-25 14:13:27 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1104 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.20% (0.1640 => 0.1840, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 16.73% (0.9561 => 1.1161, std.dev.: 0.0478) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.98% (0.6680 => 0.7480, std.dev.: 0.0172) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -14.29% (0.1680 => 0.1440, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.19% (0.7640 => 0.7320, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0119) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 12:31:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 14:31:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140425193158.C61B02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24970?compare_to=24960&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24970, Order: 207226, Start Time: 2014-04-25 14:50:46, End Time: 2014-04-25 19:38:41 To: 24960, Order: 207214, Start Time: 2014-04-25 09:58:21, End Time: 2014-04-25 14:47:18 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (128 on baseline) Performance Improvements: 6 (38 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 14.71% (0.1360 => 0.1560, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 10.81% (0.1480 => 0.1640, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 5.63% (0.2840 => 0.3000, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.45% (0.2200 => 0.2320, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 28.57% (0.0560 => 0.0720, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.53% (4.6443 => 4.8083, std.dev.: 0.0485) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/pointer_member: -100.00% (0.0200 => 0.0000, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.58% (2.2761 => 2.2401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.51% (2.1201 => 2.0881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.34% (2.0841 => 2.0561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.18% (2.0361 => 2.0121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.16% (2.0601 => 2.0361, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0116) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.00% (1.7401 => 2.0881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.81% (1.6761 => 2.0081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.62% (1.6721 => 2.0001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.55% (1.8001 => 2.1521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.30% (1.7201 => 2.0521, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.07% (1.7201 => 2.0481, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.64% (1.8881 => 2.2401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.97% (1.9801 => 2.3161, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.77% (1.9081 => 2.2281, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.69% (0.6120 => 0.7080, std.dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.30% (0.1720 => 0.1880, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.20% (0.3480 => 0.3800, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.21% (0.7800 => 0.8440, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.67% (0.4800 => 0.5120, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.51% (3.5002 => 3.7282, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (11.7880 => 12.5040, std.dev.: 0.0546) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (6.7200 => 7.1240, std.dev.: 0.0601) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.84% (1.2400 => 1.3000, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0059) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0246) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 4.26% (4.7920 => 4.9960, std.dev.: 0.0488) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (9.9842 => 10.3962, std.dev.: 0.0692) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (2.0680 => 2.1520, std.dev.: 0.0259) MultiSource/Applications/d/make_dparser: 4.04% (3.9641 => 4.1241, std.dev.: 0.0300) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.1440 => 1.1880, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (6.8321 => 7.0761, std.dev.: 0.0390) MultiSource/Applications/oggenc/oggenc: 3.47% (6.9124 => 7.1524, std.dev.: 0.0211) MultiSource/Applications/treecc/treecc: 3.36% (2.6200 => 2.7080, std.dev.: 0.0189) MultiSource/Applications/JM/ldecod/ldecod: 3.18% (10.3203 => 10.6484, std.dev.: 0.0364) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0182) MultiSource/Applications/SIBsim4/SIBsim4: 3.10% (1.6801 => 1.7321, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0083) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 2.69% (22.6287 => 23.2368, std.dev.: 0.0652) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (3.0122 => 3.0882, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 2.49% (19.7371 => 20.2291, std.dev.: 0.0389) MultiSource/Benchmarks/Bullet/bullet: 2.39% (38.9366 => 39.8686, std.dev.: 0.0739) MultiSource/Applications/SPASS/SPASS: 2.38% (18.4924 => 18.9325, std.dev.: 0.0985) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (2.2721 => 2.3241, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0104) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.27% (51.1089 => 52.2689, std.dev.: 0.1852) MultiSource/Applications/ClamAV/clamscan: 2.07% (20.2445 => 20.6645, std.dev.: 0.0519) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0165) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 1.52% (25.1895 => 25.5736, std.dev.: 0.0397) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (16.5963 => 16.8443, std.dev.: 0.0586) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0244 => 6.1044, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 19.39% (0.9281 => 1.1081, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (1.2681 => 1.4281, std.dev.: 0.0418) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1761 => 2.2521, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (4.4883 => 4.5563, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/pointer_member: -100.00% (0.0160 => 0.0000, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0127) SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.43% (3.1762 => 1.3521, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0082) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.63% (7.4801 => 6.2360, std.dev.: 0.0526) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.19% (7.5041 => 6.3640, std.dev.: 0.0221) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (13.5243 => 13.1243, std.dev.: 0.0491) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.75% (21.6534 => 17.8091, std.dev.: 0.0908) SingleSource/Benchmarks/Linpack/linpack-pc: -15.69% (7.8005 => 6.5764, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.01% (2.6642 => 2.4242, std.dev.: 0.0918) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (5.1603 => 5.0043, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: -2.26% (2.1281 => 2.0801, std.dev.: 0.0184) MultiSource/Applications/JM/lencod/lencod: -2.21% (8.3085 => 8.1245, std.dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: -1.75% (11.6527 => 11.4487, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.17% (1.3681 => 1.3521, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 14:21:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 16:21:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425212116.E0BD52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24971?compare_to=24967&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24971, Order: 207233, Start Time: 2014-04-25 16:46:09, End Time: 2014-04-25 21:27:58 To: 24967, Order: 207226, Start Time: 2014-04-25 14:09:31, End Time: 2014-04-25 18:50:43 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (101 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 44.44% (0.0720 => 0.1040, std.dev.: 0.0081) SingleSource/Regression/C++/EH/ctor_dtor_count: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: 28.57% (0.0560 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.4120 => 0.4400, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: 6.49% (0.3080 => 0.3280, std.dev.: 0.0037) MultiSource/Applications/obsequi/Obsequi: 3.53% (1.2480 => 1.2920, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.37% (0.3560 => 0.3680, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.60% (1.2481 => 1.2681, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.47% (8.4481 => 8.5721, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.37% (1.4641 => 1.4841, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 55.56% (0.0360 => 0.0560, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 27.03% (0.1480 => 0.1880, std.dev.: 0.0067) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.15% (1.2201 => 1.3561, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.84% (1.1441 => 1.2681, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0400) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0471) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.4120 => 0.4400, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9200 => 0.9720, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.26% (8.1441 => 8.5721, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (5.8000 => 6.0640, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0199) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (10.4082 => 10.8122, std.dev.: 0.0319) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0496) MultiSource/Applications/JM/lencod/lencod: 3.09% (17.6165 => 18.1605, std.dev.: 0.0420) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (5.8400 => 5.9960, std.dev.: 0.0539) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0116) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.02% (48.1088 => 49.0809, std.dev.: 0.0916) MultiSource/Benchmarks/Bullet/bullet: 1.88% (37.0925 => 37.7886, std.dev.: 0.0637) MultiSource/Applications/sqlite3/sqlite3: 1.79% (23.7574 => 24.1815, std.dev.: 0.0591) MultiSource/Applications/treecc/treecc: 1.63% (2.4480 => 2.4880, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0156) MultiSource/Applications/kimwitu++/kc: 1.38% (18.8170 => 19.0771, std.dev.: 0.0351) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0408) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0031) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0507) MultiSource/Applications/lua/lua: 2.78% (21.1533 => 21.7414, std.dev.: 0.0639) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.28% (4.0643 => 4.1163, std.dev.: 0.0185) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0389) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 14:40:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 16:40:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425214049.075F62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24972?compare_to=24971&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24972, Order: 207234, Start Time: 2014-04-25 17:03:45, End Time: 2014-04-25 21:47:30 To: 24971, Order: 207233, Start Time: 2014-04-25 16:46:09, End Time: 2014-04-25 21:27:58 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (104 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1840 => 0.2120, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.43% (0.2680 => 0.3040, std.dev.: 0.0080) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.57% (0.1400 => 0.1520, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.52% (0.3680 => 0.3920, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 15.73% (1.1441 => 1.3241, std.dev.: 0.0363) MultiSource/Applications/obsequi/Obsequi: 2.50% (2.0761 => 2.1281, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.37% (1.6881 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.94% (3.5002 => 3.5682, std.dev.: 0.0209) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0058) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1840 => 0.2120, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.84% (1.1441 => 1.2681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0589) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0554) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (5.8000 => 6.0840, std.dev.: 0.0258) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0400) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0394) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0442) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0144) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0443) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.17% (48.1088 => 49.1530, std.dev.: 0.0844) MultiSource/Applications/sqlite3/sqlite3: 2.07% (23.7574 => 24.2495, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0158) MultiSource/Benchmarks/Bullet/bullet: 1.57% (37.0925 => 37.6766, std.dev.: 0.0787) MultiSource/Applications/kimwitu++/kc: 1.55% (18.8170 => 19.1090, std.dev.: 0.0383) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0562) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (15.2282 => 15.3842, std.dev.: 0.0400) MultiSource/Applications/ClamAV/clamscan: 1.01% (17.4082 => 17.5842, std.dev.: 0.0475) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.49% (25.8896 => 26.7937, std.dev.: 0.0180) MultiSource/Applications/lua/lua: 2.93% (21.1533 => 21.7734, std.dev.: 0.1322) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0116) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0340) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.4080 => 0.3720, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: -1.51% (2.3841 => 2.3481, std.dev.: 0.0134) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 14:58:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 16:58:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425215842.B2A4E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24973?compare_to=24972&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24973, Order: 207237, Start Time: 2014-04-25 17:23:38, End Time: 2014-04-25 22:05:22 To: 24972, Order: 207234, Start Time: 2014-04-25 17:03:45, End Time: 2014-04-25 21:47:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (107 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2002-05-02-CastTest2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.91% (0.2200 => 0.2440, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3080 => 0.3320, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.10% (0.5160 => 0.5320, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.33% (0.9001 => 0.9121, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 27.27% (0.0440 => 0.0560, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0072) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/sumarray2d: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (6.0160 => 6.4480, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (10.6960 => 11.3560, std.dev.: 0.0655) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0163) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0291) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0424) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (5.8000 => 6.0520, std.dev.: 0.0432) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0354) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (5.8400 => 6.0560, std.dev.: 0.0370) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0110) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0581) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0453) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.4400 => 1.4720, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 2.07% (37.0925 => 37.8605, std.dev.: 0.0901) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0205) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.00% (48.1088 => 49.0689, std.dev.: 0.1147) MultiSource/Applications/sqlite3/sqlite3: 1.89% (23.7574 => 24.2055, std.dev.: 0.0496) MultiSource/Applications/kimwitu++/kc: 1.79% (18.8170 => 19.1531, std.dev.: 0.0545) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0170) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0556) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.13% (0.2480 => 0.2880, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0557) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.26% (0.7360 => 0.7600, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 2.82% (21.1533 => 21.7494, std.dev.: 0.0906) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.0643 => 4.1203, std.dev.: 0.0162) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0076) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 15:29:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 15:29:46 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140425223022.CFA394FF782A@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14803 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207217 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17834 of 17835) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17835 of 17835) 1 warning(s) in tests. Testing Time: 404.55s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17685 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207217) ^ :1:28: note: possible intended match here clang version 3.5.0 (trunk 207217) ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 15:37:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 17:37:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425223740.D80FE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24974?compare_to=24964&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24974, Order: 207245, Start Time: 2014-04-25 18:01:38, End Time: 2014-04-25 22:44:21 To: 24964, Order: 207222, Start Time: 2014-04-25 13:05:31, End Time: 2014-04-25 17:48:49 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 8 (147 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2008-01-07-LongDouble: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 4.42% (0.7240 => 0.7560, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 27.50% (0.1600 => 0.2040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.67% (0.3600 => 0.3840, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.40% (11.3687 => 3.0242, std.dev.: 0.0143) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0122) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0072) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 20.00% (0.1200 => 0.1440, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 14.55% (0.6600 => 0.7560, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0069) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.16% (0.1520 => 0.1720, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0244) MultiSource/Benchmarks/McCat/08-main/main: 11.90% (0.3360 => 0.3760, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.2360 => 0.2640, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0100) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.79% (1.8161 => 2.0121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.51% (1.5601 => 1.7241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.51% (1.4841 => 1.6401, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.00% (0.1200 => 0.1320, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0100) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0271) MultiSource/Applications/obsequi/Obsequi: 7.49% (1.8680 => 2.0080, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (1.5401 => 1.6481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0095) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (11.6440 => 12.3640, std.dev.: 0.0740) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (6.4680 => 6.8480, std.dev.: 0.0436) MultiSource/Applications/Burg/burg: 5.57% (1.5080 => 1.5920, std.dev.: 0.0215) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (9.4842 => 9.9922, std.dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.95% (0.8881 => 0.9321, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.31% (2.0440 => 2.1320, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (0.3720 => 0.3880, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.22% (6.5440 => 6.8200, std.dev.: 0.0363) MultiSource/Applications/JM/ldecod/ldecod: 4.18% (10.0443 => 10.4643, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 3.93% (4.7880 => 4.9760, std.dev.: 0.0380) MultiSource/Applications/JM/lencod/lencod: 3.92% (21.9606 => 22.8208, std.dev.: 0.0488) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (6.5080 => 6.7440, std.dev.: 0.0315) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (5.3600 => 5.5480, std.dev.: 0.0695) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.40% (50.0290 => 51.7290, std.dev.: 0.0897) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.35% (4.1843 => 4.3243, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 3.30% (18.4404 => 19.0486, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 3.15% (6.9844 => 7.2044, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 2.97% (38.4046 => 39.5446, std.dev.: 0.0786) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5284, std.dev.: 0.0404) MultiSource/Applications/kimwitu++/kc: 2.36% (19.6891 => 20.1531, std.dev.: 0.0789) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (16.3483 => 16.6723, std.dev.: 0.0574) MultiSource/Applications/d/make_dparser: 1.92% (3.9681 => 4.0441, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.57% (1.0201 => 1.0361, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0303) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.27% (2.1401 => 2.4882, std.dev.: 0.0335) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.51% (0.1880 => 0.2040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.67% (0.3600 => 0.3840, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.71% (0.3400 => 0.3560, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0267) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (3.9922 => 4.0883, std.dev.: 0.0322) MultiSource/Applications/minisat/minisat: 2.10% (6.6684 => 6.8084, std.dev.: 0.0303) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.81% (3.9842 => 4.0563, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 1.39% (11.5087 => 11.6687, std.dev.: 0.0233) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.14% (10.6247 => 2.0041, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.43% (91.8497 => 49.2071, std.dev.: 10.5893) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.40% (26.0616 => 17.0971, std.dev.: 0.1864) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.27% (50.3031 => 33.0661, std.dev.: 0.1449) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.31% (42.1466 => 28.5298, std.dev.: 0.3616) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1096) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.37% (1.2481 => 1.1561, std.dev.: 0.0157) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.42% (4.1243 => 4.0243, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0121) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.70% (2.8202 => 2.7722, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0129) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.47% (5.1563 => 5.0803, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.30% (26.6977 => 26.3496, std.dev.: 0.0501) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 15:40:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 17:40:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425224031.59B0C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24975?compare_to=24973&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24975, Order: 207245, Start Time: 2014-04-25 18:08:22, End Time: 2014-04-25 22:47:14 To: 24973, Order: 207237, Start Time: 2014-04-25 17:23:38, End Time: 2014-04-25 22:05:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (93 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (1001 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.54% (0.1040 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.26% (1.2681 => 1.2841, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.98% (6.0560 => 5.9360, std.dev.: 0.0460) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.69% (10.6960 => 11.4120, std.dev.: 0.0530) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0224) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0354) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0369) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.74% (0.8561 => 0.8881, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0340) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (10.4082 => 10.7282, std.dev.: 0.0404) MultiSource/Applications/JM/lencod/lencod: 2.34% (17.6165 => 18.0285, std.dev.: 0.0410) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (4.9000 => 4.9920, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0110) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.70% (48.1088 => 48.9249, std.dev.: 0.1028) MultiSource/Benchmarks/Bullet/bullet: 1.68% (37.0925 => 37.7166, std.dev.: 0.0739) MultiSource/Applications/sqlite3/sqlite3: 1.60% (23.7574 => 24.1375, std.dev.: 0.0398) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0314) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0393) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.76% (1.0881 => 1.2161, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0195) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (25.8896 => 26.7977, std.dev.: 0.0390) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 2.82% (21.1533 => 21.7494, std.dev.: 0.0738) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0643 => 4.1123, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/health/health: -9.80% (0.4080 => 0.3680, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.35% (2.0681 => 2.0401, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 16:35:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 18:35:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140425233552.00D352A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24976?compare_to=24966&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24976, Order: 207254, Start Time: 2014-04-25 18:59:41, End Time: 2014-04-25 23:42:31 To: 24966, Order: 207226, Start Time: 2014-04-25 14:05:01, End Time: 2014-04-25 18:47:38 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (156 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.69% (0.1560 => 0.1680, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0045) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.34% (1.3680 => 1.4000, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 1.44% (5.5480 => 5.6280, std.dev.: 0.0218) MultiSource/Applications/siod/siod: 1.30% (2.7722 => 2.8082, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.69% (0.1160 => 0.1400, std.dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2350.00% (0.0320 => 0.7840, std.dev.: 0.0107) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0070) SingleSource/Regression/C/sumarray2d: 977.78% (0.0360 => 0.3880, std.dev.: 0.0101) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0066) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 200.00% (0.2520 => 0.7560, std.dev.: 0.0165) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 65.00% (0.0800 => 0.1320, std.dev.: 0.0078) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.00% (0.7040 => 1.0560, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0048) MultiSource/Applications/obsequi/Obsequi: 41.09% (1.3920 => 1.9640, std.dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 26.65% (1.2160 => 1.5401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.00% (1.2001 => 1.4521, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.42% (1.1361 => 1.3681, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0123) MultiSource/Applications/JM/ldecod/ldecod: 18.32% (8.5802 => 10.1523, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.83% (1.3681 => 1.6121, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.65% (0.1360 => 0.1600, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.67% (1.2001 => 1.4001, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/bh/bh: 15.96% (0.3760 => 0.4360, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 14.72% (19.5406 => 22.4167, std.dev.: 0.0802) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.42% (5.3360 => 6.0521, std.dev.: 0.0513) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.10% (1.7400 => 1.9680, std.dev.: 0.0244) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0083) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 10.00% (0.2800 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 9.52% (11.3843 => 12.4683, std.dev.: 0.0232) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.21% (11.4440 => 12.3840, std.dev.: 0.0530) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.12% (5.6680 => 6.1280, std.dev.: 0.0556) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.75% (5.7280 => 6.1720, std.dev.: 0.0504) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.41% (0.6480 => 0.6960, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.43% (9.5802 => 10.1962, std.dev.: 0.0414) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.74% (1.3240 => 1.4000, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (5.3840 => 5.6280, std.dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.16% (6.8280 => 7.1120, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0124) MultiSource/Applications/lua/lua: 4.02% (4.7720 => 4.9640, std.dev.: 0.0389) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3040 => 0.3160, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0145) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.34% (49.1529 => 50.7929, std.dev.: 0.0948) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (1.2320 => 1.2720, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.4320 => 1.4760, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: 2.68% (19.2243 => 19.7404, std.dev.: 0.0561) MultiSource/Applications/sqlite3/sqlite3: 2.52% (24.7575 => 25.3815, std.dev.: 0.0370) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0117) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: 1.76% (2.7282 => 2.7762, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 1.70% (19.7491 => 20.0851, std.dev.: 0.0535) MultiSource/Benchmarks/Bullet/bullet: 1.41% (39.0726 => 39.6246, std.dev.: 0.0766) MultiSource/Applications/SPASS/SPASS: 1.08% (18.7966 => 19.0005, std.dev.: 0.0361) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (3.9842 => 4.2923, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0170) MultiSource/Applications/minisat/minisat: 3.99% (6.8204 => 7.0924, std.dev.: 0.0443) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.03% (5.0203 => 5.1723, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.55% (1.1001 => 1.1281, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (25.4536 => 25.8976, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4041 => 1.4241, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/2002-10-13-BadLoad: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.42% (21.6534 => 17.8811, std.dev.: 0.0366) SingleSource/Benchmarks/Linpack/linpack-pc: -15.98% (7.8605 => 6.6044, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -9.10% (3.4722 => 3.1562, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.60% (5.2763 => 4.9283, std.dev.: 0.0997) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.05% (4.5123 => 4.2843, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9242 => 2.8362, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -2.20% (5.0963 => 4.9843, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.5602 => 3.5202, std.dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0187) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 16:37:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 18:37:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140425233749.60A0D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24977?compare_to=24975&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24977, Order: 207256, Start Time: 2014-04-25 19:03:27, End Time: 2014-04-25 23:44:30 To: 24975, Order: 207245, Start Time: 2014-04-25 18:08:22, End Time: 2014-04-25 22:47:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (101 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-20-FoldBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/pointer_method2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 7.59% (0.3160 => 0.3400, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 5.77% (0.4160 => 0.4400, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 2.84% (1.1280 => 1.1600, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (5.9360 => 6.0520, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.55% (1.2921 => 1.3121, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 2.15% (1.3041 => 1.3321, std.dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0038) SingleSource/UnitTests/2003-08-20-FoldBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.81% (0.1240 => 0.1560, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0599) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0457) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (4.9200 => 5.1320, std.dev.: 0.0266) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0595) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0439) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0210) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0498) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (5.8400 => 6.0520, std.dev.: 0.0229) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0232) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0123) MultiSource/Applications/obsequi/Obsequi: 3.16% (1.2640 => 1.3040, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0354) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 3.01% (1.4600 => 1.5040, std.dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0526) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.27% (48.1088 => 49.2010, std.dev.: 0.0761) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8726, std.dev.: 0.0599) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0336) MultiSource/Applications/kimwitu++/kc: 1.96% (18.8170 => 19.1851, std.dev.: 0.0458) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 1.52% (23.7574 => 24.1175, std.dev.: 0.0445) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: 1.39% (17.5484 => 17.7924, std.dev.: 0.0516) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0144) MultiSource/Applications/lua/lua: 3.12% (21.1533 => 21.8134, std.dev.: 0.1442) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (4.5203 => 4.6323, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 1.92% (6.6564 => 6.7844, std.dev.: 0.0344) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 16:42:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 18:42:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140425234220.6D71B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24978?compare_to=24968&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24978, Order: 207256, Start Time: 2014-04-25 19:03:40, End Time: 2014-04-25 23:49:03 To: 24968, Order: 207226, Start Time: 2014-04-25 14:06:05, End Time: 2014-04-25 18:51:29 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 4 (138 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1107 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 1.09% (4.0321 => 4.0761, std.dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 21.95% (0.1640 => 0.2000, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bisort/bisort: 1.61% (0.7440 => 0.7560, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.51% (2.3881 => 2.3521, std.dev.: 0.0127) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.20% (17.6723 => 19.6523, std.dev.: 0.0286) MultiSource/Applications/sqlite3/sqlite3: 1414.12% (1.7001 => 25.7416, std.dev.: 0.0500) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.33% (50.1010 => 51.7690, std.dev.: 0.0828) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.08% (1.0520 => 1.1160, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.43% (11.3920 => 12.3520, std.dev.: 0.0621) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0148) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0203, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0170) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0094) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0049) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C/sumarray2d: 100.00% (0.0200 => 0.0400, std.dev.: 0.0035) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/ary3: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.67% (0.1440 => 0.1680, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.60% (1.8081 => 2.0721, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.44% (1.8281 => 2.0921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.29% (0.1120 => 0.1280, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.74% (1.8921 => 2.1521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.72% (1.8361 => 2.0881, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.59% (1.9721 => 2.2401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.22% (1.8761 => 2.1241, std.dev.: 0.0169) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.70% (1.9521 => 2.2001, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.13% (1.9121 => 2.1441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.36% (2.1121 => 2.3521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.06% (1.7721 => 1.9681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.93% (1.9761 => 2.1921, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.64% (2.0681 => 2.2881, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.41% (1.8441 => 2.0361, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.27% (2.1041 => 2.3201, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.8361 => 2.0161, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.80% (1.7961 => 1.9721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.68% (1.9001 => 2.0841, std.dev.: 0.0148) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.57% (1.8801 => 2.0601, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/em3d/em3d: 9.43% (0.2120 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.21% (0.3040 => 0.3320, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0128) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.17% (1.9201 => 2.0961, std.dev.: 0.0177) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.69% (0.7280 => 0.7840, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.2240 => 0.2400, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0239) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.67% (0.1800 => 0.1920, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (6.4800 => 6.8840, std.dev.: 0.0289) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.1320 => 1.1880, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0195) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (9.6042 => 10.0322, std.dev.: 0.0376) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (6.5320 => 6.8200, std.dev.: 0.0423) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (5.8281 => 6.0681, std.dev.: 0.0419) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (10.2283 => 10.6164, std.dev.: 0.0468) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.7480 => 1.8120, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/gs/gs: 3.63% (5.3960 => 5.5920, std.dev.: 0.0400) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (16.3003 => 16.7763, std.dev.: 0.0275) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1600 => 2.2200, std.dev.: 0.0200) MultiSource/Applications/SPASS/SPASS: 2.68% (18.5284 => 19.0244, std.dev.: 0.0444) MultiSource/Applications/lua/lua: 2.59% (4.7920 => 4.9160, std.dev.: 0.0390) MultiSource/Applications/JM/lencod/lencod: 2.52% (22.2206 => 22.7807, std.dev.: 0.0324) MultiSource/Applications/d/make_dparser: 2.52% (3.9761 => 4.0761, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 2.38% (38.6366 => 39.5566, std.dev.: 0.1020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0143) MultiSource/Applications/siod/siod: 1.74% (2.7522 => 2.8002, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 1.53% (7.0524 => 7.1604, std.dev.: 0.0379) MultiSource/Applications/kimwitu++/kc: 1.49% (19.8291 => 20.1251, std.dev.: 0.0381) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.42% (2.1201 => 2.4682, std.dev.: 0.0402) MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.35% (0.3680 => 0.3840, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.16% (4.8043 => 4.9563, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0243 => 5.1683, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.03% (3.7442 => 3.8202, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 1.98% (11.4967 => 11.7247, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (4.0003 => 4.0643, std.dev.: 0.0224) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1285 => 8.2165, std.dev.: 0.0270) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.74% (2.9562 => 0.9240, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.10% (94.8339 => 49.2191, std.dev.: 9.6386) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.26% (49.9431 => 32.8301, std.dev.: 0.2436) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.76% (25.7136 => 17.0331, std.dev.: 0.0807) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.72% (37.0863 => 28.6618, std.dev.: 0.4493) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.86% (5.1563 => 5.0603, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 16:55:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 18:55:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140425235543.927492A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24979?compare_to=24969&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24979, Order: 207259, Start Time: 2014-04-25 19:15:40, End Time: 2014-04-26 00:02:09 To: 24969, Order: 207226, Start Time: 2014-04-25 14:17:14, End Time: 2014-04-25 19:03:14 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1094 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2008-01-07-LongDouble: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/2002-08-19-CodegenBug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 30.77% (0.0520 => 0.0680, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.89% (0.1440 => 0.1640, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.64% (0.1880 => 0.2080, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.00% (0.1600 => 0.1760, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.92% (0.7320 => 0.7680, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.28% (0.4880 => 0.5040, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.9041 => 0.9201, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.37% (1.1641 => 1.1801, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.15% (1.7401 => 1.7601, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.43% (0.9201 => 1.0161, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -12.12% (0.1320 => 0.1160, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 17:28:18 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 17:28:18 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140426002835.85A594FF88EA@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building compiler-rt. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14805 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207218 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17834 of 17835) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17835 of 17835) 1 warning(s) in tests. Testing Time: 348.41s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17685 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207218) ^ :1:28: note: possible intended match here clang version 3.5.0 (trunk 207218) ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 17:28:18 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 17:28:18 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140426002835.868E04FF88EB@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building compiler-rt. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14805 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207218 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17834 of 17835) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17835 of 17835) 1 warning(s) in tests. Testing Time: 348.41s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17685 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207218) ^ :1:28: note: possible intended match here clang version 3.5.0 (trunk 207218) ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 17:32:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 19:32:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140426003235.9B6FA2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24980?compare_to=24970&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24980, Order: 207260, Start Time: 2014-04-25 19:50:57, End Time: 2014-04-26 00:39:18 To: 24970, Order: 207226, Start Time: 2014-04-25 14:50:46, End Time: 2014-04-25 19:38:41 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (124 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (949 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.24% (0.3400 => 0.3680, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/chomp: 4.92% (0.2440 => 0.2560, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: 3.61% (0.3320 => 0.3440, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 3.00% (0.4000 => 0.4120, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 2.08% (1.7321 => 1.7681, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.65% (1.4560 => 1.4800, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.62% (2.2281 => 2.2641, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: 1.10% (18.9325 => 19.1406, std.dev.: 0.0622) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 5.46% (0.9521 => 1.0041, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.8601 => 0.8761, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/SignlessTypes/Large/cast: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 300.00% (0.0120 => 0.0480, std.dev.: 0.0032) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0078) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 36.17% (0.1880 => 0.2560, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.09% (1.7641 => 2.1361, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.05% (1.6761 => 2.0121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.62% (1.6721 => 2.0001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.30% (1.7201 => 2.0521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.26% (1.7241 => 2.0561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.79% (1.9801 => 2.3521, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.75% (1.7921 => 2.1281, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.62% (1.7401 => 2.0641, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 17.92% (1.8081 => 2.1321, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.70% (1.9641 => 2.2921, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 15.99% (1.9761 => 2.2921, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (6.7200 => 7.1680, std.dev.: 0.0274) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.51% (3.5002 => 3.7282, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (0.8601 => 0.9161, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.13% (1.2400 => 1.3160, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.04% (11.7880 => 12.5000, std.dev.: 0.0666) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.59% (0.6440 => 0.6800, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0148) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0166) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0145) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0366) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0090) MultiSource/Applications/d/make_dparser: 4.44% (3.9641 => 4.1401, std.dev.: 0.0215) MultiSource/Benchmarks/McCat/18-imp/imp: 4.39% (0.4560 => 0.4760, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0260) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (9.9842 => 10.4082, std.dev.: 0.0484) MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 3.99% (6.9124 => 7.1884, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.94% (1.7280 => 1.7960, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.4360 => 0.4520, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0095) MultiSource/Applications/SPASS/SPASS: 3.51% (18.4924 => 19.1406, std.dev.: 0.0622) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.34% (6.8321 => 7.0601, std.dev.: 0.0389) MultiSource/Applications/minisat/minisat: 3.27% (0.8560 => 0.8840, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (10.3203 => 10.6524, std.dev.: 0.0561) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.21% (1.3720 => 1.4160, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (2.0440 => 2.1040, std.dev.: 0.0207) MultiSource/Applications/JM/lencod/lencod: 2.85% (22.6287 => 23.2728, std.dev.: 0.0650) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.83% (51.1089 => 52.5529, std.dev.: 0.0930) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: 2.41% (20.2445 => 20.7325, std.dev.: 0.0687) MultiSource/Applications/kimwitu++/kc: 2.27% (19.7371 => 20.1851, std.dev.: 0.0619) MultiSource/Benchmarks/Bullet/bullet: 2.20% (38.9366 => 39.7926, std.dev.: 0.0559) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.07% (16.5963 => 16.9403, std.dev.: 0.0590) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0158) MultiSource/Applications/sqlite3/sqlite3: 1.57% (25.1895 => 25.5856, std.dev.: 0.0489) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0244 => 6.1124, std.dev.: 0.0272) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0105) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0145) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.34% (4.4883 => 4.5483, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/nestedloop: -60.32% (2.9642 => 1.1761, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0064) MultiSource/Applications/obsequi/Obsequi: -22.36% (2.6481 => 2.0560, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.99% (7.4801 => 6.2840, std.dev.: 0.0327) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.78% (7.5041 => 6.3200, std.dev.: 0.0564) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0061) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -2.72% (13.5243 => 13.1563, std.dev.: 0.0262) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6534 => 17.8851, std.dev.: 0.0390) SingleSource/Benchmarks/Linpack/linpack-pc: -15.74% (7.8005 => 6.5724, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.31% (3.4442 => 3.0202, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.60% (0.9281 => 0.8761, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.19% (29.4578 => 28.5178, std.dev.: 0.3635) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -2.95% (5.1603 => 5.0083, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.29% (2.6202 => 2.5602, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: -2.26% (8.3085 => 8.1205, std.dev.: 0.0299) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.10% (2.9122 => 2.8802, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 18:00:47 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 18:00:47 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140426010047.E6F794FF8CCC@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14806 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207221 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17835) PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17835 of 17835) 1 warning(s) in tests. Testing Time: 331.52s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17685 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207221) ^ :1:29: note: possible intended match here clang version 3.5.0 (trunk 207221) ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 18:41:39 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 18:41:39 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140426014207.34D444FF92C0@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14807 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207222 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17834 of 17835) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17835 of 17835) 1 warning(s) in tests. Testing Time: 333.33s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17685 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207222) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 19:16:07 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 19:16:07 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140426021624.1D0034FF96C9@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14808 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207223 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17834 of 17835) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17835 of 17835) 1 warning(s) in tests. Testing Time: 396.40s ******************** Failing Tests (1): Clang :: Driver/windows-include-env.c Expected Passes : 17685 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207223) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 19:15:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 21:15:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426021536.B876E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24981?compare_to=24977&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24981, Order: 207274, Start Time: 2014-04-25 21:40:43, End Time: 2014-04-26 02:22:16 To: 24977, Order: 207256, Start Time: 2014-04-25 19:03:27, End Time: 2014-04-25 23:44:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (102 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 37.50% (0.0640 => 0.0880, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 8.33% (0.2880 => 0.3120, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.20% (1.2721 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.17% (0.9201 => 0.9401, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-08-20-FoldBug: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary3: 9.86% (0.2840 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0546) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0125) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0341) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0444) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0418) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0188) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (10.4082 => 10.7162, std.dev.: 0.0453) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0227) MultiSource/Applications/JM/lencod/lencod: 2.43% (17.6165 => 18.0445, std.dev.: 0.0481) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.15% (48.1088 => 49.1409, std.dev.: 0.1343) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 2.08% (37.0925 => 37.8645, std.dev.: 0.0729) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.88% (4.9000 => 4.9920, std.dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 1.31% (23.7574 => 24.0695, std.dev.: 0.0467) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0321) MultiSource/Applications/lua/lua: 2.93% (21.1533 => 21.7734, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0308) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0304) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0162) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 19:39:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 19:39:52 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140426024011.7788A4FF99A1@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building compiler-rt. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14809 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207224 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -std=c++11 -fno-exceptions -fPIC -funwind-tables -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/lib -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/include -arch i386 -fvisibility=hidden -DVISIBILITY_HIDDEN -Wall -Werror -O3 -fomit-frame-pointer -mmacosx-version-min=10.6 -fno-builtin -gline-tables-only -DMAC_INTERPOSE_FUNCTIONS=1 -c -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/asan_osx_dynamic/i386/SubDir.lib__asan/asan_new_delete.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/lib/asan/asan_new_delete.cc fatal error: too many errors emitted, stopping now [-ferror-limit=] COMPILE: clang_darwin/asan_osx_dynamic/i386: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/lib/asan/asan_poisoning.cc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -std=c++11 -fno-exceptions -fPIC -funwind-tables -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/lib -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/include -arch i386 -fvisibility=hidden -DVISIBILITY_HIDDEN -Wall -Werror -O3 -fomit-frame-pointer -mmacosx-version-min=10.6 -fno-builtin -gline-tables-only -DMAC_INTERPOSE_FUNCTIONS=1 -c -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/asan_osx_dynamic/i386/SubDir.lib__asan/asan_poisoning.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/lib/asan/asan_poisoning.cc COMPILE: clang_darwin/asan_osx_dynamic/i386: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/lib/asan/asan_posix.cc /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/bin/clang -std=c++11 -fno-exceptions -fPIC -funwind-tables -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/lib -I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/include -arch i386 -fvisibility=hidden -DVISIBILITY_HIDDEN -Wall -Werror -O3 -fomit-frame-pointer -mmacosx-version-min=10.6 -fno-builtin -gline-tables-only -DMAC_INTERPOSE_FUNCTIONS=1 -c -o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/asan_osx_dynamic/i386/SubDir.lib__asan/asan_posix.o /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/projects/compiler-rt/lib/asan/asan_posix.cc 20 errors generated. make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/asan_osx_dynamic/i386/SubDir.lib__asan/asan_interceptors.o] Error 1 make[5]: *** Waiting for unfinished jobs.... make[4]: *** [BuildRuntimeLibraries] Error 2 rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/clang/3.5.0/lib/darwin/.dir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/clang/3.5.0/lib/macho_embedded/.dir make[3]: *** [compiler-rt/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Fri Apr 25 19:37:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 21:37:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426023740.51A332A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24982?compare_to=24981&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24982, Order: 207276, Start Time: 2014-04-25 22:00:29, End Time: 2014-04-26 02:44:17 To: 24981, Order: 207274, Start Time: 2014-04-25 21:40:43, End Time: 2014-04-26 02:22:16 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (109 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-18-LoopBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 31.25% (0.0640 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.20% (1.0560 => 1.1320, std.dev.: 0.0229) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.1280 => 1.1720, std.dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (10.6960 => 11.3960, std.dev.: 0.0756) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (6.0160 => 6.3800, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.1240 => 1.1720, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (8.1441 => 8.4641, std.dev.: 0.0447) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (10.4082 => 10.7202, std.dev.: 0.0355) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.8000 => 5.9600, std.dev.: 0.0503) MultiSource/Applications/JM/lencod/lencod: 2.47% (17.6165 => 18.0525, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0349) MultiSource/Benchmarks/Bullet/bullet: 2.19% (37.0925 => 37.9045, std.dev.: 0.0860) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.04% (48.1088 => 49.0889, std.dev.: 0.1130) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 1.64% (18.8170 => 19.1251, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0123) MultiSource/Applications/JM/ldecod/ldecod: 1.58% (7.8562 => 7.9802, std.dev.: 0.0367) MultiSource/Applications/sqlite3/sqlite3: 1.38% (23.7574 => 24.0855, std.dev.: 0.0314) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Applications/ALAC/encode/alacconvert-encode: 40.00% (0.0400 => 0.0560, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0367) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 2.89% (21.1533 => 21.7654, std.dev.: 0.1220) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.65% (4.5203 => 4.6403, std.dev.: 0.0336) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.70% (3.5322 => 3.5922, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1921 => 2.2241, std.dev.: 0.0027) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0363) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (4.4683 => 4.2563, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -1.49% (2.6762 => 2.6362, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0105) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 19:48:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 21:48:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426024857.263A22A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24983?compare_to=24982&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24983, Order: 207279, Start Time: 2014-04-25 22:14:11, End Time: 2014-04-26 02:55:36 To: 24982, Order: 207276, Start Time: 2014-04-25 22:00:29, End Time: 2014-04-26 02:44:17 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (106 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/2010-12-08-tls: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Towers: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0480 => 0.0600, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.74% (0.0920 => 0.1120, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.86% (0.1120 => 0.1320, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.67% (0.0960 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.11% (0.1480 => 0.1600, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: 6.35% (2.0161 => 2.1441, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.85% (1.5600 => 1.6200, std.dev.: 0.0143) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.70% (0.5400 => 0.5600, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 3.49% (0.3440 => 0.3560, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3480 => 0.3600, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (1.6041 => 1.6441, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.30% (0.9241 => 0.9361, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -3.17% (0.5040 => 0.4880, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: -21.43% (0.0560 => 0.0440, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.20% (1.2201 => 1.3201, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.27% (1.1561 => 1.2401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0810) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (1.5200 => 1.6200, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0217) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0164) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0202) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0267) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3480 => 0.3600, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0400) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0086) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 2.85% (4.9200 => 5.0600, std.dev.: 0.0411) MultiSource/Benchmarks/mafft/pairlocalalign: 2.69% (10.4082 => 10.6882, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.40% (5.8400 => 5.9800, std.dev.: 0.0331) MultiSource/Applications/JM/lencod/lencod: 2.25% (17.6165 => 18.0125, std.dev.: 0.0476) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0314) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0171) MultiSource/Benchmarks/Bullet/bullet: 1.92% (37.0925 => 37.8045, std.dev.: 0.0597) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.89% (48.1088 => 49.0170, std.dev.: 0.0969) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 1.58% (23.7574 => 24.1335, std.dev.: 0.0227) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 1.11% (18.8170 => 19.0250, std.dev.: 0.0309) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0401) MultiSource/Applications/lua/lua: 2.76% (21.1533 => 21.7374, std.dev.: 0.0539) MultiSource/Applications/obsequi/Obsequi: 2.71% (2.0681 => 2.1241, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0161) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0132) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0206) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -80.32% (10.8967 => 2.1441, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.02% (3.9202 => 3.8802, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 20:29:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 22:29:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426032911.27E322A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24984?compare_to=24983&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24984, Order: 207283, Start Time: 2014-04-25 22:56:00, End Time: 2014-04-26 03:35:52 To: 24983, Order: 207279, Start Time: 2014-04-25 22:14:11, End Time: 2014-04-26 02:55:36 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (98 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 40.00% (0.0400 => 0.0560, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.05% (0.0840 => 0.1000, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.84% (0.4080 => 0.4400, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 2.80% (2.5681 => 2.6401, std.dev.: 0.0095) MultiSource/Applications/d/make_dparser: 2.34% (3.7681 => 3.8561, std.dev.: 0.0147) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 16.13% (0.9921 => 1.1521, std.dev.: 0.0375) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.25% (0.2360 => 0.2720, std.dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.57% (0.3680 => 0.4400, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.58% (6.0160 => 6.4720, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0635) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0124) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0243) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0421) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.19% (0.7640 => 0.7960, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (4.9200 => 5.1120, std.dev.: 0.0462) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0330) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.49% (0.9161 => 0.9481, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0176) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0510) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0306) MultiSource/Applications/siod/siod: 2.64% (2.5721 => 2.6401, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0459) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0309) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1889, std.dev.: 0.1406) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8206, std.dev.: 0.0851) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0378) MultiSource/Applications/kimwitu++/kc: 1.91% (18.8170 => 19.1771, std.dev.: 0.0604) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0211) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0523) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (25.8896 => 26.7817, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 2.87% (21.1533 => 21.7614, std.dev.: 0.0569) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -80.40% (10.8967 => 2.1361, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.27% (7.7485 => 6.7204, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 20:29:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 22:29:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426032922.2C5BA2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24985?compare_to=24974&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24985, Order: 207283, Start Time: 2014-04-25 22:53:10, End Time: 2014-04-26 03:36:04 To: 24974, Order: 207245, Start Time: 2014-04-25 18:01:38, End Time: 2014-04-25 22:44:21 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 14 (148 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 80.00% (0.0200 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/UnitTests/vla: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 11.11% (0.1080 => 0.1200, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: 6.19% (2.0041 => 2.1281, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.80% (0.3160 => 0.3280, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.57% (0.9321 => 0.9561, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 1.65% (2.6600 => 2.7040, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 33.33% (0.0720 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.67% (0.2400 => 0.2920, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.19% (11.3687 => 3.0482, std.dev.: 0.0113) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0072) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 293.07% (0.4600 => 1.8081, std.dev.: 0.0120) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0042) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Regression/C/sumarraymalloc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/UnitTests/vla: 50.00% (0.0320 => 0.0480, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 36.36% (0.0880 => 0.1200, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 13.10% (0.3360 => 0.3800, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.50% (1.5241 => 1.6841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.17% (0.2360 => 0.2600, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.95% (1.6081 => 1.7681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0074) MultiSource/Applications/obsequi/Obsequi: 9.42% (1.8680 => 2.0440, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (1.1640 => 1.2560, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.82% (1.4841 => 1.6001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0109) MultiSource/Applications/Burg/burg: 7.43% (1.5080 => 1.6200, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (0.2200 => 0.2360, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (6.4680 => 6.9040, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0099) MultiSource/Applications/spiff/spiff: 5.95% (1.0080 => 1.0680, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (11.6440 => 12.3360, std.dev.: 0.0869) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.86% (9.4842 => 10.0402, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.2960 => 0.3120, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.7400 => 1.8320, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.83% (1.7401 => 1.8241, std.dev.: 0.0162) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (10.0443 => 10.5243, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.71% (6.5440 => 6.8520, std.dev.: 0.0534) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (5.8121 => 6.0841, std.dev.: 0.0393) MultiSource/Applications/treecc/treecc: 4.64% (2.5840 => 2.7040, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0205) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0209) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0124) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0155) MultiSource/Applications/JM/lencod/lencod: 4.19% (21.9606 => 22.8808, std.dev.: 0.0480) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.09% (50.0290 => 52.0730, std.dev.: 0.0528) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (5.3600 => 5.5760, std.dev.: 0.0400) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0173) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.87% (0.7240 => 0.7520, std.dev.: 0.0105) MultiSource/Applications/oggenc/oggenc: 3.72% (6.9844 => 7.2445, std.dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (6.5080 => 6.7320, std.dev.: 0.0637) MultiSource/Applications/SPASS/SPASS: 3.43% (18.4404 => 19.0724, std.dev.: 0.0440) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0349) MultiSource/Benchmarks/Bullet/bullet: 3.23% (38.4046 => 39.6446, std.dev.: 0.0579) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0147) MultiSource/Applications/ClamAV/clamscan: 2.77% (19.0444 => 19.5724, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (16.3483 => 16.7723, std.dev.: 0.0381) MultiSource/Applications/kimwitu++/kc: 2.48% (19.6891 => 20.1771, std.dev.: 0.0604) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (13.0563 => 13.2283, std.dev.: 0.0403) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (6.1044 => 6.1764, std.dev.: 0.0246) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.52% (2.1401 => 2.4722, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 10.35% (2.8602 => 3.1562, std.dev.: 0.0235) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.96% (0.2680 => 0.2920, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.89% (0.3600 => 0.3920, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.33% (4.5603 => 4.7123, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 3.13% (7.4205 => 7.6525, std.dev.: 0.0210) MultiSource/Applications/minisat/minisat: 2.16% (6.6684 => 6.8124, std.dev.: 0.0326) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.88% (11.5087 => 11.7247, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 1.71% (3.9842 => 4.0523, std.dev.: 0.0173) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -79.97% (10.6247 => 2.1281, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.57% (2.9442 => 0.8960, std.dev.: 0.0255) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.47% (91.8497 => 49.1631, std.dev.: 10.2090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.97% (26.0616 => 16.9491, std.dev.: 0.1706) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.26% (50.3031 => 33.0701, std.dev.: 0.1273) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.65% (42.1466 => 28.3858, std.dev.: 0.3053) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1176) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: -12.33% (7.7845 => 6.8244, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.33% (4.1243 => 4.0283, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.63% (5.1563 => 5.0723, std.dev.: 0.0063) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0133) MultiSource/Benchmarks/mafft/pairlocalalign: -1.17% (26.6977 => 26.3856, std.dev.: 0.0385) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4602 => 2.4322, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 21:10:44 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 21:10:44 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140426041104.DEC004FFA7E6@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19251 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207296 Blamelist: adrian,anemet,compnerd,d0k,dblaikie,dexonsmith,nicholas,nico,samsonov,tfiala,tmroeder,whunt Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Fri Apr 25 21:24:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 23:24:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140426042443.A1E3E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24986?compare_to=24976&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24986, Order: 207287, Start Time: 2014-04-25 23:48:28, End Time: 2014-04-26 04:31:24 To: 24976, Order: 207254, Start Time: 2014-04-25 18:59:41, End Time: 2014-04-25 23:42:31 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 11 (157 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 50.00% (0.0320 => 0.0480, std.dev.: 0.0027) SingleSource/Regression/C/sumarray: 36.36% (0.0440 => 0.0600, std.dev.: 0.0053) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.00% (0.0800 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.49% (0.3560 => 0.3720, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/nestedloop: 2.56% (0.7840 => 0.8041, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.08% (1.5401 => 1.5721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.65% (1.4561 => 1.4801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.30% (1.5361 => 1.5561, std.dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2412.81% (0.0320 => 0.8041, std.dev.: 0.0062) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0124) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 329.35% (0.2320 => 0.9961, std.dev.: 0.0089) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0160 => 0.0480, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 193.65% (0.2520 => 0.7400, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0067) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0055) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0053) SingleSource/UnitTests/Vector/simple: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 44.25% (1.3920 => 2.0080, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.98% (1.2921 => 1.5761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.91% (1.1321 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.68% (1.1441 => 1.3921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.16% (1.1721 => 1.4201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.34% (1.1601 => 1.3961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.13% (1.2321 => 1.4801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.00% (1.2001 => 1.4401, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.86% (1.1881 => 1.4241, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0143) MultiSource/Applications/JM/ldecod/ldecod: 18.79% (8.5802 => 10.1923, std.dev.: 0.0377) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.2841 => 1.5201, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 15.56% (19.5406 => 22.5807, std.dev.: 0.0540) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.39% (5.3360 => 6.1041, std.dev.: 0.0325) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.33% (1.7400 => 1.9720, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0058) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 9.38% (11.3843 => 12.4523, std.dev.: 0.0396) MultiSource/Applications/oggenc/oggenc: 9.17% (6.2844 => 6.8604, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.33% (0.4320 => 0.4680, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: 8.33% (0.3360 => 0.3640, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.19% (5.6680 => 6.1320, std.dev.: 0.0514) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (11.4440 => 12.3400, std.dev.: 0.0461) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.47% (5.7280 => 6.1560, std.dev.: 0.0609) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.4760 => 1.5760, std.dev.: 0.0242) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (9.5802 => 10.2282, std.dev.: 0.0389) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0142) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0212) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0100) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0507) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.13% (0.8721 => 0.9081, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (6.8280 => 7.0840, std.dev.: 0.0530) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.65% (49.1529 => 50.9489, std.dev.: 0.1041) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (5.3840 => 5.5800, std.dev.: 0.0445) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.33% (0.3600 => 0.3720, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.6961 => 1.7521, std.dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 3.04% (19.2243 => 19.8083, std.dev.: 0.0570) MultiSource/Applications/sqlite3/sqlite3: 2.80% (24.7575 => 25.4495, std.dev.: 0.0387) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0151) MultiSource/Applications/kimwitu++/kc: 1.94% (19.7491 => 20.1331, std.dev.: 0.0684) MultiSource/Benchmarks/Bullet/bullet: 1.68% (39.0726 => 39.7286, std.dev.: 0.0920) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.40% (6.0124 => 6.0964, std.dev.: 0.0138) MultiSource/Applications/SPASS/SPASS: 1.26% (18.7966 => 19.0326, std.dev.: 0.0428) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0477) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0178) MultiSource/Benchmarks/llubenchmark/llu: 5.00% (5.1203 => 5.3763, std.dev.: 0.0889) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 4.46% (6.8204 => 7.1244, std.dev.: 0.0336) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0216) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (5.0203 => 5.1683, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (25.4536 => 25.9096, std.dev.: 0.0256) MultiSource/Applications/sqlite3/sqlite3: 1.78% (4.0563 => 4.1283, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (4.1243 => 4.1883, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.11% (3.2362 => 3.2722, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.60% (11.0207 => 2.0281, std.dev.: 0.0080) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -80.00% (0.0200 => 0.0040, std.dev.: 0.0062) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.20% (21.6534 => 17.9291, std.dev.: 0.0319) SingleSource/Benchmarks/Linpack/linpack-pc: -15.98% (7.8605 => 6.6044, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -9.10% (3.4722 => 3.1562, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0601) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.05% (4.5123 => 4.2843, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.28% (2.9242 => 2.8282, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.73% (5.0963 => 5.0083, std.dev.: 0.0157) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 21:25:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 23:25:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426042503.E38FC2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24987?compare_to=24984&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24987, Order: 207287, Start Time: 2014-04-25 23:50:17, End Time: 2014-04-26 04:31:44 To: 24984, Order: 207283, Start Time: 2014-04-25 22:56:00, End Time: 2014-04-26 03:35:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (106 on baseline) Performance Improvements: 2 (14 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 400.00% (0.0040 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/RealMM: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/mason/mason: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.67% (0.0960 => 0.1120, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 5.77% (0.4160 => 0.4400, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.80% (1.5720 => 1.6160, std.dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 1.95% (1.2320 => 1.2560, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.94% (1.2401 => 1.2641, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 11.54% (0.1040 => 0.1160, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.43% (2.1361 => 2.0201, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.68% (1.1521 => 1.0521, std.dev.: 0.0378) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.4120 => 0.4400, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0888) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (1.5200 => 1.6160, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (8.1441 => 8.5921, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 5.04% (4.5200 => 4.7480, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0465) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (7.8562 => 8.0962, std.dev.: 0.0206) MultiSource/Applications/minisat/minisat: 3.00% (0.8000 => 0.8240, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0468) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0423) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0184) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.50% (48.1088 => 49.3129, std.dev.: 0.0645) MultiSource/Benchmarks/Bullet/bullet: 2.35% (37.0925 => 37.9645, std.dev.: 0.0701) MultiSource/Applications/sqlite3/sqlite3: 2.16% (23.7574 => 24.2695, std.dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: 2.06% (18.8170 => 19.2051, std.dev.: 0.0369) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0166) MultiSource/Applications/SPASS/SPASS: 1.82% (17.5484 => 17.8684, std.dev.: 0.0288) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 38.09% (2.8042 => 3.8722, std.dev.: 0.0000) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0184) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.37% (1.6601 => 1.7161, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0112) MultiSource/Applications/lua/lua: 2.80% (21.1533 => 21.7454, std.dev.: 0.1871) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.57% (4.5203 => 4.6363, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4081 => 1.4361, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.14% (6.6564 => 6.7324, std.dev.: 0.0254) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.32% (7.7485 => 6.7164, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (4.4683 => 4.2523, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -1.64% (2.6762 => 2.6322, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 21:34:15 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 21:34:15 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140426043430.A03434FFAB5A@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14816 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207293 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17839 of 17840) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17840 of 17840) 1 warning(s) in tests. Testing Time: 338.94s ******************** Failing Tests (1): LLVM :: CodeGen/X86/sse41.ll Expected Passes : 17690 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::sse41.ll': movl 4(%esp), %eax ^ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/X86/sse41.ll:282:14: note: CHECK-NOT: pattern specified here ; CHECK-NOT: mov ^ :192:2: error: CHECK-NOT: string occurred! movl 4(%esp), %eax ^ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/X86/sse41.ll:301:14: note: CHECK-NOT: pattern specified here ; CHECK-NOT: mov ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 21:34:15 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 21:34:15 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140426043430.9E8064FFAB59@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14816 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207293 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17839 of 17840) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17840 of 17840) 1 warning(s) in tests. Testing Time: 338.94s ******************** Failing Tests (1): LLVM :: CodeGen/X86/sse41.ll Expected Passes : 17690 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::sse41.ll': movl 4(%esp), %eax ^ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/X86/sse41.ll:282:14: note: CHECK-NOT: pattern specified here ; CHECK-NOT: mov ^ :192:2: error: CHECK-NOT: string occurred! movl 4(%esp), %eax ^ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/X86/sse41.ll:301:14: note: CHECK-NOT: pattern specified here ; CHECK-NOT: mov ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 21:34:31 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 21:34:31 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140426043436.34FCA4FFAB61@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19253 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207293 Blamelist: gclayton BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 21:34:31 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 21:34:31 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140426043436.351104FFAB62@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19253 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207293 Blamelist: gclayton BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: include/lldb/Interpreter/ScriptInterpreter.h include/lldb/Interpreter/ScriptInterpreterPython.h source/Interpreter/CommandInterpreter.cpp source/Interpreter/ScriptInterpreterPython.cpp On: http://10.1.1.2/svn/llvm-project For: lldb At: Fri 25 Apr 2014 17:05:39 Changed By: gclayton Comments: Free the strong reference to a lldb::SBDebugger that the script interpreter was holding onto in the "lldb.debugger" global variable. Properties: Files: include/lldb/Host/Editline.h source/Host/common/Editline.cpp On: http://10.1.1.2/svn/llvm-project For: lldb At: Fri 25 Apr 2014 17:05:40 Changed By: gclayton Comments: Since one or more Editline instances of the same kind (lldb commands, expressions, etc) can exist at once, they should all shared a ref counted history object. Now they do. Properties: LOGS: From llvm-testresults at cs.uiuc.edu Fri Apr 25 21:33:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 23:33:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140426043351.F1EE12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24988?compare_to=24978&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24988, Order: 207287, Start Time: 2014-04-25 23:54:48, End Time: 2014-04-26 04:40:36 To: 24978, Order: 207256, Start Time: 2014-04-25 19:03:40, End Time: 2014-04-25 23:49:03 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 16 (134 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-03-NotTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/ccc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.00% (0.2400 => 0.2520, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.95% (0.3040 => 0.3160, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.48% (2.0961 => 2.1481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.92% (2.0841 => 2.1241, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.75% (2.0601 => 2.0961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.62% (1.9721 => 2.0041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.43% (2.2321 => 2.2641, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.31% (2.1401 => 2.1681, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 1.17% (7.1604 => 7.2445, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.15% (2.4402 => 2.4682, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.88% (0.3240 => 0.3560, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/health/health: 5.26% (0.3800 => 0.4000, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.66% (17.6723 => 19.7323, std.dev.: 0.0294) MultiSource/Applications/sqlite3/sqlite3: 1425.42% (1.7001 => 25.9336, std.dev.: 0.0223) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.43% (50.1010 => 51.8170, std.dev.: 0.1052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.29% (11.3920 => 12.3360, std.dev.: 0.0666) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0112) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0323, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0108) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0077) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 55.56% (0.0360 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/lists: 26.09% (0.0920 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.93% (0.1720 => 0.2080, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.31% (0.4160 => 0.4880, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.97% (1.8281 => 2.1201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 15.55% (2.1361 => 2.4682, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.51% (1.9601 => 2.2641, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.48% (1.8601 => 2.1481, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.01% (1.9721 => 2.2681, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.80% (1.8921 => 2.1721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.79% (2.0281 => 2.3281, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.55% (1.9241 => 2.2041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.14% (1.9521 => 2.2281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.83% (1.8081 => 2.0401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.50% (0.2240 => 0.2520, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.50% (0.0960 => 0.1080, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.87% (1.9201 => 2.1481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.79% (1.9001 => 2.1241, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.76% (0.3400 => 0.3800, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.70% (1.8801 => 2.1001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.33% (1.8361 => 2.0441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.29% (1.9481 => 2.1681, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.92% (2.0521 => 2.2761, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.69% (0.6360 => 0.7040, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0178) MultiSource/Applications/aha/aha: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 9.57% (0.3760 => 0.4120, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0109) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0204) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.82% (1.0880 => 1.1840, std.dev.: 0.0318) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (6.4800 => 6.8840, std.dev.: 0.0442) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.9960 => 1.0560, std.dev.: 0.0127) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0209) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.61% (1.2120 => 1.2800, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0213) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.1320 => 1.1920, std.dev.: 0.0144) MultiSource/Applications/Burg/burg: 5.24% (1.5280 => 1.6080, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3120 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (6.5320 => 6.8520, std.dev.: 0.0364) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (0.8280 => 0.8680, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.75% (9.6042 => 10.0602, std.dev.: 0.0430) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0196) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.2283 => 10.6884, std.dev.: 0.0303) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (5.8281 => 6.0801, std.dev.: 0.0345) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: 3.71% (2.5880 => 2.6840, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (2.1600 => 2.2320, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3960 => 5.5680, std.dev.: 0.0606) MultiSource/Applications/lua/lua: 3.17% (4.7920 => 4.9440, std.dev.: 0.0338) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (6.5360 => 6.7400, std.dev.: 0.0515) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (16.3003 => 16.8003, std.dev.: 0.0567) MultiSource/Applications/SPASS/SPASS: 3.04% (18.5284 => 19.0925, std.dev.: 0.0530) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0196) MultiSource/Benchmarks/Bullet/bullet: 2.80% (38.6366 => 39.7166, std.dev.: 0.0609) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0270) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (4.2243 => 4.3363, std.dev.: 0.0104) MultiSource/Applications/d/make_dparser: 2.62% (3.9761 => 4.0801, std.dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 2.47% (22.2206 => 22.7687, std.dev.: 0.0786) MultiSource/Applications/kimwitu++/kc: 1.61% (19.8291 => 20.1491, std.dev.: 0.0540) MultiSource/Applications/siod/siod: 1.45% (2.7522 => 2.7922, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.74% (2.1201 => 2.4962, std.dev.: 0.0274) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.16% (4.8043 => 4.9563, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.87% (5.0243 => 5.1683, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.14% (3.7442 => 3.8242, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 2.02% (11.4967 => 11.7287, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9684 => 6.0484, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.30% (4.0003 => 4.0523, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.08% (8.1285 => 8.2165, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.65% (10.4007 => 2.0121, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.33% (0.6880 => 0.6720, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.07% (94.8339 => 49.2431, std.dev.: 9.9736) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.15% (25.7136 => 16.9331, std.dev.: 0.1868) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.74% (49.9431 => 33.0901, std.dev.: 0.1778) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.08% (37.0863 => 28.8978, std.dev.: 0.5198) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -13.87% (7.8165 => 6.7324, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.83% (1.2681 => 1.1561, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0050) MultiSource/Applications/aha/aha: -3.63% (2.7522 => 2.6522, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.73% (2.7722 => 2.7242, std.dev.: 0.0160) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1123 => 4.0443, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 21:51:38 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 21:51:38 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-RA Message-ID: <20140426045156.BA5454FFAD30@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-RA/builds/6811 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 207165 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17834 of 17834) 1 warning(s) in tests. Testing Time: 414.80s ******************** Failing Tests (2): Clang :: Driver/windows-include-env.c LLVM :: DebugInfo/X86/array.ll Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207165) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'LLVM::array.ll': Script: -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/llc -filetype=asm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/test/DebugInfo/X86/Output/array.ll.tmp -o - | /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/llvm-dwarfdump -debug-dump=info - | /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/FileCheck /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/test/DebugInfo/X86/array.ll -- Exit Code: 2 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/llc: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/test/DebugInfo/X86/Output/array.ll.tmp: error: Could not open input file: No such file or directory -: The file was not recognized as a valid object file FileCheck error: '-' is empty. -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 21:51:38 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 21:51:38 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-RA Message-ID: <20140426045156.B9A864FFAD2F@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-RA/builds/6811 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 207165 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: ADT/Release+Asserts/ADTTests/APFloatTest.StringHexadecimalExponentDeath (17834 of 17834) 1 warning(s) in tests. Testing Time: 414.80s ******************** Failing Tests (2): Clang :: Driver/windows-include-env.c LLVM :: DebugInfo/X86/array.ll Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207165) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'LLVM::array.ll': Script: -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/llc -filetype=asm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/test/DebugInfo/X86/Output/array.ll.tmp -o - | /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/llvm-dwarfdump -debug-dump=info - | /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/FileCheck /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/llvm/test/DebugInfo/X86/array.ll -- Exit Code: 2 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/Release+Asserts/bin/llc: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-RA/clang-build/test/DebugInfo/X86/Output/array.ll.tmp: error: Could not open input file: No such file or directory -: The file was not recognized as a valid object file FileCheck error: '-' is empty. -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Fri Apr 25 21:48:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Apr 2014 23:48:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426044831.82DA62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24989?compare_to=24979&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24989, Order: 207291, Start Time: 2014-04-26 00:08:40, End Time: 2014-04-26 04:55:12 To: 24979, Order: 207259, Start Time: 2014-04-25 19:15:40, End Time: 2014-04-26 00:02:09 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.08% (0.1040 => 0.1280, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.54% (0.3120 => 0.3480, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/tsp/tsp: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3360 => 0.3480, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.58% (1.7761 => 1.8041, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: 1.20% (2.0001 => 2.0241, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.18% (0.0880 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.68% (5.3723 => 5.5163, std.dev.: 0.0547) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.39% (0.8641 => 0.8761, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.1083 => 4.1563, std.dev.: 0.0127) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Apr 25 22:26:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 00:26:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140426052625.7C18F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24990?compare_to=24980&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24990, Order: 207296, Start Time: 2014-04-26 00:44:56, End Time: 2014-04-26 05:33:06 To: 24980, Order: 207260, Start Time: 2014-04-25 19:50:57, End Time: 2014-04-26 00:39:18 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (129 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.09% (2.2921 => 2.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.69% (2.1321 => 2.1681, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/nestedloop: 1.47% (1.3561 => 1.3761, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.40% (2.2921 => 2.3241, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.54% (3.9482 => 4.0483, std.dev.: 0.0284) MultiSource/Applications/sqlite3/sqlite3: 1.27% (4.0803 => 4.1323, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.02% (4.3243 => 4.2803, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.30% (6.4324 => 6.2204, std.dev.: 0.0749) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0037) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0074) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.08% (1.7081 => 2.0681, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.33% (1.6921 => 2.0361, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.00% (0.1400 => 0.1680, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.86% (1.6721 => 2.0041, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.46% (1.7681 => 2.1121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.31% (1.7401 => 2.0761, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.30% (1.7201 => 2.0521, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.96% (1.9601 => 2.3121, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.77% (1.9801 => 2.3121, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 7.89% (0.1520 => 0.1640, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (3.5002 => 3.7562, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0257) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.7200 => 7.1440, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.8601 => 0.9121, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.00% (0.2000 => 0.2120, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (11.7880 => 12.4800, std.dev.: 0.0829) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.81% (1.2400 => 1.3120, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0166) MultiSource/Applications/lua/lua: 4.92% (4.7920 => 5.0280, std.dev.: 0.0234) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (9.9842 => 10.4482, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0110) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0205) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0128) MultiSource/Applications/d/make_dparser: 3.94% (3.9641 => 4.1201, std.dev.: 0.0257) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.79% (1.3720 => 1.4240, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0247) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (10.3203 => 10.6523, std.dev.: 0.0437) MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.1440 => 1.1800, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (6.8321 => 7.0321, std.dev.: 0.0503) MultiSource/Applications/lambda-0_1_3/lambda: 2.84% (0.8440 => 0.8680, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 2.83% (18.4924 => 19.0166, std.dev.: 0.0385) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.5480 => 5.7000, std.dev.: 0.0519) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.7400 => 0.7600, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 2.67% (22.6287 => 23.2328, std.dev.: 0.0475) MultiSource/Applications/treecc/treecc: 2.60% (2.6200 => 2.6880, std.dev.: 0.0210) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.55% (51.1089 => 52.4129, std.dev.: 0.0854) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.44% (0.4920 => 0.5040, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (1.0001 => 1.0241, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 2.37% (20.2445 => 20.7245, std.dev.: 0.0380) MultiSource/Applications/kimwitu++/kc: 2.27% (19.7371 => 20.1851, std.dev.: 0.0348) MultiSource/Benchmarks/Bullet/bullet: 2.02% (38.9366 => 39.7246, std.dev.: 0.0980) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (3.0122 => 3.0682, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.83% (16.5963 => 16.9003, std.dev.: 0.0469) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0161) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (4.2203 => 4.2803, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 1.22% (25.1895 => 25.4975, std.dev.: 0.0437) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (6.0244 => 6.0924, std.dev.: 0.0248) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (1.2681 => 1.4281, std.dev.: 0.0190) MultiSource/Applications/siod/siod: 9.62% (2.8282 => 3.1002, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.92% (1.2121 => 1.3081, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.87% (1.6521 => 1.7161, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1761 => 2.2521, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 3.11% (6.8204 => 7.0324, std.dev.: 0.0304) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (4.4883 => 4.5563, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0203 => 4.0723, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/DefaultInitDynArrays: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0117) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.67% (3.1762 => 1.3761, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0049) MultiSource/Applications/obsequi/Obsequi: -21.60% (2.6481 => 2.0760, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.90% (7.4801 => 6.2160, std.dev.: 0.0478) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.99% (7.5041 => 6.3040, std.dev.: 0.0446) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -3.11% (13.5243 => 13.1043, std.dev.: 0.0351) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.77% (21.6534 => 17.8051, std.dev.: 0.0640) SingleSource/Benchmarks/Linpack/linpack-pc: -15.80% (7.8005 => 6.5684, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/18-imp/imp: -15.79% (0.0760 => 0.0640, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.31% (3.4442 => 3.0202, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0090) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (5.1603 => 5.0043, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.01% (2.9202 => 2.8322, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.44% (2.6202 => 2.5562, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802, std.dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0285) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (4.1323 => 4.0843, std.dev.: 0.0012) MultiSource/Applications/aha/aha: -1.10% (2.9122 => 2.8802, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0131) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 22:46:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 22:46:42 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140426054702.557FB4FFB327@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6817 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 207165 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Debug+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17834) 1 warning(s) in tests. Testing Time: 673.62s ******************** Failing Tests (2): Clang :: Driver/windows-include-env.c LLVM :: DebugInfo/X86/array.ll Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207165) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'LLVM::array.ll': Script: -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/bin/llc -filetype=asm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/test/DebugInfo/X86/Output/array.ll.tmp -o - | /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/bin/llvm-dwarfdump -debug-dump=info - | /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/bin/FileCheck /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/llvm/test/DebugInfo/X86/array.ll -- Exit Code: 2 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/bin/llc: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/test/DebugInfo/X86/Output/array.ll.tmp: error: Could not open input file: No such file or directory -: The file was not recognized as a valid object file FileCheck error: '-' is empty. -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 22:46:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 22:46:42 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-DA Message-ID: <20140426054702.69A904FFB328@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-DA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-DA/builds/6817 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase2-stage0) Build Source Stamp: 207165 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Debug+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17834 of 17834) 1 warning(s) in tests. Testing Time: 673.62s ******************** Failing Tests (2): Clang :: Driver/windows-include-env.c LLVM :: DebugInfo/X86/array.ll Expected Passes : 17683 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang::windows-include-env.c': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang.src/test/Driver/windows-include-env.c:3:11: error: expected string not found in input // CHECK: "-cc1" ^ :1:1: note: scanning from here clang version 3.5.0 (trunk 207165) ^ :2:14: note: possible intended match here Target: x86_64-apple-windows-msvc ^ -- ******************** Last 15 lines of 'LLVM::array.ll': Script: -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/bin/llc -filetype=asm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/test/DebugInfo/X86/Output/array.ll.tmp -o - | /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/bin/llvm-dwarfdump -debug-dump=info - | /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/bin/FileCheck /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/llvm/test/DebugInfo/X86/array.ll -- Exit Code: 2 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/Debug+Asserts/bin/llc: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-DA/clang-build/test/DebugInfo/X86/Output/array.ll.tmp: error: Could not open input file: No such file or directory -: The file was not recognized as a valid object file FileCheck error: '-' is empty. -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 22:47:04 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 22:47:04 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase2 - living Message-ID: <20140426054715.B4AA74FFB347@lab.llvm.org> The Buildbot has detected a new failure on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7568 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207165 Blamelist: aaronballman,abramo,adibiagio,adrian,akirtzidis,alexfh,amusman,andersg,arsenm,atanasyan,benlangmuir,bogner,chandlerc,chapuni,compnerd,ctopper,d0k,dblaikie,delena,dnovillo,domipheus,dsanders,dvyukov,dyatkovskiy,emaste,enrico,eugenis,filcab,fjahanian,gclayton,glider,gribozavr,hans,jamesm,jmolenda,jrose,jtsoftware,karthik,kcc,kevinqin,logan,majnemer,matheusalmeida,mspencer,nico,pcc,qcolombet,rafael,rnk,rsmith,rtrieu,samsonov,sbenza,spyffe,timurrrr,tnorthover,volkalex,zinovy.nis BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Fri Apr 25 23:31:05 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Fri, 25 Apr 2014 23:31:05 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140426063117.B54C14FFB960@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19254 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207308 Blamelist: ghoflehner Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sat Apr 26 00:02:03 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 02:02:03 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426070203.3A34C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24991?compare_to=24987&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24991, Order: 207303, Start Time: 2014-04-26 02:27:11, End Time: 2014-04-26 07:08:44 To: 24987, Order: 207287, Start Time: 2014-04-25 23:50:17, End Time: 2014-04-26 04:31:44 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (100 on baseline) Performance Improvements: 5 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (1.6161 => 1.6561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.57% (1.2761 => 1.2961, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.13% (3.8722 => 4.0323, std.dev.: 0.0601) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.8002 => 3.7082, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.07% (4.6363 => 4.5403, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.1003 => 4.0203, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.27% (4.1083 => 4.0563, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.03% (3.8882 => 3.8482, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-7: 66.67% (0.0240 => 0.0400, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0520) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0420) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0215) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0442) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0349) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0459) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0559) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0531) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0497) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.44% (48.1088 => 49.2849, std.dev.: 0.1149) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0328) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 2.03% (37.0925 => 37.8446, std.dev.: 0.0914) MultiSource/Applications/kimwitu++/kc: 2.00% (18.8170 => 19.1931, std.dev.: 0.0493) MultiSource/Applications/sqlite3/sqlite3: 1.97% (23.7574 => 24.2255, std.dev.: 0.0461) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0191) MultiSource/Applications/SPASS/SPASS: 1.39% (17.5484 => 17.7924, std.dev.: 0.0580) MultiSource/Applications/ClamAV/clamscan: 1.19% (17.4082 => 17.6162, std.dev.: 0.0254) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.89% (1.6601 => 1.7081, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 2.84% (21.1533 => 21.7534, std.dev.: 0.1130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0028) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0486) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 26 00:42:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 26 Apr 2014 00:42:20 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase2 - living Message-ID: <20140426074231.D9DBF4FFC5F1@lab.llvm.org> The Buildbot has detected a restored build on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7569 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207306 Blamelist: adibiagio,adrian,andersg,anemet,arsenm,bogner,brasmi01,chandlerc,compnerd,ctopper,d0k,dblaikie,dexonsmith,dvyukov,eugenis,filcab,ghoflehner,glider,gribozavr,hans,jiangning,karthik,kcc,kevinqin,majnemer,mren,nicholas,nico,qcolombet,rafael,ributzka,rkotler,rnk,rsmith,samsonov,tfiala,tilmann,tmroeder,tnorthover,whunt Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sat Apr 26 00:51:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 02:51:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426075104.3BDE12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24992?compare_to=24991&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24992, Order: 207304, Start Time: 2014-04-26 03:13:37, End Time: 2014-04-26 07:57:45 To: 24991, Order: 207303, Start Time: 2014-04-26 02:27:11, End Time: 2014-04-26 07:08:44 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (108 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Towers: 27.27% (0.0440 => 0.0560, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 17.39% (0.0920 => 0.1080, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/mst/mst: 11.76% (0.1360 => 0.1520, std.dev.: 0.0062) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.00% (0.4000 => 0.4160, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 1.37% (3.8000 => 3.8521, std.dev.: 0.0166) MultiSource/Applications/treecc/treecc: 1.28% (2.4920 => 2.5240, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.55% (0.2200 => 0.2520, std.dev.: 0.0083) MultiSource/Benchmarks/BitBench/five11/five11: 1.38% (2.3161 => 2.3481, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7081 => 1.7281, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0193) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: 11.76% (0.1360 => 0.1520, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 11.39% (0.3160 => 0.3520, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0649) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0227) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0160) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0435) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0338) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0434) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0386) MultiSource/Applications/treecc/treecc: 3.10% (2.4480 => 2.5240, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0405) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0548) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0323) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.58% (48.1088 => 49.3489, std.dev.: 0.0957) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0425) MultiSource/Benchmarks/Bullet/bullet: 2.41% (37.0925 => 37.9846, std.dev.: 0.0876) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0156) MultiSource/Applications/sqlite3/sqlite3: 2.02% (23.7574 => 24.2375, std.dev.: 0.0430) MultiSource/Applications/oggenc/oggenc: 2.00% (5.7964 => 5.9124, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 1.96% (18.8170 => 19.1851, std.dev.: 0.0393) MultiSource/Applications/ClamAV/clamscan: 1.08% (17.4082 => 17.5962, std.dev.: 0.0457) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0256) MultiSource/Applications/lua/lua: 2.76% (21.1533 => 21.7374, std.dev.: 0.0575) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0191) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.4080 => 0.3720, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.6165 => 8.4765, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.18% (4.0643 => 4.0163, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 01:16:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 03:16:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426081656.858E72A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24993?compare_to=24985&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 24993, Order: 207304, Start Time: 2014-04-26 03:40:45, End Time: 2014-04-26 08:23:41 To: 24985, Order: 207283, Start Time: 2014-04-25 22:53:10, End Time: 2014-04-26 03:36:04 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 11 (158 on baseline) Performance Improvements: 5 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (927 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/UnitTests/Vector/build2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 11.32% (0.2120 => 0.2360, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 1.58% (2.7762 => 2.8202, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.50% (1.6001 => 1.6241, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 4.62% (5.1043 => 5.3403, std.dev.: 0.0588) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.51% (4.1403 => 4.2443, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.29% (5.0723 => 5.1883, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.95% (8.2005 => 8.3605, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.07% (2.1281 => 2.0201, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.65% (4.7123 => 4.5403, std.dev.: 0.0053) MultiSource/Applications/aha/aha: -2.56% (2.6522 => 2.5842, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -2.34% (6.8244 => 6.6644, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0106) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0132) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0095) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/AtomicOps: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/sieve: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0164) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: 13.94% (0.6600 => 0.7520, std.dev.: 0.0157) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/em3d/em3d: 13.46% (0.2080 => 0.2360, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.80% (1.4241 => 1.5921, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.54% (1.4561 => 1.6241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.00% (0.1200 => 0.1320, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.89% (0.3640 => 0.4000, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0139) MultiSource/Applications/obsequi/Obsequi: 9.64% (1.8680 => 2.0480, std.dev.: 0.0166) MultiSource/Applications/sgefa/sgefa: 9.59% (0.5840 => 0.6400, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.45% (1.6081 => 1.7601, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.99% (1.7361 => 1.8921, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.90% (1.5281 => 1.6641, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.11% (1.4801 => 1.6001, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.82% (1.4841 => 1.6001, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (1.1640 => 1.2520, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.36% (1.4681 => 1.5761, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.6921 => 1.8161, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.67% (1.7400 => 1.8560, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (6.4680 => 6.8920, std.dev.: 0.0430) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0221) MultiSource/Applications/Burg/burg: 6.37% (1.5080 => 1.6040, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.22% (11.6440 => 12.3680, std.dev.: 0.0607) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0114) MultiSource/Applications/spiff/spiff: 5.95% (1.0080 => 1.0680, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0184) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.74% (9.4842 => 10.0282, std.dev.: 0.0268) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (5.8121 => 6.1281, std.dev.: 0.0232) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0070) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/EH/except: 4.92% (0.2440 => 0.2560, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (10.0443 => 10.5083, std.dev.: 0.0303) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 4.55% (5.3600 => 5.6040, std.dev.: 0.0273) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0111) MultiSource/Applications/lua/lua: 4.43% (4.7880 => 5.0000, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 4.26% (21.9606 => 22.8968, std.dev.: 0.0424) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 4.12% (6.9844 => 7.2725, std.dev.: 0.0183) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (6.5080 => 6.7600, std.dev.: 0.0417) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 3.83% (2.7162 => 2.8202, std.dev.: 0.0110) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.82% (50.0290 => 51.9410, std.dev.: 0.0880) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (6.5440 => 6.7880, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0134) MultiSource/Applications/SPASS/SPASS: 3.41% (18.4404 => 19.0686, std.dev.: 0.0487) MultiSource/Benchmarks/Bullet/bullet: 3.28% (38.4046 => 39.6646, std.dev.: 0.0865) MultiSource/Applications/minisat/minisat: 3.26% (0.8600 => 0.8880, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.14% (1.0201 => 1.0521, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: 2.70% (19.6891 => 20.2211, std.dev.: 0.0522) MultiSource/Applications/ClamAV/clamscan: 2.67% (19.0444 => 19.5524, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (16.3483 => 16.7683, std.dev.: 0.0430) MultiSource/Applications/d/make_dparser: 2.22% (3.9681 => 4.0561, std.dev.: 0.0301) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (13.0563 => 13.2483, std.dev.: 0.0281) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0202) MultiSource/Applications/sqlite3/sqlite3: 1.04% (25.6856 => 25.9536, std.dev.: 0.0284) MultiSource/Benchmarks/PAQ8p/paq8p: 1.00% (2.7922 => 2.8202, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0462) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0037) MultiSource/Benchmarks/llubenchmark/llu: 4.46% (5.1123 => 5.3403, std.dev.: 0.0588) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.51% (4.1003 => 4.2443, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 2.70% (6.6684 => 6.8484, std.dev.: 0.0265) MultiSource/Applications/sqlite3/sqlite3: 2.21% (3.9842 => 4.0723, std.dev.: 0.0189) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (8.1845 => 8.3605, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (3.9922 => 4.0763, std.dev.: 0.0279) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.5087 => 11.7167, std.dev.: 0.0161) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.99% (10.6247 => 2.0201, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.43% (2.9442 => 0.9000, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.22% (1.5641 => 1.0601, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.10% (91.8497 => 49.5031, std.dev.: 10.2412) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.86% (26.0616 => 16.9771, std.dev.: 0.1420) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.54% (50.3031 => 32.9301, std.dev.: 0.1688) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -33.18% (42.1466 => 28.1618, std.dev.: 0.4027) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1161) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0115) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0178) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 01:26:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 03:26:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426082636.6F5832A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24994?compare_to=24992&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24994, Order: 207306, Start Time: 2014-04-26 03:53:32, End Time: 2014-04-26 08:33:17 To: 24992, Order: 207304, Start Time: 2014-04-26 03:13:37, End Time: 2014-04-26 07:57:45 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (111 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 30.00% (0.0400 => 0.0520, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 5.36% (0.4480 => 0.4720, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 4.05% (0.2960 => 0.3080, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.84% (1.3041 => 1.3281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.50% (1.3321 => 1.3521, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.32% (5.7484 => 5.8244, std.dev.: 0.0184) MultiSource/Applications/lemon/lemon: 1.17% (1.3721 => 1.3881, std.dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.04% (0.2280 => 0.2600, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0597) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0384) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/lists: 5.48% (0.2920 => 0.3080, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0527) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0142) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0189) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (10.4082 => 10.8402, std.dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 3.74% (4.9200 => 5.1040, std.dev.: 0.0563) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0338) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0194) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3480 => 0.3600, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 3.00% (0.8000 => 0.8240, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.4400 => 1.4800, std.dev.: 0.0132) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.69% (48.1088 => 49.4049, std.dev.: 0.0798) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0360) MultiSource/Benchmarks/Bullet/bullet: 2.44% (37.0925 => 37.9966, std.dev.: 0.0886) MultiSource/Applications/sqlite3/sqlite3: 2.42% (23.7574 => 24.3335, std.dev.: 0.0401) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (4.0122 => 4.1043, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 2.15% (18.8170 => 19.2211, std.dev.: 0.0437) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0359) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (1.7080 => 1.7440, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0220) MultiSource/Applications/SPASS/SPASS: 1.50% (17.5484 => 17.8124, std.dev.: 0.0479) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (5.7564 => 5.8244, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (15.2282 => 15.3882, std.dev.: 0.0539) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 3.71% (5.8164 => 6.0324, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0252) MultiSource/Applications/lua/lua: 2.97% (21.1533 => 21.7814, std.dev.: 0.1327) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/cast-bug: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 02:12:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 04:12:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140426091216.1A97B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24995?compare_to=24986&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 24995, Order: 207306, Start Time: 2014-04-26 04:36:06, End Time: 2014-04-26 09:18:56 To: 24986, Order: 207287, Start Time: 2014-04-25 23:48:28, End Time: 2014-04-26 04:31:24 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 11 (171 on baseline) Performance Improvements: 3 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (918 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.67% (0.1800 => 0.1920, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.61% (0.4600 => 0.4720, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (1.0201 => 1.0361, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.55% (1.5521 => 1.5761, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 26.09% (0.0920 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.21% (0.3040 => 0.3320, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.54% (1.1041 => 1.1321, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.06% (4.4723 => 4.5643, std.dev.: 0.0281) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.53% (6.2844 => 6.3804, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.18% (4.0843 => 4.1323, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.09% (5.1683 => 5.0603, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.81% (4.1883 => 4.1123, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0096) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0077) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 994.87% (0.0760 => 0.8321, std.dev.: 0.0066) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0112) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 200.00% (0.2520 => 0.7560, std.dev.: 0.0131) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0057) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0060) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0047) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0037) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0063) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0137) SingleSource/Regression/C/matrixTranspose: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 44.25% (1.3920 => 2.0080, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 33.33% (0.0960 => 0.1280, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.09% (1.2401 => 1.5761, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.10% (1.1401 => 1.3921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.77% (1.1761 => 1.4321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.13% (1.2321 => 1.4801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.86% (1.1881 => 1.4241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.23% (0.1040 => 0.1240, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.94% (1.2881 => 1.5321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 18.42% (8.5802 => 10.1603, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.27% (1.1601 => 1.3721, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.24% (1.1841 => 1.4001, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.91% (0.1760 => 0.2040, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 15.44% (19.5406 => 22.5567, std.dev.: 0.0569) MultiSource/Benchmarks/nbench/nbench: 15.38% (1.3521 => 1.5601, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 14.81% (0.1080 => 0.1240, std.dev.: 0.0060) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.54% (5.3360 => 6.1121, std.dev.: 0.0391) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.56% (1.7400 => 1.9760, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.66% (0.3160 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/health/health: 10.64% (0.1880 => 0.2080, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 9.36% (6.2844 => 6.8724, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.03% (5.6680 => 6.1800, std.dev.: 0.0383) MultiSource/Benchmarks/mafft/pairlocalalign: 8.92% (11.3843 => 12.4003, std.dev.: 0.0501) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.64% (0.6480 => 0.7040, std.dev.: 0.0163) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.56% (11.4440 => 12.4240, std.dev.: 0.0412) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.96% (5.7280 => 6.1840, std.dev.: 0.0345) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.7640 => 0.8200, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.72% (9.5802 => 10.2242, std.dev.: 0.0415) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.65% (1.6240 => 1.7320, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.7360 => 0.7840, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/moments: 6.48% (0.4320 => 0.4600, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0089) MultiSource/Applications/lua/lua: 4.86% (4.7720 => 5.0040, std.dev.: 0.0338) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.4760 => 1.5440, std.dev.: 0.0191) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 3.94% (5.3840 => 5.5960, std.dev.: 0.0498) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (6.8280 => 7.0960, std.dev.: 0.0357) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.79% (49.1529 => 51.0169, std.dev.: 0.0836) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0194) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 3.05% (24.7575 => 25.5136, std.dev.: 0.0478) MultiSource/Applications/ClamAV/clamscan: 2.91% (19.2243 => 19.7844, std.dev.: 0.0643) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0155) MultiSource/Applications/treecc/treecc: 2.57% (2.6480 => 2.7160, std.dev.: 0.0238) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 2.01% (19.7491 => 20.1451, std.dev.: 0.0578) MultiSource/Benchmarks/Bullet/bullet: 1.98% (39.0726 => 39.8446, std.dev.: 0.0667) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (1.0201 => 1.0361, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 1.40% (18.7966 => 19.0605, std.dev.: 0.0432) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0124 => 6.0884, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 18.18% (0.9241 => 1.0921, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0142) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0141) MultiSource/Applications/minisat/minisat: 4.16% (6.8204 => 7.1044, std.dev.: 0.0650) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.00% (1.1001 => 1.1441, std.dev.: 0.0125) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.54% (1.1041 => 1.1321, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.78% (4.0563 => 4.1283, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (25.4536 => 25.8696, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.40% (6.2924 => 6.3804, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0078) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0038) SingleSource/Regression/C/globalrefs: -50.00% (0.0240 => 0.0120, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.48% (21.6534 => 17.8691, std.dev.: 0.0555) SingleSource/Benchmarks/Linpack/linpack-pc: -16.59% (7.8605 => 6.5564, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -11.92% (0.6040 => 0.5320, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: -9.68% (3.4722 => 3.1362, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0730) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.69% (2.9242 => 2.8162, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.66% (0.3280 => 0.3160, std.dev.: 0.0000) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0212) MultiSource/Applications/hexxagon/hexxagon: -1.11% (11.5567 => 11.4287, std.dev.: 0.0167) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 02:24:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 04:24:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140426092423.A01642A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24996?compare_to=24988&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 24996, Order: 207306, Start Time: 2014-04-26 04:45:10, End Time: 2014-04-26 09:31:08 To: 24988, Order: 207287, Start Time: 2014-04-25 23:54:48, End Time: 2014-04-26 04:40:36 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 24 (138 on baseline) Performance Improvements: 6 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1082 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/PR1386: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/div: 80.00% (0.0200 => 0.0360, std.dev.: 0.0030) SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 18.75% (0.1280 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.00% (0.1600 => 0.1840, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.42% (0.1920 => 0.2120, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.00% (0.1200 => 0.1320, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2640 => 0.2880, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 8.33% (0.1920 => 0.2080, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.69% (0.2600 => 0.2800, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.22% (0.7720 => 0.8200, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.12% (0.1960 => 0.2080, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.21% (0.6240 => 0.6440, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 1.38% (4.9440 => 5.0120, std.dev.: 0.0237) MultiSource/Benchmarks/MallocBench/gs/gs: 1.29% (5.5680 => 5.6400, std.dev.: 0.0253) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/spiff/spiff: 3.90% (2.0521 => 2.1321, std.dev.: 0.0213) MultiSource/Applications/obsequi/Obsequi: 2.57% (2.0201 => 2.0721, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.76% (2.7242 => 2.7722, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.05% (4.9563 => 4.6563, std.dev.: 0.0059) MultiSource/Applications/aha/aha: -2.56% (2.6522 => 2.5842, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.48% (4.1963 => 4.0923, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.78% (5.1683 => 5.0763, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -1.25% (6.7324 => 6.6484, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.45% (17.6723 => 19.6964, std.dev.: 0.0611) MultiSource/Applications/sqlite3/sqlite3: 1423.53% (1.7001 => 25.9016, std.dev.: 0.0586) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.02% (50.1010 => 52.1130, std.dev.: 0.0397) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (11.3920 => 12.3480, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0116) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0243, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0085) SingleSource/Regression/C/2003-05-23-TransparentUnion: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2002-08-02-CastTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0060) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 55.56% (0.0360 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0032) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0089) MultiSource/Benchmarks/BitBench/five11/five11: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.13% (0.2480 => 0.2880, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.71% (1.8081 => 2.0921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.81% (1.8361 => 2.1081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.71% (1.8761 => 2.1521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.59% (2.0281 => 2.3241, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.47% (0.3040 => 0.3480, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.64% (2.1121 => 2.4001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1880 => 0.2120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.71% (1.8441 => 2.0601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.58% (1.9001 => 2.1201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.55% (1.8361 => 2.0481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.41% (2.1041 => 2.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.81% (0.7400 => 0.8200, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0148) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0044) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.8760 => 2.0560, std.dev.: 0.0200) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.60% (0.3720 => 0.4040, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.39% (0.7040 => 0.7560, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4920 => 0.5280, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 6.72% (0.4760 => 0.5080, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.17% (6.4800 => 6.8800, std.dev.: 0.0431) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.6960 => 1.7920, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.15% (5.8281 => 6.1281, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.08% (0.7880 => 0.8280, std.dev.: 0.0150) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.81% (1.6641 => 1.7441, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.71% (9.6042 => 10.0562, std.dev.: 0.0549) MultiSource/Applications/hbd/hbd: 4.63% (1.7280 => 1.8080, std.dev.: 0.0126) MultiSource/Applications/lua/lua: 4.59% (4.7920 => 5.0120, std.dev.: 0.0237) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (5.3960 => 5.6400, std.dev.: 0.0253) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0089) MultiSource/Applications/minisat/minisat: 4.25% (0.8480 => 0.8840, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.11% (2.3401 => 2.4362, std.dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.2283 => 10.6324, std.dev.: 0.0469) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.8280 => 0.8600, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (6.5320 => 6.7680, std.dev.: 0.0722) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (6.5360 => 6.7640, std.dev.: 0.0329) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (3.0562 => 3.1522, std.dev.: 0.0096) MultiSource/Applications/SPASS/SPASS: 3.07% (18.5284 => 19.0965, std.dev.: 0.0621) MultiSource/Applications/oggenc/oggenc: 3.06% (7.0524 => 7.2685, std.dev.: 0.0247) MultiSource/Benchmarks/Bullet/bullet: 3.04% (38.6366 => 39.8126, std.dev.: 0.0499) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 2.83% (22.2206 => 22.8487, std.dev.: 0.0481) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (16.3003 => 16.7483, std.dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (4.2243 => 4.3363, std.dev.: 0.0153) MultiSource/Applications/siod/siod: 2.47% (2.7522 => 2.8202, std.dev.: 0.0151) MultiSource/Applications/kimwitu++/kc: 2.42% (19.8291 => 20.3091, std.dev.: 0.0488) MultiSource/Applications/d/make_dparser: 2.21% (3.9761 => 4.0641, std.dev.: 0.0188) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: 18.18% (0.0880 => 0.1040, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.34% (2.1201 => 2.4242, std.dev.: 0.0533) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0346) MultiSource/Applications/spiff/spiff: 7.03% (1.9921 => 2.1321, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.3725 => 7.6765, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0113) MultiSource/Applications/minisat/minisat: 2.55% (6.5964 => 6.7644, std.dev.: 0.0516) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.74% (11.4967 => 11.6967, std.dev.: 0.0203) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.0243 => 5.0763, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.99% (94.8339 => 49.3231, std.dev.: 10.4931) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.05% (49.9431 => 32.9381, std.dev.: 0.1742) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.29% (25.7136 => 17.1531, std.dev.: 0.1225) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.83% (37.0863 => 28.6178, std.dev.: 0.2855) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.15% (1.2681 => 1.1521, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.40% (4.2363 => 4.0923, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.08% (4.8043 => 4.6563, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0197) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 02:39:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 04:39:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426093949.8A13B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24997?compare_to=24989&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 24997, Order: 207306, Start Time: 2014-04-26 04:59:48, End Time: 2014-04-26 09:46:30 To: 24989, Order: 207291, Start Time: 2014-04-26 00:08:40, End Time: 2014-04-26 04:55:12 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 20 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1090 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Regression/C++/BuiltinTypeInfo: 75.00% (0.0160 => 0.0280, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/mason/mason: 26.67% (0.0600 => 0.0760, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 14.29% (0.0840 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.50% (0.1280 => 0.1440, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 12.00% (0.1000 => 0.1120, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 8.33% (0.2400 => 0.2600, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 4.15% (1.0600 => 1.1040, std.dev.: 0.0164) MultiSource/Applications/hexxagon/hexxagon: 3.09% (1.1640 => 1.2000, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (1.1280 => 1.1520, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 1.62% (4.9280 => 5.0080, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.61% (1.7441 => 1.7721, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.16% (8.7205 => 8.9086, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.72% (3.9482 => 4.0163, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.43% (1.6841 => 1.7081, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.34% (4.4883 => 4.5483, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/matrix: -1.63% (3.1842 => 3.1322, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.73% (0.7280 => 0.5480, std.dev.: 0.0124) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 03:19:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 05:19:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140426101921.7F3AE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24998?compare_to=24990&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 24998, Order: 207306, Start Time: 2014-04-26 05:37:40, End Time: 2014-04-26 10:26:03 To: 24990, Order: 207296, Start Time: 2014-04-26 00:44:56, End Time: 2014-04-26 05:33:06 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (130 on baseline) Performance Improvements: 3 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/stmtexpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 8.16% (0.1960 => 0.2120, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.38% (0.1880 => 0.2000, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.4520 => 0.4680, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/nestedloop: 1.37% (1.1681 => 1.1841, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.64% (4.0843 => 4.1923, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.55% (0.9401 => 0.9641, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.29% (5.0763 => 5.1923, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.15% (1.3041 => 1.3321, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.8042 => 3.7122, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.7081 => 1.6881, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 295.64% (0.4560 => 1.8041, std.dev.: 0.0096) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0047) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.39% (0.1640 => 0.2040, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.48% (1.6761 => 2.0361, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.99% (1.6961 => 2.0521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.92% (1.9881 => 2.3841, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.91% (1.8281 => 2.1921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.86% (1.6921 => 2.0281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.70% (1.8881 => 2.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.62% (1.6721 => 2.0001, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.46% (1.8201 => 2.1561, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0080) SingleSource/Regression/C/sumarraymalloc: 18.18% (0.0880 => 0.1040, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.16% (1.9601 => 2.3161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.69% (0.6120 => 0.7080, std.dev.: 0.0222) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: 12.77% (0.1880 => 0.2120, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.54% (0.3280 => 0.3560, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.11% (0.1480 => 0.1600, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0189) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (6.7200 => 7.1760, std.dev.: 0.0507) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (11.7880 => 12.5680, std.dev.: 0.0530) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (1.5240 => 1.6160, std.dev.: 0.0221) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.00% (0.2000 => 0.2120, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.7800 => 0.8240, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.61% (0.7840 => 0.8280, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (1.2400 => 1.3080, std.dev.: 0.0253) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0094) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.22% (2.0680 => 2.1760, std.dev.: 0.0196) MultiSource/Applications/lua/lua: 5.01% (4.7920 => 5.0320, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.84% (0.2480 => 0.2600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (9.9842 => 10.4322, std.dev.: 0.0405) MultiSource/Applications/d/make_dparser: 4.44% (3.9641 => 4.1401, std.dev.: 0.0315) MultiSource/Applications/oggenc/oggenc: 4.28% (6.9124 => 7.2085, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.23% (0.7560 => 0.7880, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0082) MultiSource/Applications/treecc/treecc: 3.97% (2.6200 => 2.7240, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 3.70% (18.4924 => 19.1767, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 3.61% (10.3203 => 10.6924, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (6.8321 => 7.0721, std.dev.: 0.0319) MultiSource/Applications/JM/lencod/lencod: 2.88% (22.6287 => 23.2808, std.dev.: 0.0624) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.82% (51.1089 => 52.5489, std.dev.: 0.1148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1560 => 2.2160, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: 2.76% (19.7371 => 20.2811, std.dev.: 0.0429) MultiSource/Benchmarks/Bullet/bullet: 2.58% (38.9366 => 39.9406, std.dev.: 0.0912) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (2.0440 => 2.0960, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (5.5480 => 5.6840, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (3.0122 => 3.0802, std.dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 2.25% (20.2445 => 20.7005, std.dev.: 0.0797) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (16.5963 => 16.9563, std.dev.: 0.0499) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.06% (6.0244 => 6.1484, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: 2.02% (25.1895 => 25.6976, std.dev.: 0.0336) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 10.18% (2.8282 => 3.1162, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0144) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0097) MultiSource/Applications/minisat/minisat: 3.23% (6.8204 => 7.0404, std.dev.: 0.0573) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (4.2443 => 4.3403, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.88% (5.0963 => 5.1923, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0151) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/nestedloop: -60.05% (2.9642 => 1.1841, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.44% (1.5881 => 1.1841, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: -20.85% (2.6481 => 2.0960, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.42% (7.5041 => 6.2720, std.dev.: 0.0649) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.42% (7.4801 => 6.2520, std.dev.: 0.0366) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0058) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -2.34% (13.5243 => 13.2083, std.dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.48% (21.6534 => 17.8691, std.dev.: 0.0438) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.66% (3.4442 => 3.0082, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.33% (0.9281 => 0.8601, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0050) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0179) MultiSource/Applications/lambda-0_1_3/lambda: -2.95% (5.1603 => 5.0083, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -1.75% (11.6527 => 11.4487, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.34% (4.7603 => 4.6963, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.17% (1.3681 => 1.3521, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 03:38:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 05:38:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426103800.E77C52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/24999?compare_to=24994&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 24999, Order: 207308, Start Time: 2014-04-26 06:03:35, End Time: 2014-04-26 10:44:40 To: 24994, Order: 207306, Start Time: 2014-04-26 03:53:32, End Time: 2014-04-26 08:33:17 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (105 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.00% (0.0800 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 7.14% (0.2240 => 0.2400, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.63% (1.2241 => 1.2441, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 28.57% (0.0560 => 0.0720, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/strcat: 23.33% (0.1200 => 0.1480, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) MultiSource/Benchmarks/llubenchmark/llu: 3.51% (5.2403 => 5.4243, std.dev.: 0.0573) MultiSource/Benchmarks/BitBench/five11/five11: 1.56% (2.3081 => 2.3441, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0608) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0362) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0150) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0377) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0376) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0184) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0352) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0415) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0682) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0139) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.11% (48.1088 => 49.1249, std.dev.: 0.0889) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0136) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0158) MultiSource/Benchmarks/Bullet/bullet: 1.85% (37.0925 => 37.7805, std.dev.: 0.0767) MultiSource/Applications/sqlite3/sqlite3: 1.75% (23.7574 => 24.1735, std.dev.: 0.0398) MultiSource/Applications/SPASS/SPASS: 1.60% (17.5484 => 17.8284, std.dev.: 0.0261) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 1.23% (18.8170 => 19.0490, std.dev.: 0.0599) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0070) MultiSource/Benchmarks/llubenchmark/llu: 4.39% (5.1963 => 5.4243, std.dev.: 0.0573) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0511) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0230) MultiSource/Applications/lua/lua: 3.08% (21.1533 => 21.8054, std.dev.: 0.1373) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (4.0643 => 4.1123, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0094) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 03:52:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 05:52:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426105201.DE75D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25000?compare_to=24999&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25000, Order: 207309, Start Time: 2014-04-26 06:17:23, End Time: 2014-04-26 10:58:42 To: 24999, Order: 207308, Start Time: 2014-04-26 06:03:35, End Time: 2014-04-26 10:44:40 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (110 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (978 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 27.78% (0.0720 => 0.0920, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.52% (0.1680 => 0.1840, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1440 => 0.1560, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.48% (1.3481 => 1.3681, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.00% (0.1600 => 0.1840, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0185) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: 10.81% (0.1480 => 0.1640, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0125) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0717) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.60% (1.2121 => 1.2921, std.dev.: 0.0171) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0432) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0270) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (5.8000 => 6.0760, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0196) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0429) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0155) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0284) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0180) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0352) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0437) MultiSource/Applications/JM/lencod/lencod: 2.38% (17.6165 => 18.0365, std.dev.: 0.0519) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0085) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1169, std.dev.: 0.0741) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 1.82% (37.0925 => 37.7685, std.dev.: 0.0819) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (7.8562 => 7.9962, std.dev.: 0.0365) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 1.40% (18.8170 => 19.0811, std.dev.: 0.0398) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0296) MultiSource/Applications/sqlite3/sqlite3: 1.31% (23.7574 => 24.0695, std.dev.: 0.0492) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 2.95% (21.1533 => 21.7774, std.dev.: 0.0705) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0027) MultiSource/Applications/obsequi/Obsequi: 1.93% (2.0681 => 2.1081, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0284) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0517) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -15.79% (0.0760 => 0.0640, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 06:02:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 08:02:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426130254.C0C402A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25001?compare_to=24993&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25001, Order: 207309, Start Time: 2014-04-26 08:26:55, End Time: 2014-04-26 13:09:34 To: 24993, Order: 207304, Start Time: 2014-04-26 03:40:45, End Time: 2014-04-26 08:23:41 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (146 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/spiff/spiff: 3.59% (2.0081 => 2.0801, std.dev.: 0.0227) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.15% (1.1161 => 1.1401, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.09% (1.4681 => 1.4841, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.29% (11.3687 => 3.0362, std.dev.: 0.0106) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0160) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0129) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0052) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C/sumarraymalloc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/UnitTests/2002-05-02-CastTest: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 29.41% (0.0680 => 0.0880, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0059) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/15-trie/trie: 21.43% (0.0560 => 0.0680, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0205) SingleSource/Benchmarks/Stanford/Oscar: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.84% (0.6200 => 0.7120, std.dev.: 0.0283) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1760 => 0.2000, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/em3d/em3d: 13.46% (0.2080 => 0.2360, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.4240 => 0.4680, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.14% (1.4601 => 1.6081, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.97% (1.1640 => 1.2800, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0119) MultiSource/Applications/obsequi/Obsequi: 9.42% (1.8680 => 2.0440, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0125) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.36% (1.4841 => 1.6081, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.24% (1.1160 => 1.2080, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.9800 => 1.0600, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0185) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.43% (0.7000 => 0.7520, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.34% (1.5801 => 1.6961, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0107) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0091) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.87% (1.4561 => 1.5561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.67% (0.1800 => 0.1920, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.64% (1.0240 => 1.0920, std.dev.: 0.0245) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (11.6440 => 12.3800, std.dev.: 0.0509) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.20% (1.6121 => 1.7121, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.71% (5.8121 => 6.1441, std.dev.: 0.0300) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (9.4842 => 10.0202, std.dev.: 0.0294) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.44% (6.4680 => 6.8200, std.dev.: 0.0489) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.40% (6.5440 => 6.8320, std.dev.: 0.0348) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.7400 => 1.8120, std.dev.: 0.0246) MultiSource/Applications/JM/lencod/lencod: 4.06% (21.9606 => 22.8528, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (6.5080 => 6.7720, std.dev.: 0.0361) MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (1.7921 => 1.8641, std.dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 3.94% (10.0443 => 10.4403, std.dev.: 0.0424) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0158) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0111) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4720 => 0.4880, std.dev.: 0.0049) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.29% (50.0290 => 51.6730, std.dev.: 0.1026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.09% (4.7880 => 4.9360, std.dev.: 0.0360) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (5.3600 => 5.5240, std.dev.: 0.0508) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (3.0282 => 3.1202, std.dev.: 0.0147) MultiSource/Applications/SPASS/SPASS: 2.91% (18.4404 => 18.9764, std.dev.: 0.0512) MultiSource/Benchmarks/Bullet/bullet: 2.80% (38.4046 => 39.4806, std.dev.: 0.0770) MultiSource/Applications/hbd/hbd: 2.76% (1.7360 => 1.7840, std.dev.: 0.0147) MultiSource/Benchmarks/nbench/nbench: 2.71% (1.7721 => 1.8201, std.dev.: 0.0148) MultiSource/Applications/siod/siod: 2.36% (2.7162 => 2.7802, std.dev.: 0.0185) MultiSource/Applications/ClamAV/clamscan: 2.25% (19.0444 => 19.4724, std.dev.: 0.0730) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.3483 => 16.7003, std.dev.: 0.0436) MultiSource/Applications/kimwitu++/kc: 1.81% (19.6891 => 20.0451, std.dev.: 0.0683) MultiSource/Applications/d/make_dparser: 1.71% (3.9681 => 4.0361, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.52% (2.1401 => 2.4722, std.dev.: 0.0446) MultiSource/Applications/siod/siod: 10.63% (2.8602 => 3.1642, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.51% (4.1003 => 4.2443, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0438) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4205 => 7.5805, std.dev.: 0.0239) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (8.1845 => 8.3605, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (3.9922 => 4.0723, std.dev.: 0.0253) MultiSource/Applications/JM/lencod/lencod: 1.97% (8.1245 => 8.2845, std.dev.: 0.0184) MultiSource/Applications/sqlite3/sqlite3: 1.81% (3.9842 => 4.0563, std.dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: 1.67% (11.5087 => 11.7007, std.dev.: 0.0179) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.75% (2.9442 => 0.9200, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.43% (91.8497 => 49.2071, std.dev.: 10.0890) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.77% (26.0616 => 17.0011, std.dev.: 0.1490) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.31% (50.3031 => 33.0421, std.dev.: 0.1903) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.90% (42.1466 => 28.7018, std.dev.: 0.2884) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1170) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0055) SingleSource/Benchmarks/Linpack/linpack-pc: -14.44% (7.7845 => 6.6604, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.09% (1.2481 => 1.1721, std.dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/five11/five11: -2.38% (2.3561 => 2.3001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.75% (4.1243 => 4.0523, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0188) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 06:58:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 08:58:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426135847.4DAA12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25002?compare_to=25000&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25002, Order: 207310, Start Time: 2014-04-26 09:22:01, End Time: 2014-04-26 14:05:30 To: 25000, Order: 207309, Start Time: 2014-04-26 06:17:23, End Time: 2014-04-26 10:58:42 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (105 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ackermann: 133.33% (0.0120 => 0.0280, std.dev.: 0.0047) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 22.73% (0.0880 => 0.1080, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.2760 => 0.2960, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.17% (1.2881 => 1.3161, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 6.47% (3.3362 => 3.5522, std.dev.: 0.0766) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0097) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.13% (10.6960 => 11.3520, std.dev.: 0.0747) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0138) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0392) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0369) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0274) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0408) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0321) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 1.73% (37.0925 => 37.7325, std.dev.: 0.0593) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0084) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.63% (48.1088 => 48.8929, std.dev.: 0.1059) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (7.8562 => 7.9762, std.dev.: 0.0434) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 1.38% (23.7574 => 24.0855, std.dev.: 0.0492) MultiSource/Applications/kimwitu++/kc: 1.32% (18.8170 => 19.0650, std.dev.: 0.0471) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0205) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0213) MultiSource/Applications/lua/lua: 2.84% (21.1533 => 21.7534, std.dev.: 0.0629) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.70% (0.4440 => 0.4560, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0208) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0669) MultiSource/Applications/minisat/minisat: 1.26% (6.6564 => 6.7404, std.dev.: 0.0252) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 06:59:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 08:59:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140426135904.895BB2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25003?compare_to=24995&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25003, Order: 207310, Start Time: 2014-04-26 09:23:01, End Time: 2014-04-26 14:05:49 To: 24995, Order: 207306, Start Time: 2014-04-26 04:36:06, End Time: 2014-04-26 09:18:56 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (157 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.64% (0.1880 => 0.2080, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.33% (0.3000 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.61% (0.4600 => 0.4720, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/nestedloop: 1.53% (0.7920 => 0.8041, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.40% (1.4241 => 1.4441, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.7401 => 1.7601, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.36% (0.8481 => 0.8681, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2412.81% (0.0320 => 0.8041, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0104) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 994.87% (0.0760 => 0.8321, std.dev.: 0.0067) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0109) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0154) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0069) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0080) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0059) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: 41.95% (1.3920 => 1.9760, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 28.57% (0.0560 => 0.0720, std.dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.79% (1.1761 => 1.4441, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.13% (1.2321 => 1.4801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.87% (1.2281 => 1.4721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 17.93% (1.1601 => 1.3681, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 17.67% (8.5802 => 10.0963, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 17.21% (1.2321 => 1.4441, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 15.05% (19.5406 => 22.4807, std.dev.: 0.0524) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.94% (5.3360 => 6.0801, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0083) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.57% (1.7400 => 1.9240, std.dev.: 0.0254) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 8.85% (11.3843 => 12.3923, std.dev.: 0.0424) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 8.59% (6.2844 => 6.8244, std.dev.: 0.0234) MultiSource/Benchmarks/McCat/05-eks/eks: 8.50% (0.6120 => 0.6640, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (5.6680 => 6.1480, std.dev.: 0.0362) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.24% (5.7280 => 6.2000, std.dev.: 0.0414) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.10% (11.4440 => 12.2560, std.dev.: 0.0811) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.50% (1.4760 => 1.5720, std.dev.: 0.0219) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (9.5802 => 10.1522, std.dev.: 0.0585) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.76% (0.7640 => 0.8080, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.6240 => 1.7000, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0100) MultiSource/Applications/lua/lua: 4.11% (4.7720 => 4.9680, std.dev.: 0.0348) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.04% (6.8280 => 7.1040, std.dev.: 0.0373) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.80% (0.3160 => 0.3280, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.6961 => 1.7601, std.dev.: 0.0062) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (1.3400 => 1.3840, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3840 => 5.5560, std.dev.: 0.0442) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.11% (49.1529 => 50.6809, std.dev.: 0.0960) MultiSource/Applications/minisat/minisat: 2.87% (0.8360 => 0.8600, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 2.70% (19.2243 => 19.7443, std.dev.: 0.0519) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 2.36% (24.7575 => 25.3415, std.dev.: 0.0520) MultiSource/Applications/kimwitu++/kc: 1.46% (19.7491 => 20.0371, std.dev.: 0.0403) MultiSource/Benchmarks/Bullet/bullet: 1.17% (39.0726 => 39.5286, std.dev.: 0.0577) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0131) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.54% (3.9842 => 4.3243, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.67% (0.3000 => 0.3200, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0229) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0238) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 3.93% (6.8204 => 7.0884, std.dev.: 0.0390) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.17% (1.1041 => 1.1281, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.78% (4.0563 => 4.1283, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (25.4536 => 25.8696, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4802 => 3.5322, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.0443 => 4.0963, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0200 => 0.0000, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6534 => 17.8851, std.dev.: 0.0645) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: -9.68% (3.4722 => 3.1362, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0781) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.37% (1.7121 => 1.6201, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.10% (2.9242 => 2.8042, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -3.43% (0.7000 => 0.6760, std.dev.: 0.0090) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0239) MultiSource/Applications/lambda-0_1_3/lambda: -1.96% (5.0963 => 4.9963, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/ary3: -1.01% (3.5682 => 3.5322, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 07:13:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 09:13:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140426141305.5A2482A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25004?compare_to=24996&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25004, Order: 207310, Start Time: 2014-04-26 09:34:26, End Time: 2014-04-26 14:19:50 To: 24996, Order: 207306, Start Time: 2014-04-26 04:45:10, End Time: 2014-04-26 09:31:08 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 12 (132 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0039) SingleSource/Regression/C/badidx: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.00% (0.0400 => 0.0560, std.dev.: 0.0062) SingleSource/Regression/C/casts: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 12.50% (0.1920 => 0.2160, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 3.11% (0.6440 => 0.6640, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 16.67% (0.1200 => 0.1400, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.63% (2.4242 => 2.5122, std.dev.: 0.0290) MultiSource/Applications/sgefa/sgefa: 3.10% (0.5160 => 0.5320) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.12% (20.3091 => 20.0811, std.dev.: 0.0440) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.98% (17.6723 => 19.6123, std.dev.: 0.0405) MultiSource/Applications/sqlite3/sqlite3: 1414.59% (1.7001 => 25.7496, std.dev.: 0.0411) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.34% (50.1010 => 51.7730, std.dev.: 0.0788) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0286) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.88% (11.3920 => 12.4040, std.dev.: 0.0632) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0078) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0243, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0094) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0068) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Regression/C/casts: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 30.00% (0.0800 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.00% (0.1920 => 0.2400, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.81% (1.9721 => 2.2641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.69% (1.9601 => 2.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.16% (1.8921 => 2.1601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.94% (1.8361 => 2.0921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.55% (1.8601 => 2.1121, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.76% (1.9121 => 2.1561, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0157) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.54% (0.4160 => 0.4640, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0096) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (1.8361 => 2.0361, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.75% (1.8601 => 2.0601, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.25% (2.0681 => 2.2801, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.19% (1.0880 => 1.1880, std.dev.: 0.0240) MultiSource/Applications/obsequi/Obsequi: 8.96% (1.8760 => 2.0440, std.dev.: 0.0228) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0172) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 7.79% (0.6160 => 0.6640, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4920 => 0.5240, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 6.38% (0.3760 => 0.4000, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (6.4800 => 6.8760, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (2.9721 => 3.1202, std.dev.: 0.0333) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.6960 => 1.7760, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (5.8281 => 6.0761, std.dev.: 0.0273) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (9.6042 => 10.0082, std.dev.: 0.0427) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (6.5320 => 6.7640, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (6.5360 => 6.7680, std.dev.: 0.0295) MultiSource/Applications/SIBsim4/SIBsim4: 3.36% (1.7841 => 1.8441, std.dev.: 0.0205) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (10.2283 => 10.5684, std.dev.: 0.0493) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (5.3960 => 5.5640, std.dev.: 0.0372) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.08% (1.3000 => 1.3400, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.5040 => 1.5480, std.dev.: 0.0142) MultiSource/Applications/lua/lua: 2.75% (4.7920 => 4.9240, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (16.3003 => 16.7403, std.dev.: 0.0495) MultiSource/Applications/SPASS/SPASS: 2.48% (18.5284 => 18.9885, std.dev.: 0.0550) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.34% (1.0241 => 1.0481, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.31% (38.6366 => 39.5286, std.dev.: 0.0568) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2243 => 4.3203, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 1.98% (22.2206 => 22.6607, std.dev.: 0.0635) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 1.27% (19.8291 => 20.0811, std.dev.: 0.0440) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.49% (2.1201 => 2.5122, std.dev.: 0.0290) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 3.69% (7.3725 => 7.6445, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0108) MultiSource/Applications/minisat/minisat: 3.27% (6.5964 => 6.8124, std.dev.: 0.0384) MultiSource/Applications/sgefa/sgefa: 2.31% (0.5200 => 0.5320) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.4967 => 11.7047, std.dev.: 0.0166) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0094) MultiSource/Applications/JM/lencod/lencod: 1.48% (8.1285 => 8.2485, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.3801 => 1.4001, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.20% (8.3605 => 8.4605, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0159) SingleSource/UnitTests/printargs: -60.00% (0.0200 => 0.0080, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.26% (94.8339 => 49.0711, std.dev.: 9.5781) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.71% (49.9431 => 33.1061, std.dev.: 0.0903) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.63% (25.7136 => 17.0651, std.dev.: 0.0995) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.34% (37.0863 => 28.8018, std.dev.: 0.2771) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.40% (4.2363 => 4.0923, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.91% (4.8043 => 4.6643, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 07:15:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 09:15:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426141504.22DE02A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25005?compare_to=25002&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25005, Order: 207311, Start Time: 2014-04-26 09:42:04, End Time: 2014-04-26 14:21:47 To: 25002, Order: 207310, Start Time: 2014-04-26 09:22:01, End Time: 2014-04-26 14:05:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (100 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/exptree: 18.18% (0.0880 => 0.1040, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.98% (0.1720 => 0.1840, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.38% (0.7440 => 0.7840, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash2: 2.48% (0.4840 => 0.4960, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.84% (1.3041 => 1.3281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.52% (1.3121 => 1.3321, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.49% (1.3401 => 1.3601, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.16% (11.3520 => 11.4840, std.dev.: 0.0467) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 40.00% (0.0400 => 0.0560, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.72% (0.7360 => 0.7560, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.17% (3.4162 => 3.4562, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0158) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.57% (1.2121 => 1.3281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0467) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0400) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0599) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.71% (0.7640 => 0.8000, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0322) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.36% (5.8400 => 6.0360, std.dev.: 0.0352) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.90% (5.8000 => 5.9680, std.dev.: 0.0594) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0102) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1209, std.dev.: 0.0876) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 1.78% (37.0925 => 37.7526, std.dev.: 0.1024) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (7.8562 => 7.9842, std.dev.: 0.0437) MultiSource/Applications/sqlite3/sqlite3: 1.58% (23.7574 => 24.1335, std.dev.: 0.0274) MultiSource/Applications/kimwitu++/kc: 1.19% (18.8170 => 19.0410, std.dev.: 0.0520) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0179) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.85% (0.7280 => 0.7560, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (25.8896 => 26.7297, std.dev.: 0.0358) MultiSource/Applications/lua/lua: 3.06% (21.1533 => 21.8014, std.dev.: 0.0402) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4842 => 3.5322, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.13% (1.0641 => 1.0761, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.68% (10.8967 => 1.9961, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -20.00% (0.0600 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: -9.09% (0.1760 => 0.1600, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 07:29:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 09:29:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426142917.6AD9D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25006?compare_to=24997&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25006, Order: 207311, Start Time: 2014-04-26 09:49:48, End Time: 2014-04-26 14:36:01 To: 24997, Order: 207306, Start Time: 2014-04-26 04:59:48, End Time: 2014-04-26 09:46:30 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1095 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Applications/aha/aha: 17.24% (0.1160 => 0.1360, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 7.22% (0.3880 => 0.4160, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.14% (0.1680 => 0.1800, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 4.40% (0.3640 => 0.3800, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.57% (1.7801 => 1.8081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.38% (1.7441 => 1.7681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.16% (1.7281 => 1.7481, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.13% (0.3120 => 0.3280, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 4.69% (0.5120 => 0.5360, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 3.47% (2.1921 => 2.2681, std.dev.: 0.0245) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (2.8242 => 2.7882, std.dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0115) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 07:36:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 09:36:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426143649.526E52A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25007?compare_to=25005&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25007, Order: 207312, Start Time: 2014-04-26 10:02:08, End Time: 2014-04-26 14:43:32 To: 25005, Order: 207311, Start Time: 2014-04-26 09:42:04, End Time: 2014-04-26 14:21:47 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (104 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/lowercase: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.76% (0.1640 => 0.1800, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.94% (0.5080 => 0.5280, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.4160 => 0.4320, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.6321 => 1.6641, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.24% (3.4882 => 3.6362, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (0.9721 => 0.9961, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: -16.13% (0.1240 => 0.1040, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/pi: -1.62% (0.7400 => 0.7280, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (10.6960 => 11.3760, std.dev.: 0.0769) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0175) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0476) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.9880 => 1.0320, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0308) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0303) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0619) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (5.8400 => 6.0040, std.dev.: 0.0435) MultiSource/Applications/JM/lencod/lencod: 2.50% (17.6165 => 18.0565, std.dev.: 0.0610) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.96% (48.1088 => 49.0530, std.dev.: 0.1141) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.6321 => 1.6641, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 1.91% (37.0925 => 37.8006, std.dev.: 0.0577) MultiSource/Applications/sqlite3/sqlite3: 1.58% (23.7574 => 24.1335, std.dev.: 0.0417) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0850, std.dev.: 0.0383) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0414) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.80% (0.7360 => 0.7640, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.06% (21.1533 => 21.8014, std.dev.: 0.0508) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.94% (3.5322 => 3.6362, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0248) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0537) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 08:16:43 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 10:16:43 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140426151643.258682A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25008?compare_to=24998&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25008, Order: 207313, Start Time: 2014-04-26 10:34:43, End Time: 2014-04-26 15:23:26 To: 24998, Order: 207306, Start Time: 2014-04-26 05:37:40, End Time: 2014-04-26 10:26:03 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (131 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1107 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 18.75% (0.0640 => 0.0760, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.10% (2.3441 => 2.4402, std.dev.: 0.0168) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0088) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0056) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.31% (1.7921 => 2.1561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.91% (1.8081 => 2.1681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.86% (1.7321 => 2.0761, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.86% (1.6921 => 2.0281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.62% (1.6921 => 2.0241, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.52% (1.6801 => 2.0081, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.11% (1.9881 => 2.3681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.85% (1.8881 => 2.2441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.84% (1.7201 => 2.0441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.56% (1.7241 => 2.0441, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.8281 => 2.1641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.30% (1.8361 => 2.1721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.07% (0.1640 => 0.1920, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0072) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 6.90% (0.3480 => 0.3720, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.86% (3.5002 => 3.7402, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (11.7880 => 12.4760, std.dev.: 0.0863) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (6.7200 => 7.1080, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (1.6481 => 1.7321, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0250) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0133) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0246) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (9.9842 => 10.4322, std.dev.: 0.0439) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0317) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.1440 => 1.1920, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 3.99% (6.9124 => 7.1884, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (6.8321 => 7.0841, std.dev.: 0.0353) MultiSource/Applications/SPASS/SPASS: 3.22% (18.4924 => 19.0885, std.dev.: 0.0468) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (10.3203 => 10.6443, std.dev.: 0.0370) MultiSource/Applications/d/make_dparser: 3.13% (3.9641 => 4.0881, std.dev.: 0.0290) MultiSource/Applications/JM/lencod/lencod: 2.53% (22.6287 => 23.2007, std.dev.: 0.0478) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.50% (51.1089 => 52.3889, std.dev.: 0.1465) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 2.30% (38.9366 => 39.8326, std.dev.: 0.0454) MultiSource/Applications/kimwitu++/kc: 2.25% (19.7371 => 20.1811, std.dev.: 0.0422) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (5.5480 => 5.6720, std.dev.: 0.0467) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (16.5963 => 16.9323, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (3.0122 => 3.0722, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0130) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.0244 => 6.1364, std.dev.: 0.0118) MultiSource/Applications/ClamAV/clamscan: 1.86% (20.2445 => 20.6205, std.dev.: 0.0892) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 1.21% (25.1895 => 25.4935, std.dev.: 0.0456) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 17.24% (0.9281 => 1.0881, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.99% (1.2681 => 1.4201, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.77% (0.2600 => 0.2880, std.dev.: 0.0103) MultiSource/Applications/siod/siod: 10.18% (2.8282 => 3.1162, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.12% (1.6521 => 1.7201, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.04% (1.0881 => 1.1321, std.dev.: 0.0142) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0381) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.44% (3.4842 => 3.6042, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.73% (5.0963 => 5.1843, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (1.2921 => 1.3121, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.39% (4.0203 => 4.0763, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0923 => 4.1363, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-04-17-PrintfChar: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.83% (6.2884 => 0.8280, std.dev.: 0.0180) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.67% (3.1762 => 1.3761, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: -22.21% (2.6481 => 2.0600, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.47% (7.4801 => 6.2480, std.dev.: 0.0335) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.67% (7.5041 => 6.3280, std.dev.: 0.0446) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -2.87% (13.5243 => 13.1363, std.dev.: 0.0325) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.48% (21.6534 => 17.8691, std.dev.: 0.0394) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.36% (2.6082 => 2.3641, std.dev.: 0.0910) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0064) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.66% (0.3280 => 0.3160, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -3.30% (2.9122 => 2.8162, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -3.26% (5.1603 => 4.9923, std.dev.: 0.0242) MultiSource/Applications/viterbi/viterbi: -2.94% (2.7242 => 2.6442, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.52% (4.6083 => 4.4923, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.98% (2.6202 => 2.5682, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.47% (2.4522 => 2.4162, std.dev.: 0.0131) MultiSource/Benchmarks/sim/sim: -1.12% (4.9883 => 4.9323, std.dev.: 0.0142) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 08:26:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 10:26:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426152631.571CC2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25009?compare_to=25007&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25009, Order: 207313, Start Time: 2014-04-26 10:53:17, End Time: 2014-04-26 15:33:16 To: 25007, Order: 207312, Start Time: 2014-04-26 10:02:08, End Time: 2014-04-26 14:43:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (111 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-LocalTypeTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 7.32% (0.3280 => 0.3520, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.3280 => 0.3440, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/pi: 1.65% (0.7280 => 0.7400, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.04% (2.3081 => 2.3321, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: -80.00% (0.0200 => 0.0040, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 133.33% (0.0120 => 0.0280, std.dev.: 0.0059) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0050) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 11.39% (0.3160 => 0.3520, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.3200 => 0.3440, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0673) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0334) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 6.07% (0.9880 => 1.0480, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0199) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0400) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0229) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0394) MultiSource/Applications/JM/lencod/lencod: 2.18% (17.6165 => 18.0005, std.dev.: 0.0544) MultiSource/Benchmarks/Bullet/bullet: 2.09% (37.0925 => 37.8685, std.dev.: 0.0512) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0380) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0165) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.00% (48.1088 => 49.0689, std.dev.: 0.0987) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0175) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0379) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0157) MultiSource/Applications/sqlite3/sqlite3: 1.35% (23.7574 => 24.0775, std.dev.: 0.0511) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0481) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 3.01% (21.1533 => 21.7894, std.dev.: 0.0403) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0168) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0353) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 10:01:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 12:01:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426170131.CA95C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25010?compare_to=25009&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25010, Order: 207315, Start Time: 2014-04-26 12:27:14, End Time: 2014-04-26 17:08:13 To: 25009, Order: 207313, Start Time: 2014-04-26 10:53:17, End Time: 2014-04-26 15:33:16 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (107 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 200.00% (0.0080 => 0.0240, std.dev.: 0.0022) SingleSource/UnitTests/2003-04-22-Switch: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Oscar: 30.77% (0.0520 => 0.0680, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.39% (0.0920 => 0.1080, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.12% (0.1320 => 0.1480, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 8.62% (0.2320 => 0.2520, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.69% (0.3120 => 0.3360, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.77% (1.3561 => 1.3801, std.dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 2.53% (1.1081 => 1.1361, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0052) SingleSource/UnitTests/2003-04-22-Switch: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.53% (0.3040 => 0.3360, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.69% (1.1961 => 1.2881, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.4120 => 0.4400, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (10.6960 => 11.3960, std.dev.: 0.0783) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0507) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0476) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (4.9200 => 5.1320, std.dev.: 0.0435) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0217) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0281) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0376) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0417) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 2.41% (17.6165 => 18.0405, std.dev.: 0.0773) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.20% (48.1088 => 49.1689, std.dev.: 0.0861) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0491) MultiSource/Benchmarks/Bullet/bullet: 1.92% (37.0925 => 37.8046, std.dev.: 0.1275) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.6321 => 1.6601, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1130, std.dev.: 0.0391) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0158) MultiSource/Applications/SPASS/SPASS: 1.25% (17.5484 => 17.7684, std.dev.: 0.0522) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0461) MultiSource/Applications/lua/lua: 2.89% (21.1533 => 21.7654, std.dev.: 0.1465) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.73% (3.9202 => 3.8522, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 10:54:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 12:54:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426175404.79FA72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25011?compare_to=25001&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25011, Order: 207315, Start Time: 2014-04-26 13:18:05, End Time: 2014-04-26 18:00:49 To: 25001, Order: 207309, Start Time: 2014-04-26 08:26:55, End Time: 2014-04-26 13:09:34 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 21 (150 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-03-NotTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/factor: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/UnitTests/2003-08-11-VaListArg: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 7.35% (0.2720 => 0.2920, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.80% (0.2760 => 0.2920, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 3.86% (1.5560 => 1.6160, std.dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.70% (0.6480 => 0.6720, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.06% (0.3920 => 0.4040, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.46% (1.9240 => 1.9520, std.dev.: 0.0106) MultiSource/Applications/d/make_dparser: 1.39% (4.0361 => 4.0921, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.23% (6.8200 => 6.9040, std.dev.: 0.0284) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 9.73% (0.4520 => 0.4960, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.78% (1.3841 => 1.4641, std.dev.: 0.0242) MultiSource/Benchmarks/Olden/bisort/bisort: 2.19% (0.7320 => 0.7480, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0101) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 294.80% (0.4600 => 1.8161, std.dev.: 0.0119) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0052) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.69% (0.1160 => 0.1400, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 20.24% (0.3360 => 0.4040, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0128) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.87% (0.2520 => 0.2920, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0148) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: 10.06% (1.8680 => 2.0560, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0225) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.96% (1.6521 => 1.8001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.89% (1.4401 => 1.5681, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.81% (1.8161 => 1.9761, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.49% (1.4601 => 1.5841, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.27% (1.5481 => 1.6761, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.00% (0.7000 => 0.7560, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.23% (0.3320 => 0.3560, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0115) MultiSource/Applications/Burg/burg: 7.16% (1.5080 => 1.6160, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (6.4680 => 6.9040, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.70% (1.6121 => 1.7201, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.41% (1.4361 => 1.5281, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (11.6440 => 12.3800, std.dev.: 0.0810) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.77% (1.4561 => 1.5401, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (5.8121 => 6.1361, std.dev.: 0.0268) MultiSource/Applications/spiff/spiff: 5.56% (1.0080 => 1.0640, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.45% (1.4681 => 1.5481, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (6.5440 => 6.8880, std.dev.: 0.0321) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.23% (9.4842 => 9.9802, std.dev.: 0.0552) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (1.5600 => 1.6400, std.dev.: 0.0244) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (5.3600 => 5.6080, std.dev.: 0.0434) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0078) MultiSource/Applications/hbd/hbd: 4.38% (1.7360 => 1.8120, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 4.26% (21.9606 => 22.8968, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (6.5080 => 6.7840, std.dev.: 0.0467) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.0443 => 10.4683, std.dev.: 0.0381) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.7400 => 1.8120, std.dev.: 0.0241) MultiSource/Applications/lua/lua: 4.01% (4.7880 => 4.9800, std.dev.: 0.0284) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0139) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.78% (50.0290 => 51.9210, std.dev.: 0.0929) MultiSource/Applications/treecc/treecc: 3.72% (2.5840 => 2.6800, std.dev.: 0.0113) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0146) MultiSource/Applications/SPASS/SPASS: 3.49% (18.4404 => 19.0845, std.dev.: 0.0495) MultiSource/Benchmarks/Bullet/bullet: 3.34% (38.4046 => 39.6886, std.dev.: 0.0745) MultiSource/Applications/ClamAV/clamscan: 3.26% (19.0444 => 19.6644, std.dev.: 0.0323) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0171) MultiSource/Applications/d/make_dparser: 3.12% (3.9681 => 4.0921, std.dev.: 0.0161) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (3.0282 => 3.1162, std.dev.: 0.0141) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (16.3483 => 16.7723, std.dev.: 0.0544) MultiSource/Applications/kimwitu++/kc: 2.44% (19.6891 => 20.1691, std.dev.: 0.0564) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 1.10% (13.0563 => 13.2003, std.dev.: 0.0480) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.70% (2.1401 => 2.4762, std.dev.: 0.0404) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 7.33% (1.3641 => 1.4641, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 6.90% (0.4640 => 0.4960, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.51% (4.1003 => 4.2443, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0363) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (3.9922 => 4.0923, std.dev.: 0.0226) MultiSource/Applications/minisat/minisat: 2.46% (6.6684 => 6.8324, std.dev.: 0.0329) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (8.1845 => 8.3605, std.dev.: 0.0126) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.01% (3.9842 => 4.0643, std.dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: 1.74% (11.5087 => 11.7087, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: 1.72% (8.1245 => 8.2645, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.89% (2.9442 => 0.9160, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.48% (1.5641 => 1.0561, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.08% (91.8497 => 49.5231, std.dev.: 10.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.58% (26.0616 => 17.0491, std.dev.: 0.1672) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.47% (50.3031 => 32.9621, std.dev.: 0.2143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.21% (42.1466 => 28.5698, std.dev.: 0.4016) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1110) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -14.34% (7.7845 => 6.6684, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.37% (1.2481 => 1.1561, std.dev.: 0.0137) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1243 => 4.0563, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 11:49:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 13:49:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140426184958.A51FD2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25012?compare_to=25003&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25012, Order: 207317, Start Time: 2014-04-26 14:14:11, End Time: 2014-04-26 18:56:40 To: 25003, Order: 207310, Start Time: 2014-04-26 09:23:01, End Time: 2014-04-26 14:05:49 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (160 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR640: 100.00% (0.0160 => 0.0320, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/dt: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 10.00% (0.1200 => 0.1320, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 7.69% (0.2080 => 0.2240, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 5.00% (0.2400 => 0.2520, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4480 => 0.4680, std.dev.: 0.0049) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.06% (1.3600 => 1.3880, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.32% (0.9121 => 0.9241, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/FloatMM: -33.33% (0.0480 => 0.0320, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2362.50% (0.0320 => 0.7880, std.dev.: 0.0112) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0061) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/nestedloop: 329.35% (0.2320 => 0.9961, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 203.17% (0.2520 => 0.7640, std.dev.: 0.0124) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 115.38% (0.1040 => 0.2240, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0054) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0067) SingleSource/Regression/C/sumarraymalloc: 66.67% (0.0360 => 0.0600, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/ary3: 62.50% (0.0320 => 0.0520, std.dev.: 0.0038) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0053) SingleSource/UnitTests/Vector/simple: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0054) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.98% (0.7040 => 1.0840, std.dev.: 0.0143) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.31% (1.2160 => 1.5481, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.68% (0.1520 => 0.1880, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.08% (1.3001 => 1.5481, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0155) MultiSource/Applications/JM/ldecod/ldecod: 18.28% (8.5802 => 10.1483, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.24% (1.1841 => 1.4001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.24% (1.2281 => 1.4521, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.89% (1.2521 => 1.4761, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.17% (1.1881 => 1.3921, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.00% (1.2001 => 1.4041, std.dev.: 0.0114) MultiSource/Applications/sgefa/sgefa: 16.96% (0.4480 => 0.5240, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.82% (1.2841 => 1.5001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.67% (1.3681 => 1.5961, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 15.27% (19.5406 => 22.5247, std.dev.: 0.0457) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.24% (5.3360 => 6.0961, std.dev.: 0.0333) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.7400 => 1.9560, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0078) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (11.3843 => 12.3963, std.dev.: 0.0368) MultiSource/Applications/oggenc/oggenc: 8.85% (6.2844 => 6.8404, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.64% (0.3240 => 0.3520, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.45% (5.7280 => 6.2120, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.12% (5.6680 => 6.1280, std.dev.: 0.0435) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (11.4440 => 12.2480, std.dev.: 0.0804) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.81% (0.7640 => 0.8160, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0141) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.18% (9.5802 => 10.1722, std.dev.: 0.0490) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (1.1240 => 1.1920, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0273) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (5.3840 => 5.6120, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.22% (1.2320 => 1.2840, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 4.02% (4.7720 => 4.9640, std.dev.: 0.0331) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.98% (6.8280 => 7.1000, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.4520 => 0.4680, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.7440 => 0.7680, std.dev.: 0.0073) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.98% (49.1529 => 50.6169, std.dev.: 0.1276) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (2.0920 => 2.1400, std.dev.: 0.0178) MultiSource/Applications/sqlite3/sqlite3: 2.29% (24.7575 => 25.3255, std.dev.: 0.0510) MultiSource/Applications/ClamAV/clamscan: 2.19% (19.2243 => 19.6444, std.dev.: 0.0589) MultiSource/Applications/kimwitu++/kc: 1.58% (19.7491 => 20.0611, std.dev.: 0.0477) MultiSource/Benchmarks/Bullet/bullet: 1.48% (39.0726 => 39.6526, std.dev.: 0.0876) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0033) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0460) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (3.9842 => 4.3083, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.82% (0.3320 => 0.3480, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0220) MultiSource/Applications/minisat/minisat: 4.34% (6.8204 => 7.1164, std.dev.: 0.0346) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0176) SingleSource/Benchmarks/McGill/queens: 3.67% (2.1801 => 2.2601, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0367) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.54% (1.1041 => 1.1321, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.7280 => 0.7440, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (25.4536 => 25.8776, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0563 => 4.1083, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.60% (11.0207 => 2.0281, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/FloatMM: -33.33% (0.0480 => 0.0320, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/huffbench: -18.05% (21.6534 => 17.7451, std.dev.: 0.0921) SingleSource/Benchmarks/Linpack/linpack-pc: -16.59% (7.8605 => 6.5564, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0616) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.88% (5.0963 => 5.0003, std.dev.: 0.0339) MultiSource/Benchmarks/sim/sim: -1.12% (4.9963 => 4.9403, std.dev.: 0.0146) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0116) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 11:50:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 13:50:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426185059.7F3A12A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25013?compare_to=25010&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25013, Order: 207317, Start Time: 2014-04-26 14:13:47, End Time: 2014-04-26 18:57:43 To: 25010, Order: 207315, Start Time: 2014-04-26 12:27:14, End Time: 2014-04-26 17:08:13 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (108 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-02-04-DivRem: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 31.82% (0.0880 => 0.1160, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.56% (0.2360 => 0.2680, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.43% (0.2120 => 0.2320, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.71% (0.4200 => 0.4440, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 3.61% (0.7760 => 0.8040, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.9400 => 0.9680, std.dev.: 0.0086) MultiSource/Applications/siod/siod: 1.40% (2.5801 => 2.6161, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.00% (0.2400 => 0.2520, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.91% (5.4523 => 5.5563, std.dev.: 0.0382) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/hash: -16.67% (0.0720 => 0.0600, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.53% (0.1520 => 0.1680, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.4120 => 0.4400, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0687) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.39% (1.2521 => 1.3321, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0464) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0169) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0535) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0431) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0194) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0328) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0468) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0430) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.15% (5.8400 => 6.0240, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0353) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.4400 => 0.4520, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.27% (17.6165 => 18.0165, std.dev.: 0.0417) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: 2.23% (37.0925 => 37.9205, std.dev.: 0.0447) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0402) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0250, std.dev.: 0.1031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 1.81% (18.8170 => 19.1570, std.dev.: 0.0509) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 1.31% (23.7574 => 24.0695, std.dev.: 0.0473) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0153) MultiSource/Applications/SPASS/SPASS: 1.19% (17.5484 => 17.7564, std.dev.: 0.0374) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 3.17% (25.8896 => 26.7097, std.dev.: 0.0405) MultiSource/Applications/lua/lua: 2.93% (21.1533 => 21.7734, std.dev.: 0.0471) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0099) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0107) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.26% (3.4842 => 3.5282, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.44% (1.2601 => 1.2041, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0058) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 12:04:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 14:04:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426190413.467542A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25014?compare_to=25013&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25014, Order: 207318, Start Time: 2014-04-26 14:31:20, End Time: 2014-04-26 19:10:55 To: 25013, Order: 207317, Start Time: 2014-04-26 14:13:47, End Time: 2014-04-26 18:57:43 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (105 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/divides: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.00% (0.0800 => 0.1040, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/misr: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 11.11% (0.1080 => 0.1200, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: 8.51% (0.1880 => 0.2040, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.33% (0.1440 => 0.1560, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 7.50% (0.1600 => 0.1720, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.78% (1.2961 => 1.3321, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.55% (1.2921 => 1.3121, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (1.3241 => 1.3441, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.15% (15.2562 => 15.4322, std.dev.: 0.0410) MultiSource/Applications/lua/lua: 1.11% (4.6840 => 4.7360, std.dev.: 0.0180) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0052) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: 16.22% (0.1480 => 0.1720, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0136) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0573) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0415) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0286) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0180) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0269) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0330) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0457) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0315) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0444) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0234) MultiSource/Benchmarks/Bullet/bullet: 2.48% (37.0925 => 38.0126, std.dev.: 0.0641) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0127) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.29% (48.1088 => 49.2089, std.dev.: 0.1121) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0128) MultiSource/Applications/sqlite3/sqlite3: 2.00% (23.7574 => 24.2335, std.dev.: 0.0436) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1211, std.dev.: 0.0413) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (15.2282 => 15.4322, std.dev.: 0.0410) MultiSource/Applications/SPASS/SPASS: 1.25% (17.5484 => 17.7684, std.dev.: 0.0534) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0031) MultiSource/Benchmarks/llubenchmark/llu: 3.54% (5.1963 => 5.3803, std.dev.: 0.0663) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0224) MultiSource/Applications/lua/lua: 3.01% (21.1533 => 21.7894, std.dev.: 0.1958) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.60% (3.5322 => 3.6242, std.dev.: 0.0324) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.38% (4.0643 => 4.1203, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/mason/mason: -36.84% (0.0760 => 0.0480, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.71% (1.2601 => 1.1881, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 12:07:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 14:07:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140426190723.8C0DF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25015?compare_to=25004&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25015, Order: 207317, Start Time: 2014-04-26 14:28:10, End Time: 2014-04-26 19:14:08 To: 25004, Order: 207310, Start Time: 2014-04-26 09:34:26, End Time: 2014-04-26 14:19:50 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 19 (134 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-19-DivTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/nestedloop: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Treesort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/mason/mason: 28.57% (0.0560 => 0.0720, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.05% (0.1680 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.52% (0.1080 => 0.1280, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.39% (0.0920 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.82% (0.1360 => 0.1480, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 8.20% (0.2440 => 0.2640, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0087) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 4.88% (0.3280 => 0.3440, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.89% (0.3040 => 0.3280, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.63% (0.9921 => 1.0281, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -8.33% (0.2400 => 0.2200, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.14% (17.6723 => 19.6403, std.dev.: 0.0452) MultiSource/Applications/sqlite3/sqlite3: 1411.53% (1.7001 => 25.6976, std.dev.: 0.0425) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.19% (50.1010 => 51.6970, std.dev.: 0.1168) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.74% (11.3920 => 12.3880, std.dev.: 0.0518) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0076) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1000, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0203, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0113) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0084) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 55.56% (0.0360 => 0.0560, std.dev.: 0.0031) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.90% (1.9601 => 2.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.60% (1.8081 => 2.0721, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.58% (0.1920 => 0.2200, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.44% (1.8561 => 2.1241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.1120 => 0.1280, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.20% (1.9721 => 2.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.95% (0.1720 => 0.1960, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.74% (1.8921 => 2.1521, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.61% (2.0281 => 2.3041, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.41% (1.8201 => 2.0641, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.11% (1.9521 => 2.2081, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.50% (1.8081 => 2.0161, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.22% (2.1041 => 2.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.11% (0.1800 => 0.2000, std.dev.: 0.0045) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0120) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.54% (1.8601 => 2.0561, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.82% (1.0880 => 1.1840, std.dev.: 0.0350) MultiSource/Applications/obsequi/Obsequi: 8.74% (1.8760 => 2.0400, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.51% (0.1880 => 0.2040, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.18% (0.6360 => 0.6880, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.11% (0.7400 => 0.8000, std.dev.: 0.0226) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.3760 => 0.4040, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 6.49% (0.6160 => 0.6560, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.27% (1.2120 => 1.2880, std.dev.: 0.0283) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.4760 => 0.5040, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (6.4800 => 6.8440, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.6960 => 1.7880, std.dev.: 0.0186) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (2.9721 => 3.1322, std.dev.: 0.0172) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.1320 => 1.1920, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0065) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 4.93% (1.7841 => 1.8721, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (6.5320 => 6.8520, std.dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.8440 => 1.9320, std.dev.: 0.0217) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (9.6042 => 10.0282, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (5.8281 => 6.0801, std.dev.: 0.0229) MultiSource/Applications/hbd/hbd: 4.17% (1.7280 => 1.8000, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (6.5360 => 6.7880, std.dev.: 0.0459) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.2283 => 10.6044, std.dev.: 0.0306) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 3.56% (5.3960 => 5.5880, std.dev.: 0.0338) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0360) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.32% (1.5640 => 1.6160, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: 2.94% (2.5880 => 2.6640, std.dev.: 0.0251) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0211) MultiSource/Applications/SPASS/SPASS: 2.57% (18.5284 => 19.0045, std.dev.: 0.0353) MultiSource/Benchmarks/Bullet/bullet: 2.47% (38.6366 => 39.5926, std.dev.: 0.0750) MultiSource/Applications/JM/lencod/lencod: 2.39% (22.2206 => 22.7527, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (16.3003 => 16.6643, std.dev.: 0.0617) MultiSource/Applications/d/make_dparser: 2.01% (3.9761 => 4.0561, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (3.0562 => 3.1162, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 1.45% (19.8291 => 20.1171, std.dev.: 0.0468) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 20.78% (0.9241 => 1.1161, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.59% (2.1201 => 2.4082, std.dev.: 0.0454) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 3.34% (6.5964 => 6.8164, std.dev.: 0.0780) MultiSource/Applications/hexxagon/hexxagon: 1.91% (11.4967 => 11.7167, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.28% (3.7442 => 3.7922, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.20% (8.3605 => 8.4605, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.19% (5.0243 => 5.0843, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (3.9442 => 3.9882, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.98% (94.8339 => 49.3311, std.dev.: 10.2272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.12% (49.9431 => 32.9021, std.dev.: 0.1623) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.70% (25.7136 => 17.0491, std.dev.: 0.1171) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.59% (37.0863 => 28.7098, std.dev.: 0.4034) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.83% (1.2681 => 1.1561, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.30% (4.2363 => 4.0963, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.08% (4.8043 => 4.6563, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0241) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 12:23:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 14:23:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426192358.3267F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25016?compare_to=25006&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25016, Order: 207318, Start Time: 2014-04-26 14:44:28, End Time: 2014-04-26 19:30:41 To: 25006, Order: 207311, Start Time: 2014-04-26 09:49:48, End Time: 2014-04-26 14:36:01 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1099 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/build: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2005-05-12-Int64ToFP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 9.09% (0.2200 => 0.2400, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3040 => 0.3160, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.45% (0.8160 => 0.8360, std.dev.: 0.0075) MultiSource/Applications/d/make_dparser: 1.96% (4.0801 => 4.1601, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.53% (1.8281 => 1.8561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.20% (2.0081 => 2.0321, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.32% (0.3280 => 0.3520, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -22.53% (0.7280 => 0.5640, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 3.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 12:43:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 14:43:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426194323.174162A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25017?compare_to=25014&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25017, Order: 207319, Start Time: 2014-04-26 15:08:57, End Time: 2014-04-26 19:50:05 To: 25014, Order: 207318, Start Time: 2014-04-26 14:31:20, End Time: 2014-04-26 19:10:55 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (107 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (981 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/mason/mason: 50.00% (0.0480 => 0.0720, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/mst/mst: 30.00% (0.1200 => 0.1560, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.88% (0.9640 => 1.0400, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.67% (0.2400 => 0.2560, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.19% (1.3401 => 1.3561, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 33.33% (0.0480 => 0.0640, std.dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 26.09% (0.0920 => 0.1160, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.88% (0.3400 => 0.3600, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.91% (3.9882 => 4.0643, std.dev.: 0.0273) MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (2.3241 => 2.3481, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.66% (1.1481 => 1.2361, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.11% (10.6960 => 11.4560, std.dev.: 0.0608) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.26% (0.9880 => 1.0400, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0206) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0244) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0394) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0462) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0469) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0340) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (5.8400 => 6.0120, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0244) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.4400 => 1.4800, std.dev.: 0.0154) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: 2.35% (37.0925 => 37.9646, std.dev.: 0.0491) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0110) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.13% (48.1088 => 49.1329, std.dev.: 0.1163) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0499) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0113) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1491, std.dev.: 0.0611) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0180) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.26% (15.2282 => 15.4202, std.dev.: 0.0421) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.14% (0.3360 => 0.3600, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0164) MultiSource/Applications/lua/lua: 3.14% (21.1533 => 21.8174, std.dev.: 0.0553) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0144) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0228) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0369) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 13:11:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 15:11:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140426201156.E69BD2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25018?compare_to=25008&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25018, Order: 207320, Start Time: 2014-04-26 15:30:32, End Time: 2014-04-26 20:18:40 To: 25008, Order: 207313, Start Time: 2014-04-26 10:34:43, End Time: 2014-04-26 15:23:26 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (134 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.08% (0.0520 => 0.0640, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.83% (0.0960 => 0.1160, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: 7.84% (0.2040 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.12% (0.1960 => 0.2080, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (0.4720 => 0.5000, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists1: 5.68% (0.3520 => 0.3720, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7842 => 2.8242, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.17% (3.0722 => 3.1082, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 1.16% (25.4935 => 25.7896, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.11% (2.1641 => 2.1881, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.1760 => 0.2000, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0118) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.57% (1.6721 => 2.0161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.00% (1.7401 => 2.0881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.91% (1.7681 => 2.1201, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.91% (1.7081 => 2.0481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.90% (1.6681 => 2.0001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.81% (1.6761 => 2.0081, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.73% (1.7641 => 2.1121, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.69% (1.8281 => 2.1881, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.26% (1.7441 => 2.0801, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.95% (1.8361 => 2.1841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.91% (1.6921 => 2.0121, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.58% (1.9801 => 2.3481, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.46% (1.8201 => 2.1561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.96% (1.9601 => 2.3121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.42% (0.6120 => 0.6880, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.87% (0.1840 => 0.2040, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.14% (0.7840 => 0.8400, std.dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.09% (3.5002 => 3.7482, std.dev.: 0.0167) MultiSource/Applications/spiff/spiff: 6.67% (1.0200 => 1.0880, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (11.7880 => 12.5520, std.dev.: 0.0538) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.25% (1.7280 => 1.8360, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.13% (1.2400 => 1.3160, std.dev.: 0.0219) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.07% (6.7200 => 7.1280, std.dev.: 0.0539) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0127) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0106) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0067) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (9.9842 => 10.4682, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (2.0680 => 2.1640, std.dev.: 0.0252) MultiSource/Applications/d/make_dparser: 4.64% (3.9641 => 4.1481, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 4.28% (6.9124 => 7.2085, std.dev.: 0.0168) MultiSource/Applications/lua/lua: 4.26% (4.7920 => 4.9960, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (6.8321 => 7.1081, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 3.76% (18.4924 => 19.1886, std.dev.: 0.0535) MultiSource/Applications/JM/ldecod/ldecod: 3.76% (10.3203 => 10.7084, std.dev.: 0.0333) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0215) MultiSource/Applications/treecc/treecc: 3.51% (2.6200 => 2.7120, std.dev.: 0.0257) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.47% (1.0361 => 1.0721, std.dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 3.38% (22.6287 => 23.3927, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.19% (3.0122 => 3.1082, std.dev.: 0.0108) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.08% (51.1089 => 52.6849, std.dev.: 0.0965) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.82% (16.5963 => 17.0643, std.dev.: 0.0522) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 2.74% (19.7371 => 20.2771, std.dev.: 0.0484) MultiSource/Applications/ClamAV/clamscan: 2.51% (20.2445 => 20.7525, std.dev.: 0.0696) MultiSource/Applications/siod/siod: 2.47% (2.7562 => 2.8242, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 2.38% (25.1895 => 25.7896, std.dev.: 0.0322) MultiSource/Benchmarks/MallocBench/gs/gs: 2.38% (5.5480 => 5.6800, std.dev.: 0.0449) MultiSource/Benchmarks/Bullet/bullet: 2.25% (38.9366 => 39.8126, std.dev.: 0.0828) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: 1.88% (2.7722 => 2.8242, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.79% (6.0244 => 6.1324, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.25% (1.2681 => 1.4361, std.dev.: 0.0124) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0252) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.04% (1.0881 => 1.1321, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0425) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (4.0203 => 4.0923, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.55% (4.1323 => 4.1963, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 1.32% (7.5485 => 7.6485, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.64% (6.2884 => 0.8400, std.dev.: 0.0165) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.18% (3.1762 => 1.3601, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0091) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.58% (7.4801 => 6.2400, std.dev.: 0.0355) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.15% (7.5041 => 6.2920, std.dev.: 0.0460) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0051) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -2.48% (13.5243 => 13.1883, std.dev.: 0.0451) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.37% (21.6534 => 17.8931, std.dev.: 0.0314) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.59% (2.6082 => 2.3841, std.dev.: 0.0826) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0075) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (5.1603 => 5.0003, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.11% (3.8002 => 3.7202, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -1.85% (11.6527 => 11.4367, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: -1.40% (8.3085 => 8.1925, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.17% (1.3681 => 1.3521, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 13:13:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 15:13:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426201323.4895D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25019?compare_to=25017&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25019, Order: 207320, Start Time: 2014-04-26 15:40:20, End Time: 2014-04-26 20:20:06 To: 25017, Order: 207319, Start Time: 2014-04-26 15:08:57, End Time: 2014-04-26 19:50:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (104 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/printargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C/sumarray2d: 100.00% (0.0160 => 0.0320, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 33.33% (0.0720 => 0.0960, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.26% (0.2160 => 0.2360, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.2480 => 0.2680, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 5.41% (0.4440 => 0.4680, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3800 => 1.4400, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary2: 4.23% (0.2840 => 0.2960, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.46% (1.3681 => 1.3881, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (8.4961 => 8.5961, std.dev.: 0.0335) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.25% (4.4323 => 4.5763, std.dev.: 0.0356) MultiSource/Benchmarks/Olden/power/power: 1.21% (1.3201 => 1.3361, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4282 => 2.4562, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -1.36% (2.3481 => 2.3161, std.dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0169) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.26% (0.2160 => 0.2360, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.16% (1.1761 => 1.2721, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0654) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (6.0160 => 6.4520, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.05% (1.1921 => 1.2761, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.71% (1.1921 => 1.2721, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.55% (8.1441 => 8.5961, std.dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0278) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.69% (5.8000 => 6.0720, std.dev.: 0.0402) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3800 => 1.4400, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0228) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0418) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0406) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 3.16% (17.6165 => 18.1725, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0391) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 2.80% (2.5721 => 2.6441, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 2.46% (23.7574 => 24.3415, std.dev.: 0.0381) MultiSource/Applications/treecc/treecc: 2.45% (2.4480 => 2.5080, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0367) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.32% (48.1088 => 49.2249, std.dev.: 0.1064) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8885, std.dev.: 0.0941) MultiSource/Applications/SPASS/SPASS: 1.87% (17.5484 => 17.8764, std.dev.: 0.0276) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1291, std.dev.: 0.0525) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (15.2282 => 15.4602, std.dev.: 0.0439) MultiSource/Applications/ClamAV/clamscan: 1.10% (17.4082 => 17.6002, std.dev.: 0.0521) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.21% (0.3040 => 0.3320, std.dev.: 0.0083) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 2.74% (21.1533 => 21.7334, std.dev.: 0.0963) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.44% (6.6564 => 6.7524, std.dev.: 0.0327) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0614) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.03% (1.1681 => 1.1561, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 14:48:18 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 16:48:18 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426214818.BD5812A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25020?compare_to=25019&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25020, Order: 207322, Start Time: 2014-04-26 17:13:57, End Time: 2014-04-26 21:55:00 To: 25019, Order: 207320, Start Time: 2014-04-26 15:40:20, End Time: 2014-04-26 20:20:06 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (106 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2005-07-17-INT-To-FP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 57.14% (0.0280 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.23% (0.1040 => 0.1240, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0073) SingleSource/Benchmarks/SmallPT/smallpt: 15.15% (0.1320 => 0.1520, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/rem: 13.33% (0.1200 => 0.1360, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.2560 => 0.2720, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 6.17% (0.3240 => 0.3440, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.20% (1.2721 => 1.3001, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (10.6960 => 11.4840, std.dev.: 0.0428) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0356) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.2560 => 0.2720, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.16% (1.3641 => 1.4481, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0203) SingleSource/Regression/C++/ofstream_ctor: 5.08% (0.2360 => 0.2480, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0587) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0251) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0252) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0429) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0135) MultiSource/Applications/obsequi/Obsequi: 3.48% (1.2640 => 1.3080, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0429) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0486) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0250) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0561) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0101) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.33% (48.1088 => 49.2289, std.dev.: 0.0860) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9246, std.dev.: 0.0686) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 1.77% (23.7574 => 24.1775, std.dev.: 0.0587) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1130, std.dev.: 0.0361) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0188) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0579) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0311) MultiSource/Applications/lua/lua: 2.86% (21.1533 => 21.7574, std.dev.: 0.0569) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0037) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 15:42:20 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 17:42:20 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140426224220.79B6C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25021?compare_to=25011&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25021, Order: 207323, Start Time: 2014-04-26 18:06:26, End Time: 2014-04-26 22:49:02 To: 25011, Order: 207315, Start Time: 2014-04-26 13:18:05, End Time: 2014-04-26 18:00:49 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 12 (162 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.33% (0.3000 => 0.3160, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 3.76% (1.0640 => 1.1040, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.79% (1.5681 => 1.5961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.77% (1.5841 => 1.6121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.42% (1.9761 => 2.0041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.33% (1.8001 => 1.8241, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.28% (3.1162 => 3.1562, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.98% (0.9521 => 1.0281, std.dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.47% (11.3687 => 3.0162, std.dev.: 0.0127) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0144) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0097) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C/sumarray2d: 66.67% (0.0240 => 0.0400, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.13% (0.1240 => 0.1440, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.23% (1.0240 => 1.1800, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.55% (0.6200 => 0.7040, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.19% (0.3640 => 0.4120, std.dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 11.11% (0.1440 => 0.1600, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.65% (1.1640 => 1.2880, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: 10.28% (1.8680 => 2.0600, std.dev.: 0.0221) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: 9.52% (1.0080 => 1.1040, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.52% (0.2520 => 0.2760, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.29% (1.4961 => 1.6201, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.30% (6.4680 => 6.9400, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.76% (0.2960 => 0.3160, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.6440 => 12.3560, std.dev.: 0.0576) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.06% (1.5841 => 1.6801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.4640 => 1.5520, std.dev.: 0.0109) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (5.8121 => 6.1481, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (9.4842 => 9.9522, std.dev.: 0.0483) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.5480 => 1.6240, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.5600 => 1.6360, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.64% (2.3281 => 2.4362, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0228) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.7921 => 1.8721, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.42% (0.7240 => 0.7560, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 4.37% (21.9606 => 22.9208, std.dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (6.5440 => 6.8280, std.dev.: 0.0493) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.23% (3.0282 => 3.1562, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 4.14% (10.0443 => 10.4603, std.dev.: 0.0383) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.7400 => 1.8120, std.dev.: 0.0230) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0104) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.93% (50.0290 => 51.9930, std.dev.: 0.0896) MultiSource/Applications/hbd/hbd: 3.92% (1.7360 => 1.8040, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (2.0440 => 2.1240, std.dev.: 0.0266) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0135) MultiSource/Applications/oggenc/oggenc: 3.78% (6.9844 => 7.2485, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (6.5080 => 6.7440, std.dev.: 0.0500) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (5.3600 => 5.5520, std.dev.: 0.0426) MultiSource/Applications/SPASS/SPASS: 3.47% (18.4404 => 19.0805, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0437) MultiSource/Benchmarks/Bullet/bullet: 2.97% (38.4046 => 39.5446, std.dev.: 0.0956) MultiSource/Applications/treecc/treecc: 2.94% (2.5840 => 2.6600, std.dev.: 0.0289) MultiSource/Applications/ClamAV/clamscan: 2.83% (19.0444 => 19.5843, std.dev.: 0.0513) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.74% (1.0201 => 1.0481, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (16.3483 => 16.7923, std.dev.: 0.0453) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0183) MultiSource/Applications/kimwitu++/kc: 2.42% (19.6891 => 20.1651, std.dev.: 0.0544) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (13.0563 => 13.2163, std.dev.: 0.0371) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.89% (2.1401 => 2.4802, std.dev.: 0.0516) MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 10.35% (2.8602 => 3.1562, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.44% (0.7200 => 0.7520, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.61% (4.1003 => 4.2483, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 3.13% (7.4205 => 7.6525, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0451) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (8.1845 => 8.3685, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 2.11% (3.9842 => 4.0683, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (3.9922 => 4.0723, std.dev.: 0.0267) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0135) MultiSource/Applications/JM/lencod/lencod: 1.82% (8.1245 => 8.2725, std.dev.: 0.0512) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 1.67% (11.5087 => 11.7007, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 1.20% (21.7374 => 21.9974, std.dev.: 0.0554) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.10% (10.6247 => 2.0081, std.dev.: 0.0202) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.97% (2.9442 => 0.8840, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.23% (91.8497 => 49.3911, std.dev.: 10.4381) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.49% (26.0616 => 17.0731, std.dev.: 0.0896) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.23% (50.3031 => 33.0861, std.dev.: 0.1175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.09% (42.1466 => 28.6218, std.dev.: 0.4719) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1128) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Applications/aha/aha: -5.96% (2.7522 => 2.5882, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.50% (4.8083 => 4.6883, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.75% (4.1243 => 4.0523, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3561 => 2.3201, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0139) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 16:39:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 18:39:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140426233936.302952A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25022?compare_to=25012&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25022, Order: 207327, Start Time: 2014-04-26 19:03:37, End Time: 2014-04-26 23:46:18 To: 25012, Order: 207317, Start Time: 2014-04-26 14:14:11, End Time: 2014-04-26 18:56:40 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (155 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0060) MultiSource/Applications/aha/aha: 12.50% (0.1280 => 0.1440, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 8.33% (0.2400 => 0.2600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 4.29% (0.2800 => 0.2920, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (1.5481 => 1.5681, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (2.7602 => 2.7922, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 57.14% (0.0280 => 0.0440, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2362.50% (0.0320 => 0.7880, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/Puzzle: 1187.18% (0.1240 => 1.5961, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0061) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0142) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 195.24% (0.2520 => 0.7440, std.dev.: 0.0154) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0028) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0057) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0073) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0052) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0055) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 48.86% (0.7040 => 1.0480, std.dev.: 0.0207) MultiSource/Applications/obsequi/Obsequi: 44.83% (1.3920 => 2.0160, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.19% (1.2401 => 1.5401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0082) MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.40% (1.1401 => 1.3841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 19.81% (1.2921 => 1.5481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.39% (1.1761 => 1.4041, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 19.38% (1.1561 => 1.3801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 18.93% (8.5802 => 10.2043, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.77% (1.1721 => 1.3921, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.60% (0.1720 => 0.2040, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.21% (1.2521 => 1.4801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.65% (0.1360 => 0.1600, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.82% (1.2841 => 1.5001, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 16.07% (0.4480 => 0.5200, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.61% (1.3841 => 1.6001, std.dev.: 0.0144) MultiSource/Applications/JM/lencod/lencod: 15.27% (19.5406 => 22.5247, std.dev.: 0.0544) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.54% (5.3360 => 6.1121, std.dev.: 0.0401) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.56% (1.7400 => 1.9760, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/objinst: 10.17% (0.2360 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.88% (0.6480 => 0.7120, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0152) MultiSource/Applications/aha/aha: 9.09% (0.1320 => 0.1440, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.96% (5.6680 => 6.1760, std.dev.: 0.0407) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.87% (5.7280 => 6.2360, std.dev.: 0.0344) MultiSource/Benchmarks/mafft/pairlocalalign: 8.78% (11.3843 => 12.3843, std.dev.: 0.0405) MultiSource/Applications/oggenc/oggenc: 8.66% (6.2844 => 6.8284, std.dev.: 0.0233) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.7640 => 0.8240, std.dev.: 0.0153) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (11.4440 => 12.3120, std.dev.: 0.0591) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (9.5802 => 10.2282, std.dev.: 0.0454) MultiSource/Benchmarks/McCat/05-eks/eks: 6.54% (0.6120 => 0.6520, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (1.4760 => 1.5600, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 5.03% (4.7720 => 5.0120, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.87% (1.2320 => 1.2920, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0113) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0186) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 4.16% (5.3840 => 5.6080, std.dev.: 0.0495) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.04% (6.8280 => 7.1040, std.dev.: 0.0428) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.46% (49.1529 => 50.8529, std.dev.: 0.0846) SingleSource/Benchmarks/Shootout-C++/hash2: 3.23% (0.4960 => 0.5120, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 3.14% (19.2243 => 19.8284, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (2.0920 => 2.1520, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 2.67% (24.7575 => 25.4175, std.dev.: 0.0477) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 2.15% (19.7491 => 20.1731, std.dev.: 0.0518) MultiSource/Benchmarks/Bullet/bullet: 1.67% (39.0726 => 39.7246, std.dev.: 0.1102) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 1.11% (18.7966 => 19.0045, std.dev.: 0.0450) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0211) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 18.18% (0.9241 => 1.0921, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 11.63% (0.1720 => 0.1920, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.44% (3.9842 => 4.3203, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0202) MultiSource/Applications/minisat/minisat: 3.81% (6.8204 => 7.0804, std.dev.: 0.0443) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.17% (1.1041 => 1.1281, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.68% (4.0563 => 4.1243, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (25.4536 => 25.8456, std.dev.: 0.0497) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.52% (11.0207 => 2.0361, std.dev.: 0.0121) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/family/family: -33.33% (0.0480 => 0.0320, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.50% (21.6534 => 17.8651, std.dev.: 0.0374) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.44% (5.2763 => 4.9363, std.dev.: 0.0916) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.79% (4.5123 => 4.2963, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -3.92% (2.5482 => 2.4482, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.73% (5.0963 => 5.0083, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0156) MultiSource/Benchmarks/sim/sim: -1.12% (4.9963 => 4.9403, std.dev.: 0.0178) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 26 16:47:21 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 26 Apr 2014 16:47:21 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase3 - tree health Message-ID: <20140426234727.59C1650042B8@lab.llvm.org> The Buildbot has detected a restored build on builder phase3 - tree health while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase3%20-%20tree%20health/builds/2342 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 206827 Blamelist: arsenm,benlangmuir,chandlerc,chapuni,d0k,dblaikie,delesley,dexonsmith,dnovillo,dvyukov,eliben,emaste,eugenis,filcab,fjahanian,grosbach,hfinkel,kcc,kremenek,lhames,mzolotukhin,rafael,rnk,rsmith,ruiu,sylvestre,tfiala,timurrrr,yjiang Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sat Apr 26 16:41:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 18:41:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426234154.093AC2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25023?compare_to=25020&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25023, Order: 207327, Start Time: 2014-04-26 19:04:36, End Time: 2014-04-26 23:48:37 To: 25020, Order: 207322, Start Time: 2014-04-26 17:13:57, End Time: 2014-04-26 21:55:00 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (111 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (976 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bisort/bisort: 41.67% (0.0480 => 0.0680, std.dev.: 0.0058) MultiSource/Applications/aha/aha: 14.81% (0.1080 => 0.1240, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.89% (1.0801 => 1.1761, std.dev.: 0.0306) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.81% (3.9122 => 4.1003, std.dev.: 0.0561) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -8.82% (0.2720 => 0.2480, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0052) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 62.50% (0.0320 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: 11.39% (0.3160 => 0.3520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0129) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0474) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (10.6960 => 11.3680, std.dev.: 0.0936) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.09% (1.2481 => 1.3241, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0208) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0407) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0457) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.8000 => 6.0280, std.dev.: 0.0369) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0239) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0352) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4520 => 0.4640, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0505) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0505) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0157) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (2.1201 => 2.1641, std.dev.: 0.0154) MultiSource/Benchmarks/Bullet/bullet: 2.03% (37.0925 => 37.8445, std.dev.: 0.0760) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.97% (48.1088 => 49.0569, std.dev.: 0.0832) MultiSource/Applications/sqlite3/sqlite3: 1.80% (23.7574 => 24.1855, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 1.47% (18.8170 => 19.0930, std.dev.: 0.0470) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0193) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (25.8896 => 26.7257, std.dev.: 0.0274) MultiSource/Applications/lua/lua: 2.86% (21.1533 => 21.7574, std.dev.: 0.0590) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0199) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.13% (1.0641 => 1.0761, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.24% (10.8967 => 2.0441, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -16.67% (0.1200 => 0.1000, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: -4.90% (0.4080 => 0.3880, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.03% (1.1681 => 1.1561, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 16:58:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 18:58:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140426235809.637392A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25024?compare_to=25023&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25024, Order: 207328, Start Time: 2014-04-26 19:25:34, End Time: 2014-04-27 00:04:52 To: 25023, Order: 207327, Start Time: 2014-04-26 19:04:36, End Time: 2014-04-26 23:48:37 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (93 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (998 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.00% (0.0800 => 0.0920, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.57% (0.1400 => 0.1520, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.42% (1.3241 => 1.3561, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/ary3: 1.03% (3.5082 => 3.5442, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -8.93% (0.2240 => 0.2040, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0402) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0643) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.6840 => 0.7200, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0524) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0354) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0510) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0435) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0373) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0283) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.20% (48.1088 => 49.1649, std.dev.: 0.0734) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8486, std.dev.: 0.0832) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0152) MultiSource/Applications/sqlite3/sqlite3: 1.85% (23.7574 => 24.1975, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0424) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0168) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0378) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0348) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0124) MultiSource/Applications/lua/lua: 2.99% (21.1533 => 21.7854, std.dev.: 0.0545) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0087) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0300) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.20% (10.8967 => 2.0481, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.70% (2.0561 => 1.9801, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.03% (1.1681 => 1.1561, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 16:59:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 18:59:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140426235951.6918F2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25025?compare_to=25015&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25025, Order: 207327, Start Time: 2014-04-26 19:21:05, End Time: 2014-04-27 00:06:36 To: 25015, Order: 207317, Start Time: 2014-04-26 14:28:10, End Time: 2014-04-26 19:14:08 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 18 (137 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-26-Shorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 57.14% (0.0280 => 0.0440, std.dev.: 0.0051) SingleSource/Regression/C/PR640: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.27% (0.2200 => 0.2360, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.82% (0.1760 => 0.1880, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.08% (0.7240 => 0.7680, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (2.1480 => 2.2120, std.dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.43% (1.1161 => 1.1321, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.42% (2.2521 => 2.2201, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.61% (17.6723 => 19.7244, std.dev.: 0.0259) MultiSource/Applications/sqlite3/sqlite3: 1419.30% (1.7001 => 25.8296, std.dev.: 0.0341) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.54% (50.1010 => 51.8770, std.dev.: 0.0801) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (1.0520 => 1.1080, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.34% (11.3920 => 12.2280, std.dev.: 0.0916) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0104) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0042, std.dev.: 0.0174) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C/PR640: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Queens: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.60% (1.8081 => 2.0721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.16% (1.8361 => 2.0961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.01% (1.8561 => 2.1161, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0107) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.39% (1.9721 => 2.2361, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.32% (1.9521 => 2.2121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.26% (1.9601 => 2.2201, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.01% (1.8761 => 2.1201, std.dev.: 0.0127) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.93% (2.1121 => 2.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.38% (2.1441 => 2.3881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.30% (1.9121 => 2.1281, std.dev.: 0.0186) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.32% (1.9761 => 2.1801, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.8361 => 2.0241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.89% (1.8601 => 2.0441, std.dev.: 0.0134) MultiSource/Applications/obsequi/Obsequi: 9.81% (1.8760 => 2.0600, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.79% (1.9201 => 2.1081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.67% (2.0681 => 2.2681, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.56% (1.0880 => 1.1920, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.45% (1.9481 => 2.1321, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0118) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0206) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.82% (0.1760 => 0.1880, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.60% (6.4800 => 6.9080, std.dev.: 0.0419) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0113) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.7280 => 0.7680, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0178) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0107) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.19% (0.6160 => 0.6480, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.6960 => 1.7840, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 4.71% (1.7841 => 1.8681, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (6.5320 => 6.8160, std.dev.: 0.0464) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.14% (2.1240 => 2.2120, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (5.8281 => 6.0681, std.dev.: 0.0279) MultiSource/Applications/JM/ldecod/ldecod: 4.03% (10.2283 => 10.6404, std.dev.: 0.0365) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0128) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (9.6042 => 9.9722, std.dev.: 0.0455) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 3.67% (4.7920 => 4.9680, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (6.5360 => 6.7720, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.55% (1.5760 => 1.6320, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3960 => 5.5760, std.dev.: 0.0537) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (2.1600 => 2.2320, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (16.3003 => 16.7883, std.dev.: 0.0379) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: 2.66% (22.2206 => 22.8127, std.dev.: 0.0389) MultiSource/Benchmarks/Bullet/bullet: 2.66% (38.6366 => 39.6646, std.dev.: 0.0279) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0216) MultiSource/Applications/SPASS/SPASS: 2.38% (18.5284 => 18.9685, std.dev.: 0.0526) MultiSource/Applications/d/make_dparser: 2.31% (3.9761 => 4.0681, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.95% (1.0241 => 1.0441, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: 1.75% (19.8291 => 20.1771, std.dev.: 0.0396) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.64% (2.1201 => 2.3881, std.dev.: 0.0446) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 4.12% (6.5964 => 6.8684, std.dev.: 0.0327) SingleSource/Benchmarks/Misc/salsa20: 3.74% (7.3725 => 7.6485, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 1.67% (11.4967 => 11.6887, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.28% (3.7442 => 3.7922, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.23% (8.1285 => 8.2285, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.19% (5.0243 => 5.0843, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.33% (94.8339 => 49.0031, std.dev.: 9.9347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.94% (49.9431 => 32.9901, std.dev.: 0.1514) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.35% (25.7136 => 17.1371, std.dev.: 0.0533) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.02% (37.0863 => 28.5498, std.dev.: 0.3935) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -14.89% (7.8165 => 6.6524, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0151) SingleSource/Benchmarks/Dhrystone/fldry: -7.05% (0.6240 => 0.5800, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.30% (4.2363 => 4.0963, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.00% (4.8043 => 4.6603, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (2.8002 => 2.7522, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.64% (5.6124 => 5.5203, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0237) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 17:17:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 19:17:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427001725.22FD92A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25026?compare_to=25016&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25026, Order: 207328, Start Time: 2014-04-26 19:37:22, End Time: 2014-04-27 00:24:10 To: 25016, Order: 207318, Start Time: 2014-04-26 14:44:28, End Time: 2014-04-26 19:30:41 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (0 on baseline) Performance Improvements: 3 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/FloatMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: 15.00% (0.0800 => 0.0920, std.dev.: 0.0027) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.99% (0.7640 => 0.8480, std.dev.: 0.0249) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 3.53% (0.3400 => 0.3520, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: 1.59% (2.0121 => 2.0441, std.dev.: 0.0103) MultiSource/Applications/siod/siod: 1.43% (2.7882 => 2.8282, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.38% (1.7441 => 1.7681, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.55% (0.2200 => 0.2520, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/chomp: 1.82% (1.0961 => 1.1161, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.39% (1.7281 => 1.7041, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.32% (1.8161 => 1.7921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.14% (1.7521 => 1.7321, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -21.43% (0.7280 => 0.5720, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 17:30:27 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 19:30:27 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427003027.890F22A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25027?compare_to=25024&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25027, Order: 207330, Start Time: 2014-04-26 19:56:05, End Time: 2014-04-27 00:37:09 To: 25024, Order: 207328, Start Time: 2014-04-26 19:25:34, End Time: 2014-04-27 00:04:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (97 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (992 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 400.00% (0.0040 => 0.0200, std.dev.: 0.0042) SingleSource/UnitTests/2003-08-11-VaListArg: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.87% (1.2841 => 1.3081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.51% (1.3281 => 1.3481, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.25% (0.3200 => 0.3560, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (0.2440 => 0.2560, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.24% (1.2161 => 1.3041, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.23% (1.2721 => 1.3641, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0645) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.57% (1.3641 => 1.4401, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.6840 => 0.7200, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0446) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0229) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0351) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0584) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.22% (5.8400 => 6.0280, std.dev.: 0.0556) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0335) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0483) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0548) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.19% (48.1088 => 49.1610, std.dev.: 0.0799) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0448) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 1.91% (18.8170 => 19.1771, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 1.75% (37.0925 => 37.7405, std.dev.: 0.1190) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0400) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0363) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (25.8896 => 26.7337, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0105) MultiSource/Applications/lua/lua: 3.12% (21.1533 => 21.8134, std.dev.: 0.1309) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0169) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 26 18:10:18 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 26 Apr 2014 18:10:18 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140427011021.DF0F25004C3B@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/736 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 206806 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp_pm9Duexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp_pm9Duexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpB_12cpexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpB_12cpexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Sat Apr 26 18:05:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 20:05:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140427010537.1650C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25028?compare_to=25018&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25028, Order: 207330, Start Time: 2014-04-26 20:24:38, End Time: 2014-04-27 01:12:22 To: 25018, Order: 207320, Start Time: 2014-04-26 15:30:32, End Time: 2014-04-26 20:18:40 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (131 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-6: 62.50% (0.0320 => 0.0520, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 41.67% (0.0480 => 0.0680, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Treesort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.33% (0.1200 => 0.1360, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.04% (0.0920 => 0.1040, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 30.77% (0.0520 => 0.0680, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.79% (0.3080 => 0.3320, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.38% (4.6963 => 4.8083, std.dev.: 0.0248) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0056) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 295.64% (0.4560 => 1.8041, std.dev.: 0.0109) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0069) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0057) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 36.17% (0.1880 => 0.2560, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 30.77% (0.0520 => 0.0680, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 30.77% (0.1040 => 0.1360, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.39% (0.1640 => 0.2040, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.44% (1.8001 => 2.1681, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.90% (1.6881 => 2.0241, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.62% (1.6721 => 2.0001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.15% (1.6921 => 2.0161, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.08% (1.7401 => 2.0721, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.07% (1.8881 => 2.2481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.03% (1.8081 => 2.1521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.85% (1.8041 => 2.1441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.79% (1.9801 => 2.3521, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.60% (1.7201 => 2.0401, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.11% (1.9881 => 2.3481, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.02% (1.8201 => 2.1481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.61% (1.9081 => 2.2441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.55% (1.9601 => 2.3041, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.56% (1.9801 => 2.3081, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.50% (1.9641 => 2.2881, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0241) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.67% (0.7200 => 0.7680, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (6.7200 => 7.1560, std.dev.: 0.0357) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.31% (11.7880 => 12.5320, std.dev.: 0.0610) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.5240 => 1.6080, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.4160 => 1.4920, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0134) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 4.42% (4.7920 => 5.0040, std.dev.: 0.0417) MultiSource/Applications/oggenc/oggenc: 4.34% (6.9124 => 7.2124, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: 4.27% (2.6200 => 2.7320, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0250) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0153) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (9.9842 => 10.3962, std.dev.: 0.0571) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: 4.00% (1.1000 => 1.1440, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.34% (6.8321 => 7.0601, std.dev.: 0.0354) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (5.5480 => 5.7240, std.dev.: 0.0341) MultiSource/Applications/SPASS/SPASS: 3.14% (18.4924 => 19.0725, std.dev.: 0.0754) MultiSource/Applications/kimwitu++/kc: 3.06% (19.7371 => 20.3411, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (3.0122 => 3.1002, std.dev.: 0.0126) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.90% (51.1089 => 52.5929, std.dev.: 0.0842) MultiSource/Applications/siod/siod: 2.76% (2.7562 => 2.8322, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.74% (2.0440 => 2.1000, std.dev.: 0.0174) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.6287 => 23.2287, std.dev.: 0.0622) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (10.3203 => 10.5844, std.dev.: 0.0562) MultiSource/Benchmarks/Bullet/bullet: 2.50% (38.9366 => 39.9086, std.dev.: 0.0823) MultiSource/Applications/ClamAV/clamscan: 2.37% (20.2445 => 20.7245, std.dev.: 0.0846) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (6.0244 => 6.1644, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (2.2721 => 2.3241, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (16.5963 => 16.9203, std.dev.: 0.0297) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 1.83% (25.1895 => 25.6496, std.dev.: 0.0275) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (29.4578 => 29.8019, std.dev.: 0.0478) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 24.52% (7.3405 => 9.1406, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.39% (0.9281 => 1.1081, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0117) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0229) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0118) MultiSource/Applications/minisat/minisat: 3.17% (6.8204 => 7.0364, std.dev.: 0.0434) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.30% (4.7003 => 4.8083, std.dev.: 0.0248) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.73% (5.0963 => 5.1843, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (4.0203 => 4.0883, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0155) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.81% (3.1762 => 1.3401, std.dev.: 0.0146) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: -20.85% (2.6481 => 2.0960, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.31% (7.5041 => 6.2800, std.dev.: 0.0510) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.94% (7.4801 => 6.2880, std.dev.: 0.0354) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -3.08% (13.5243 => 13.1083, std.dev.: 0.0372) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.29% (21.6534 => 17.9091, std.dev.: 0.0336) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.05% (2.6082 => 2.3721, std.dev.: 0.0881) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0081) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9202 => 2.8162, std.dev.: 0.0122) MultiSource/Applications/aha/aha: -3.30% (2.9122 => 2.8162, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.8002 => 3.7162, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0160) MultiSource/Applications/JM/lencod/lencod: -1.35% (8.3085 => 8.1965, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.7041 => 1.6841, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 18:17:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 20:17:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427011722.57A872A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25029?compare_to=25027&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25029, Order: 207331, Start Time: 2014-04-26 20:45:00, End Time: 2014-04-27 01:24:04 To: 25027, Order: 207330, Start Time: 2014-04-26 19:56:05, End Time: 2014-04-27 00:37:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (101 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/objinst: 44.44% (0.0360 => 0.0520, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.00% (0.0480 => 0.0600, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.16% (0.1520 => 0.1720, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 5.41% (0.4440 => 0.4680, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.85% (0.6600 => 0.6920, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.10% (0.5160 => 0.5320, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.94% (1.4401 => 1.4681, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.31% (0.4520 => 0.4760, std.dev.: 0.0093) MultiSource/Applications/spiff/spiff: 4.46% (1.9721 => 2.0601, std.dev.: 0.0325) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0060) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.2200 => 0.2400, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0482) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0508) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0405) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0443) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0544) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (4.9200 => 5.0680, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 2.43% (17.6165 => 18.0445, std.dev.: 0.0553) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.24% (48.1088 => 49.1849, std.dev.: 0.0839) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0367) MultiSource/Applications/kimwitu++/kc: 2.17% (18.8170 => 19.2251, std.dev.: 0.0216) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8886, std.dev.: 0.0643) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0231) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 1.57% (23.7574 => 24.1295, std.dev.: 0.0295) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0235) MultiSource/Applications/lua/lua: 2.84% (21.1533 => 21.7534, std.dev.: 0.1260) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0088) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0122) SingleSource/Benchmarks/SmallPT/smallpt: 1.43% (14.0009 => 14.2009, std.dev.: 0.0578) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0136) SingleSource/UnitTests/SignlessTypes/div: -33.33% (0.0360 => 0.0240, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0388) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 19:50:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 21:50:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427025048.182A82A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25030?compare_to=25029&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25030, Order: 207332, Start Time: 2014-04-26 22:17:24, End Time: 2014-04-27 02:57:30 To: 25029, Order: 207331, Start Time: 2014-04-26 20:45:00, End Time: 2014-04-27 01:24:04 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (109 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C/test_indvars: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Perm: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Applications/aha/aha: 14.29% (0.1120 => 0.1280, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.2440 => 0.2560, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.52% (1.3121 => 1.3321, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.07% (6.3480 => 6.4160, std.dev.: 0.0264) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 46.15% (0.0520 => 0.0760, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9602 => 4.0003, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -20.00% (0.0600 => 0.0480, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2280 => 0.2480, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.09% (1.2361 => 1.3361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.07% (10.6960 => 11.4520, std.dev.: 0.0414) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.76% (0.7640 => 0.8080, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.92% (0.2440 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0572) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.8000 => 6.0320, std.dev.: 0.0232) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0235) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 2.65% (4.5200 => 4.6400, std.dev.: 0.0440) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0441) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (4.9200 => 5.0360, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0111) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.20% (48.1088 => 49.1649, std.dev.: 0.1586) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 1.79% (37.0925 => 37.7565, std.dev.: 0.0724) MultiSource/Applications/kimwitu++/kc: 1.66% (18.8170 => 19.1291, std.dev.: 0.0331) MultiSource/Applications/sqlite3/sqlite3: 1.55% (23.7574 => 24.1255, std.dev.: 0.0345) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.6321 => 1.6561, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0169) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0362) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0256) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0100) MultiSource/Applications/lua/lua: 3.03% (21.1533 => 21.7934, std.dev.: 0.1431) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0306) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0097) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0376) MultiSource/Applications/minisat/minisat: 1.02% (6.6564 => 6.7244, std.dev.: 0.0250) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -20.00% (0.0600 => 0.0480, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 20:46:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 22:46:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427034639.860642A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25031?compare_to=25021&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25031, Order: 207334, Start Time: 2014-04-26 23:11:16, End Time: 2014-04-27 03:53:22 To: 25021, Order: 207323, Start Time: 2014-04-26 18:06:26, End Time: 2014-04-26 22:49:02 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 6 (150 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-26-Shorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.3400 => 0.3640, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ReedSolomon: 5.00% (0.2400 => 0.2520, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 3.72% (17.7291 => 18.3891, std.dev.: 0.1849) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lemon/lemon: -2.13% (1.5041 => 1.4721, std.dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.43% (11.3687 => 3.0202, std.dev.: 0.0156) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0091) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0053) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 47.06% (0.0680 => 0.1000, std.dev.: 0.0045) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.1320 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0196) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.25% (0.2360 => 0.2720, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0228) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.1800 => 0.2000, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.44% (1.4401 => 1.5761, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: 9.42% (1.8680 => 2.0440, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.34% (1.4561 => 1.5921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.31% (1.4601 => 1.5961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.72% (1.6521 => 1.7961, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.27% (1.5481 => 1.6761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.21% (1.6081 => 1.7401, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.09% (1.4841 => 1.6041, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.57% (1.4801 => 1.5921, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.19% (1.1640 => 1.2360, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (6.4680 => 6.8520, std.dev.: 0.0481) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.91% (11.6440 => 12.3320, std.dev.: 0.0521) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.85% (1.4361 => 1.5201, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.71% (1.5401 => 1.6281, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0102) MultiSource/Applications/spiff/spiff: 5.56% (1.0080 => 1.0640, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (5.8121 => 6.1281, std.dev.: 0.0248) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.8881 => 0.9361, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.20% (1.6921 => 1.7801, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0199) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.68% (9.4842 => 9.9282, std.dev.: 0.0746) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4400 => 0.4600, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 3.84% (21.9606 => 22.8048, std.dev.: 0.0348) MultiSource/Applications/treecc/treecc: 3.72% (2.5840 => 2.6800, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (6.5440 => 6.7800, std.dev.: 0.0535) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.59% (50.0290 => 51.8250, std.dev.: 0.0635) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0146) MultiSource/Applications/JM/ldecod/ldecod: 3.50% (10.0443 => 10.3963, std.dev.: 0.0441) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (6.5080 => 6.7280, std.dev.: 0.0400) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (1.6601 => 1.7161, std.dev.: 0.0111) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 2.91% (38.4046 => 39.5206, std.dev.: 0.0700) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (2.1240 => 2.1840, std.dev.: 0.0149) MultiSource/Applications/lua/lua: 2.67% (4.7880 => 4.9160, std.dev.: 0.0378) MultiSource/Applications/SPASS/SPASS: 2.67% (18.4404 => 18.9326, std.dev.: 0.0623) MultiSource/Applications/d/make_dparser: 2.42% (3.9681 => 4.0641, std.dev.: 0.0129) MultiSource/Applications/ClamAV/clamscan: 2.27% (19.0444 => 19.4763, std.dev.: 0.0560) MultiSource/Applications/siod/siod: 2.21% (2.7162 => 2.7762, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 2.01% (19.6891 => 20.0851, std.dev.: 0.0390) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (16.3483 => 16.6563, std.dev.: 0.0546) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.52% (2.1401 => 2.4722, std.dev.: 0.0421) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.78% (0.3600 => 0.3880, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 5.07% (17.5011 => 18.3891, std.dev.: 0.1849) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.51% (4.1003 => 4.2443, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (3.9922 => 4.0963, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (8.1845 => 8.3685, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 2.11% (3.9842 => 4.0683, std.dev.: 0.0147) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.98% (6.6684 => 6.8004, std.dev.: 0.0390) MultiSource/Applications/hexxagon/hexxagon: 1.95% (11.5087 => 11.7327, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 1.92% (8.1245 => 8.2805, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8481 => 0.8601, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.11% (91.8497 => 49.4991, std.dev.: 10.1335) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.27% (26.0616 => 17.1291, std.dev.: 0.1034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.17% (50.3031 => 33.1141, std.dev.: 0.1194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -33.37% (42.1466 => 28.0818, std.dev.: 0.6417) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1146) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -9.41% (0.3400 => 0.3080, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.24% (0.3400 => 0.3120, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.65% (4.1243 => 4.0563, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0159) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 21:44:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 23:44:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140427044404.6E9102A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25032?compare_to=25022&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25032, Order: 207338, Start Time: 2014-04-27 00:08:35, End Time: 2014-04-27 04:50:47 To: 25022, Order: 207327, Start Time: 2014-04-26 19:03:37, End Time: 2014-04-26 23:46:18 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 10 (153 on baseline) Performance Improvements: 3 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-20-FoldBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/cast-bug: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Oscar: 40.00% (0.0600 => 0.0840, std.dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 14.29% (0.1680 => 0.1920, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.37% (1.4561 => 1.4761, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/Puzzle: 1.00% (1.5961 => 1.6121, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.00% (0.1000 => 0.1120, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 1.83% (1.0921 => 1.1121, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -9.23% (0.2600 => 0.2360, std.dev.: 0.0091) MultiSource/Applications/ClamAV/clamscan: -1.25% (19.8284 => 19.5804, std.dev.: 0.0658) MultiSource/Benchmarks/PAQ8p/paq8p: -1.00% (2.7922 => 2.7642, std.dev.: 0.0106) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0054) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 320.73% (0.2320 => 0.9761, std.dev.: 0.0124) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 198.41% (0.2520 => 0.7520, std.dev.: 0.0142) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0064) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0033) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0056) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0051) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0055) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.00% (0.7040 => 1.0560, std.dev.: 0.0182) MultiSource/Applications/obsequi/Obsequi: 43.39% (1.3920 => 1.9960, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.97% (1.2160 => 1.5561, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 27.27% (0.0880 => 0.1120, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.87% (1.2401 => 1.5361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 19.81% (1.2921 => 1.5481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.79% (1.1321 => 1.3561, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.69% (1.3001 => 1.5561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.45% (1.1721 => 1.4001, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.08% (1.2161 => 1.4481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.05% (1.1761 => 1.4001, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.77% (1.1721 => 1.3921, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.27% (1.1601 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 17.96% (1.1361 => 1.3401, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.86% (1.2321 => 1.4521, std.dev.: 0.0127) MultiSource/Applications/JM/ldecod/ldecod: 17.72% (8.5802 => 10.1003, std.dev.: 0.0584) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.13% (1.2841 => 1.5041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 16.83% (1.1881 => 1.3881, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 16.56% (1.2321 => 1.4361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.46% (1.2881 => 1.5001, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.33% (1.2001 => 1.3961, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.61% (1.3841 => 1.6001, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 14.53% (19.5406 => 22.3807, std.dev.: 0.0439) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.02% (5.3360 => 6.0841, std.dev.: 0.0297) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 10.53% (0.2280 => 0.2520, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.3160 => 0.3480, std.dev.: 0.0097) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0178) MultiSource/Benchmarks/mafft/pairlocalalign: 9.10% (11.3843 => 12.4203, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 8.53% (6.2844 => 6.8204, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.05% (5.6680 => 6.1240, std.dev.: 0.0434) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.40% (5.7280 => 6.1520, std.dev.: 0.0490) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.85% (11.4440 => 12.2280, std.dev.: 0.1065) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/neural/neural: 6.00% (0.2000 => 0.2120, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.89% (9.5802 => 10.1442, std.dev.: 0.0385) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.67% (1.6240 => 1.7160, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.4760 => 1.5520, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0273) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0101) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.29% (49.1529 => 50.7689, std.dev.: 0.0704) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (2.0920 => 2.1600, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (6.8280 => 7.0440, std.dev.: 0.0418) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (5.3840 => 5.5520, std.dev.: 0.0579) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (2.2081 => 2.2561, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 2.17% (24.7575 => 25.2935, std.dev.: 0.0286) MultiSource/Applications/kimwitu++/kc: 1.90% (19.7491 => 20.1251, std.dev.: 0.0342) MultiSource/Applications/ClamAV/clamscan: 1.85% (19.2243 => 19.5804, std.dev.: 0.0658) MultiSource/Benchmarks/Bullet/bullet: 1.59% (39.0726 => 39.6926, std.dev.: 0.0587) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.7282 => 2.7642, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 20.34% (0.9241 => 1.1121, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.95% (0.1720 => 0.1960, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.87% (1.2401 => 1.4121, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0235) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0173) MultiSource/Applications/minisat/minisat: 3.87% (6.8204 => 7.0844, std.dev.: 0.0271) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.07% (4.0563 => 4.1403, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/whetstone: 1.99% (1.4041 => 1.4321, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (25.4536 => 25.9176, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/salsa20: 1.75% (7.3085 => 7.4365, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/oourafft: 1.62% (7.3965 => 7.5165, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.3601 => 1.3761, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.16% (21.6534 => 17.9371, std.dev.: 0.0424) SingleSource/Benchmarks/Linpack/linpack-pc: -16.59% (7.8605 => 6.5564, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.90% (5.2763 => 4.9123, std.dev.: 0.0827) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.0963 => 5.0123, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0288) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0141) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 21:46:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Apr 2014 23:46:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427044635.10F302A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25033?compare_to=25030&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25033, Order: 207338, Start Time: 2014-04-27 00:10:27, End Time: 2014-04-27 04:53:19 To: 25030, Order: 207332, Start Time: 2014-04-26 22:17:24, End Time: 2014-04-27 02:57:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (97 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/short_circuit_dtor: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 16.67% (0.0960 => 0.1120, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 3.81% (0.4200 => 0.4360, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4800 => 0.4960, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: 150.00% (0.0080 => 0.0200, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.35% (0.8881 => 0.9001, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.81% (0.1240 => 0.1560, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.57% (0.3680 => 0.4400, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.32% (1.1481 => 1.2321, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 6.77% (1.2401 => 1.3241, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.73% (1.2481 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (10.6960 => 11.3360, std.dev.: 0.0599) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0514) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0246) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (8.1441 => 8.4761, std.dev.: 0.0445) MultiSource/Applications/spiff/spiff: 4.05% (0.9880 => 1.0280, std.dev.: 0.0127) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0408) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0440) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0332) MultiSource/Benchmarks/MallocBench/gs/gs: 2.36% (4.9200 => 5.0360, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: 2.00% (17.6165 => 17.9685, std.dev.: 0.0413) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.98% (48.1088 => 49.0609, std.dev.: 0.0762) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0119) MultiSource/Benchmarks/Bullet/bullet: 1.54% (37.0925 => 37.6645, std.dev.: 0.0885) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 1.31% (23.7574 => 24.0695, std.dev.: 0.0452) MultiSource/Applications/kimwitu++/kc: 1.25% (18.8170 => 19.0530, std.dev.: 0.0345) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0367) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 2.87% (21.1533 => 21.7614, std.dev.: 0.1290) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0162) MultiSource/Applications/lemon/lemon: -1.44% (1.3841 => 1.3641, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: -6.86% (0.4080 => 0.3800, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.5522 => 3.5122, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 22:06:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 00:06:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140427050633.CF2CF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25034?compare_to=25025&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25034, Order: 207338, Start Time: 2014-04-27 00:28:41, End Time: 2014-04-27 05:13:19 To: 25025, Order: 207327, Start Time: 2014-04-26 19:21:05, End Time: 2014-04-27 00:06:36 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 10 (127 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (948 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/lowercase: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.62% (0.2080 => 0.2280, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 6.20% (1.0320 => 1.0960, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash: 3.42% (0.4680 => 0.4840, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.02% (2.3881 => 2.4842, std.dev.: 0.0274) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.66% (0.9841 => 1.0201, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.16% (3.7922 => 3.7482, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.80% (17.6723 => 19.5803, std.dev.: 0.0440) MultiSource/Applications/sqlite3/sqlite3: 1409.18% (1.7001 => 25.6576, std.dev.: 0.0353) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.15% (50.1010 => 51.6810, std.dev.: 0.0803) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0291) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.16% (11.3920 => 12.2080, std.dev.: 0.0863) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0100) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0323, std.dev.: 0.0239) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0194) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0095) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.67% (0.1920 => 0.2240, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.16% (1.8081 => 2.0641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.00% (1.8281 => 2.0841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.94% (1.8361 => 2.0921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.85% (1.8201 => 2.0721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.58% (1.8561 => 2.1081, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.32% (1.8921 => 2.1441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.12% (1.8601 => 2.1041, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.06% (1.9601 => 2.2161, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.78% (1.9721 => 2.2241, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.74% (2.1361 => 2.4082, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.32% (1.9161 => 2.1521, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.29% (1.9521 => 2.1921, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.23% (2.0281 => 2.2761, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.15% (1.8761 => 2.1041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.06% (1.9241 => 2.1561, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.74% (2.1121 => 2.3601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.71% (1.9121 => 2.1361, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0088) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/health/health: 10.87% (0.1840 => 0.2040, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.62% (1.8081 => 2.0001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.55% (1.8201 => 2.0121, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.32% (1.9761 => 2.1801, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.29% (1.0880 => 1.2000, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.26% (2.1441 => 2.3641, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.21% (1.9201 => 2.1161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.08% (2.1041 => 2.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.89% (1.9001 => 2.0881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.79% (1.8801 => 2.0641, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.75% (2.0521 => 2.2521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.71% (1.7721 => 1.9441, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.68% (1.8601 => 2.0401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.67% (2.0681 => 2.2681, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.59% (1.8361 => 2.0121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.45% (1.9481 => 2.1321, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.33% (1.8441 => 2.0161, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0182) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0036) MultiSource/Applications/obsequi/Obsequi: 8.53% (1.8760 => 2.0360, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.02% (1.7961 => 1.9401, std.dev.: 0.0167) MultiSource/Applications/spiff/spiff: 7.87% (1.0160 => 1.0960, std.dev.: 0.0115) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.2240 => 0.2400, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.78% (0.2360 => 0.2520, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (6.4800 => 6.8640, std.dev.: 0.0426) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0259) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5320 => 6.8040, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.90% (1.8440 => 1.9160, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (5.8281 => 6.0521, std.dev.: 0.0426) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.7841 => 1.8521, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.75% (9.6042 => 9.9642, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.7480 => 1.8120, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0152) MultiSource/Applications/JM/ldecod/ldecod: 3.21% (10.2283 => 10.5564, std.dev.: 0.0323) MultiSource/Applications/treecc/treecc: 3.09% (2.5880 => 2.6680, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0419) MultiSource/Applications/lua/lua: 2.92% (4.7920 => 4.9320, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0077) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0081) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.77% (1.3000 => 1.3360, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (5.3960 => 5.5440, std.dev.: 0.0388) MultiSource/Applications/oggenc/oggenc: 2.50% (7.0524 => 7.2285, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (16.3003 => 16.6523, std.dev.: 0.0407) MultiSource/Benchmarks/Bullet/bullet: 2.09% (38.6366 => 39.4446, std.dev.: 0.0844) MultiSource/Applications/SPASS/SPASS: 1.86% (18.5284 => 18.8724, std.dev.: 0.0416) MultiSource/Applications/JM/lencod/lencod: 1.84% (22.2206 => 22.6287, std.dev.: 0.0455) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2243 => 4.2923, std.dev.: 0.0175) MultiSource/Applications/d/make_dparser: 1.51% (3.9761 => 4.0361, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: 1.35% (19.8291 => 20.0971, std.dev.: 0.0479) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (2.1201 => 2.4842, std.dev.: 0.0274) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0344) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.59% (1.6561 => 1.7321, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 3.46% (6.5964 => 6.8244, std.dev.: 0.0386) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.98% (11.4967 => 11.7247, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.79% (4.4803 => 4.5603, std.dev.: 0.0279) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.3801 => 1.4001, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.38% (8.1285 => 8.2405, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9684 => 6.0484, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.0243 => 5.0803, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.17% (94.8339 => 49.1551, std.dev.: 9.1783) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.76% (49.9431 => 33.0821, std.dev.: 0.1379) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.74% (25.7136 => 17.0371, std.dev.: 0.1365) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.62% (37.0863 => 28.6978, std.dev.: 0.3392) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.89% (1.2681 => 1.1681, std.dev.: 0.0174) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.30% (4.2363 => 4.0963, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8043 => 4.6763, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.86% (2.8002 => 2.7482, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sat Apr 26 22:20:35 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sat, 26 Apr 2014 22:20:35 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140427052039.1B4275006CF6@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/737 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 206827 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4616 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpx9HVPbexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpx9HVPbexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpIZqAgTexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpIZqAgTexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Sat Apr 26 22:25:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 00:25:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427052558.C6E402A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25035?compare_to=25026&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25035, Order: 207338, Start Time: 2014-04-27 00:46:17, End Time: 2014-04-27 05:32:41 To: 25026, Order: 207328, Start Time: 2014-04-26 19:37:22, End Time: 2014-04-27 00:24:10 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1101 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Towers: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 5.03% (0.6360 => 0.6680, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/moments: 3.60% (0.4440 => 0.4600, std.dev.: 0.0047) MultiSource/Applications/obsequi/Obsequi: 1.16% (2.0760 => 2.1000, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.75% (0.3200 => 0.3480, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.15% (0.9281 => 0.9081, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.81% (1.7681 => 1.7361, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0136) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Apr 26 23:15:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 01:15:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140427061516.A00FF2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25036?compare_to=25028&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25036, Order: 207338, Start Time: 2014-04-27 01:34:26, End Time: 2014-04-27 06:21:59 To: 25028, Order: 207330, Start Time: 2014-04-26 20:24:38, End Time: 2014-04-27 01:12:22 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (121 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (949 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/div: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 36.36% (0.0440 => 0.0600, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.39% (0.1840 => 0.2160, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/almabench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 22.73% (0.0880 => 0.1080, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.32% (0.1640 => 0.1760, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.85% (0.8641 => 0.8801, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -27.27% (0.0440 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -14.71% (0.1360 => 0.1160, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.03% (2.3281 => 2.3041, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 293.88% (0.4560 => 1.7961, std.dev.: 0.0131) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0044) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 25.00% (0.0480 => 0.0600, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.52% (1.6961 => 2.0441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.81% (1.6761 => 2.0081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.73% (1.7641 => 2.1121, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.63% (1.7321 => 2.0721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.42% (1.6681 => 1.9921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.38% (1.6721 => 1.9961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.34% (1.6961 => 2.0241, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.20% (1.7081 => 2.0361, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.19% (1.6881 => 2.0121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.15% (1.6921 => 2.0161, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.07% (1.7201 => 2.0481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.05% (1.6801 => 2.0001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.04% (1.7441 => 2.0761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.85% (1.8041 => 2.1441, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.55% (1.7681 => 2.0961, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.44% (1.6921 => 2.0041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.38% (1.9801 => 2.3441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.37% (1.7201 => 2.0361, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 18.36% (1.8081 => 2.1401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.7241 => 2.0401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.18% (1.8041 => 2.1321, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.16% (1.8281 => 2.1601, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.16% (1.7401 => 2.0561, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.08% (1.7921 => 2.1161, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.08% (1.7481 => 2.0641, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 18.00% (1.8001 => 2.1241, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 17.86% (1.7241 => 2.0321, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 17.80% (1.8881 => 2.2241, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 17.71% (1.9881 => 2.3401, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.39% (0.1840 => 0.2160, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.36% (1.8201 => 2.1361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.21% (1.8361 => 2.1521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.94% (1.9601 => 2.2921, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.77% (1.9081 => 2.2281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.60% (1.9761 => 2.3041, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.50% (1.9641 => 2.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 15.76% (1.9801 => 2.2921, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0227) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.86% (3.5002 => 3.7402, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0059) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (6.7200 => 7.1320, std.dev.: 0.0301) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.7200 => 0.7640, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9920 => 1.0480, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (11.7880 => 12.4280, std.dev.: 0.0525) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.61% (9.9842 => 10.4442, std.dev.: 0.0480) MultiSource/Applications/SIBsim4/SIBsim4: 4.29% (1.6801 => 1.7521, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.4160 => 1.4760, std.dev.: 0.0184) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.06% (2.0680 => 2.1520, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0147) MultiSource/Applications/lua/lua: 3.92% (4.7920 => 4.9800, std.dev.: 0.0435) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.67% (1.5240 => 1.5800, std.dev.: 0.0193) MultiSource/Applications/d/make_dparser: 3.53% (3.9641 => 4.1041, std.dev.: 0.0197) MultiSource/Applications/oggenc/oggenc: 3.53% (6.9124 => 7.1564, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (6.8321 => 7.0561, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 2.90% (18.4924 => 19.0285, std.dev.: 0.0303) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.72% (51.1089 => 52.5009, std.dev.: 0.0651) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (10.3203 => 10.5964, std.dev.: 0.0414) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 2.35% (19.7371 => 20.2011, std.dev.: 0.0503) MultiSource/Applications/JM/lencod/lencod: 2.10% (22.6287 => 23.1047, std.dev.: 0.0527) MultiSource/Benchmarks/Bullet/bullet: 1.94% (38.9366 => 39.6926, std.dev.: 0.1202) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2203 => 4.2963, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0173) MultiSource/Applications/ClamAV/clamscan: 1.74% (20.2445 => 20.5965, std.dev.: 0.0567) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.11% (16.5963 => 16.7803, std.dev.: 0.0523) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 17.24% (0.9281 => 1.0881, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (1.2681 => 1.4281, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.92% (1.0761 => 1.1721, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.04% (1.0881 => 1.1321, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 3.75% (6.8204 => 7.0764, std.dev.: 0.0203) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.36% (4.1323 => 4.1883, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0107) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0150) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0076) MultiSource/Applications/obsequi/Obsequi: -22.66% (2.6481 => 2.0480, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.95% (7.4801 => 6.2120, std.dev.: 0.0499) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.74% (7.5041 => 6.2480, std.dev.: 0.0370) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0048) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: -3.53% (0.6800 => 0.6560, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: -3.40% (13.5243 => 13.0643, std.dev.: 0.0442) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.33% (0.0600 => 0.0400, std.dev.: 0.0072) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.22% (21.6534 => 17.9251, std.dev.: 0.0278) SingleSource/Benchmarks/Linpack/linpack-pc: -15.23% (7.8005 => 6.6124, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.21% (2.6082 => 2.3681, std.dev.: 0.0871) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.17% (0.9281 => 0.8801, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0174) MultiSource/Applications/aha/aha: -3.30% (2.9122 => 2.8162, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -3.26% (5.1603 => 4.9923, std.dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.8002 => 3.7162, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: -1.49% (8.3085 => 8.1845, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.46% (1.3681 => 1.3481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.34% (4.7603 => 4.6963, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -1.04% (4.9883 => 4.9363, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 00:09:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 02:09:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427070952.5566A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25037?compare_to=25033&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25037, Order: 207339, Start Time: 2014-04-27 02:35:09, End Time: 2014-04-27 07:16:34 To: 25033, Order: 207338, Start Time: 2014-04-27 00:10:27, End Time: 2014-04-27 04:53:19 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (92 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Oscar: 26.67% (0.0600 => 0.0760, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0800 => 0.0920, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.09% (0.2200 => 0.2400, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/EH/except: 7.02% (0.2280 => 0.2440, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.3800 => 0.4040, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.79% (0.8961 => 0.9121, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.46% (1.3721 => 1.3921, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 9.09% (0.3080 => 0.3360, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.2680 => 0.2840, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bisort/bisort: 2.73% (0.7320 => 0.7520, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.4322 => 2.4602, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: 1.03% (5.0323 => 5.0843, std.dev.: 0.0127) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.22% (1.1281 => 1.2321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.45% (0.3760 => 0.4040, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.71% (1.1921 => 1.2721, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0577) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.0160 => 6.3880, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/09-vor/vor: 5.56% (0.3600 => 0.3800, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0427) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0183) MultiSource/Applications/hexxagon/hexxagon: 2.85% (1.1240 => 1.1560, std.dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: 2.73% (10.4082 => 10.6922, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.55% (5.8000 => 5.9480, std.dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0275) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0296) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0189) MultiSource/Applications/JM/lencod/lencod: 1.93% (17.6165 => 17.9565, std.dev.: 0.0652) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0249) MultiSource/Benchmarks/Bullet/bullet: 1.76% (37.0925 => 37.7445, std.dev.: 0.0893) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0080) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.60% (48.1088 => 48.8809, std.dev.: 0.1364) MultiSource/Applications/kimwitu++/kc: 1.30% (18.8170 => 19.0610, std.dev.: 0.0540) MultiSource/Applications/sqlite3/sqlite3: 1.23% (23.7574 => 24.0495, std.dev.: 0.0607) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0960 => 0.1120, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0218) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0121) MultiSource/Applications/lua/lua: 2.84% (21.1533 => 21.7534, std.dev.: 0.0679) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0127) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0490) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: -10.78% (0.4080 => 0.3640, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 01:36:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 03:36:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427083619.BEF2B2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25038?compare_to=25037&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25038, Order: 207340, Start Time: 2014-04-27 04:02:25, End Time: 2014-04-27 08:43:00 To: 25037, Order: 207339, Start Time: 2014-04-27 02:35:09, End Time: 2014-04-27 07:16:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (100 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 100.00% (0.0160 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C/badidx: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.11% (0.4440 => 0.4800, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.07% (0.9121 => 0.9401, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.4280 => 0.4400, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4440 => 0.4560, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 10.00% (0.3600 => 0.3960, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 9.09% (0.1320 => 0.1440, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 7.69% (0.3640 => 0.3920, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.10% (1.2401 => 1.3281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (10.6960 => 11.3440, std.dev.: 0.0488) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (6.0160 => 6.3200, std.dev.: 0.0662) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0270) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.78% (8.1441 => 8.4521, std.dev.: 0.0600) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.77% (1.3800 => 1.4320, std.dev.: 0.0179) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.49% (1.3760 => 1.4240, std.dev.: 0.0155) MultiSource/Applications/lua/lua: 3.45% (4.5200 => 4.6760, std.dev.: 0.0360) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0164) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (10.4082 => 10.7162, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.8000 => 5.9600, std.dev.: 0.0572) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (4.9200 => 5.0480, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 2.16% (17.6165 => 17.9965, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.04% (4.9000 => 5.0000, std.dev.: 0.0325) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8486, std.dev.: 0.0513) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.78% (48.1088 => 48.9648, std.dev.: 0.1118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0094) MultiSource/Applications/treecc/treecc: 1.47% (2.4480 => 2.4840, std.dev.: 0.0128) MultiSource/Applications/sqlite3/sqlite3: 1.26% (23.7574 => 24.0575, std.dev.: 0.0455) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (25.8896 => 26.7137, std.dev.: 0.0377) MultiSource/Applications/lua/lua: 2.95% (21.1533 => 21.7774, std.dev.: 0.1218) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0098) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0502) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/life/life: -13.64% (0.0880 => 0.0760, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0078) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0428) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.35% (2.0681 => 2.0401, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 01:38:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 03:38:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427083846.4312B2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25039?compare_to=25031&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25039, Order: 207340, Start Time: 2014-04-27 04:03:05, End Time: 2014-04-27 08:45:32 To: 25031, Order: 207334, Start Time: 2014-04-26 23:11:16, End Time: 2014-04-27 03:53:22 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (150 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Regression/C++/pointer_method2: 133.33% (0.0120 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C++/short_circuit_dtor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/stmtexpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.36% (0.1760 => 0.1960, std.dev.: 0.0073) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 3.61% (1.5520 => 1.6080, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.59% (0.4640 => 0.4760, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 1.63% (1.4721 => 1.4961, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.18% (28.0818 => 28.9738, std.dev.: 0.3018) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0113) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0087) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0098) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0041) SingleSource/UnitTests/stmtexpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0720 => 0.0880, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/fbench: 20.00% (0.0800 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.51% (0.1640 => 0.1960, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 18.18% (0.0880 => 0.1040, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 11.90% (0.3360 => 0.3760, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.61% (0.6200 => 0.6920, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/em3d/em3d: 11.54% (0.2080 => 0.2320, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: 11.11% (0.1440 => 0.1600, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0090) SingleSource/Regression/C/bigstack: 10.87% (0.1840 => 0.2040, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.89% (0.3640 => 0.4000, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.89% (1.4561 => 1.6001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.74% (1.5601 => 1.7121, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.62% (1.1640 => 1.2760, std.dev.: 0.0224) MultiSource/Applications/sgefa/sgefa: 9.59% (0.5840 => 0.6400, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.44% (1.4401 => 1.5761, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.20% (1.6521 => 1.8041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 9.09% (0.6600 => 0.7200, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.04% (1.4601 => 1.5921, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.62% (1.4841 => 1.6121, std.dev.: 0.0094) MultiSource/Applications/obsequi/Obsequi: 8.35% (1.8680 => 2.0240, std.dev.: 0.0179) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.33% (0.1440 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.75% (1.5481 => 1.6681, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.73% (1.5521 => 1.6721, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.46% (1.6081 => 1.7281, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.43% (1.7761 => 1.9081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.95% (1.6121 => 1.7241, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 6.63% (1.5080 => 1.6080, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.13% (1.4361 => 1.5241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (6.4680 => 6.8520, std.dev.: 0.0517) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.71% (1.5401 => 1.6281, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.57% (11.6440 => 12.2920, std.dev.: 0.0800) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.49% (1.4561 => 1.5361, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.8881 => 0.9361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.83% (1.7401 => 1.8241, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (9.4842 => 9.9242, std.dev.: 0.0448) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.47% (5.8121 => 6.0721, std.dev.: 0.0336) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.5480 => 1.6160, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.5600 => 1.6280, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.05% (0.2960 => 0.3080, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (2.0440 => 2.1240, std.dev.: 0.0200) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.1280 => 1.1720, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.82% (0.5240 => 0.5440, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (6.5440 => 6.7880, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (6.5080 => 6.7480, std.dev.: 0.0443) MultiSource/Applications/JM/ldecod/ldecod: 3.66% (10.0443 => 10.4123, std.dev.: 0.0314) MultiSource/Applications/JM/lencod/lencod: 3.57% (21.9606 => 22.7448, std.dev.: 0.0423) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.49% (50.0290 => 51.7770, std.dev.: 0.1002) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 3.26% (6.9844 => 7.2124, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (5.3600 => 5.5320, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout-C++/hash2: 3.17% (0.5040 => 0.5200, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0131) MultiSource/Applications/treecc/treecc: 3.10% (2.5840 => 2.6640, std.dev.: 0.0244) MultiSource/Benchmarks/Bullet/bullet: 3.04% (38.4046 => 39.5726, std.dev.: 0.0586) MultiSource/Applications/SIBsim4/SIBsim4: 2.90% (1.7921 => 1.8441, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (4.1843 => 4.3003, std.dev.: 0.0123) MultiSource/Applications/lua/lua: 2.76% (4.7880 => 4.9200, std.dev.: 0.0358) MultiSource/Applications/SPASS/SPASS: 2.71% (18.4404 => 18.9405, std.dev.: 0.0577) MultiSource/Applications/ClamAV/clamscan: 2.35% (19.0444 => 19.4923, std.dev.: 0.0537) MultiSource/Applications/kimwitu++/kc: 2.34% (19.6891 => 20.1491, std.dev.: 0.0224) MultiSource/Applications/siod/siod: 2.06% (2.7162 => 2.7722, std.dev.: 0.0175) MultiSource/Applications/d/make_dparser: 1.51% (3.9681 => 4.0281, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.25% (16.3483 => 16.5523, std.dev.: 0.0760) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0317) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0390) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.71% (4.1003 => 4.2523, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.28% (3.4122 => 3.5242, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 2.52% (6.6684 => 6.8364, std.dev.: 0.0351) MultiSource/Applications/sqlite3/sqlite3: 2.21% (3.9842 => 4.0723, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (3.9922 => 4.0763, std.dev.: 0.0284) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.05% (8.1845 => 8.3525, std.dev.: 0.0425) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.97% (8.1245 => 8.2845, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 1.70% (11.5087 => 11.7047, std.dev.: 0.0198) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0194) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.27% (91.8497 => 49.3471, std.dev.: 10.3547) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.67% (26.0616 => 17.0251, std.dev.: 0.0980) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.37% (50.3031 => 33.0141, std.dev.: 0.2374) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.25% (42.1466 => 28.9738, std.dev.: 0.3018) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1125) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.34% (0.1160 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -7.05% (0.6240 => 0.5800, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0208) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.88% (0.3400 => 0.3200, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0176) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 01:41:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 03:41:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427084102.86DE22A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25040?compare_to=25038&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25040, Order: 207342, Start Time: 2014-04-27 04:08:32, End Time: 2014-04-27 08:47:45 To: 25038, Order: 207340, Start Time: 2014-04-27 04:02:25, End Time: 2014-04-27 08:43:00 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (96 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-6: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Towers: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0560 => 0.0720, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.72% (0.2880 => 0.3160, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.6880 => 0.7200, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.81% (1.3281 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.33% (6.3200 => 6.4040, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.09% (11.3440 => 11.4680, std.dev.: 0.0375) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.30% (1.0081 => 1.1321, std.dev.: 0.0360) MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.6840 => 0.7200, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.95% (1.5200 => 1.5800, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0485) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (10.4082 => 10.7402, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0168) MultiSource/Applications/lua/lua: 2.74% (4.5200 => 4.6440, std.dev.: 0.0382) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0366) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0342) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 2.18% (37.0925 => 37.9005, std.dev.: 0.0660) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.02% (48.1088 => 49.0809, std.dev.: 0.0910) MultiSource/Applications/JM/lencod/lencod: 1.95% (17.6165 => 17.9605, std.dev.: 0.0577) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0156) MultiSource/Applications/sqlite3/sqlite3: 1.31% (23.7574 => 24.0695, std.dev.: 0.0625) MultiSource/Applications/kimwitu++/kc: 1.25% (18.8170 => 19.0530, std.dev.: 0.0475) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0228) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (25.8896 => 26.7297, std.dev.: 0.0268) MultiSource/Applications/lua/lua: 3.08% (21.1533 => 21.8054, std.dev.: 0.1231) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0109) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0199) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0332) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.76% (0.5320 => 0.5120, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: -1.73% (1.3841 => 1.3601, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 01:57:51 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 03:57:51 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427085751.9C9172A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25041?compare_to=25040&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25041, Order: 207345, Start Time: 2014-04-27 04:25:03, End Time: 2014-04-27 09:04:33 To: 25040, Order: 207342, Start Time: 2014-04-27 04:08:32, End Time: 2014-04-27 08:47:45 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (110 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 200.00% (0.0080 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C/globalrefs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: 26.67% (0.0600 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 13.16% (0.1520 => 0.1720, std.dev.: 0.0071) SingleSource/Benchmarks/Stanford/Puzzle: 11.54% (0.1040 => 0.1160, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.80% (0.2760 => 0.2920, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4600 => 0.4720, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 2.41% (4.6440 => 4.7560, std.dev.: 0.0163) MultiSource/Applications/siod/siod: 2.02% (2.5761 => 2.6281, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 28.07% (0.2280 => 0.2920, std.dev.: 0.0131) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0037) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C/compare: 133.33% (0.0120 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 16.22% (0.1480 => 0.1720, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0127) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0667) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (6.0160 => 6.3680, std.dev.: 0.0463) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.35% (8.1441 => 8.5801, std.dev.: 0.0220) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0144) MultiSource/Applications/lua/lua: 5.22% (4.5200 => 4.7560, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0529) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0164) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0481) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0600) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0137) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0387) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0452) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.31% (48.1088 => 49.2209, std.dev.: 0.0778) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9086, std.dev.: 0.0803) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0133) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0301) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0456) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0205) MultiSource/Applications/sqlite3/sqlite3: 1.43% (23.7574 => 24.0975, std.dev.: 0.0440) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0345) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (25.8896 => 26.7297, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0105) MultiSource/Applications/lua/lua: 2.95% (21.1533 => 21.7774, std.dev.: 0.1328) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0657) MultiSource/Applications/minisat/minisat: 1.20% (6.6564 => 6.7364, std.dev.: 0.0250) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 02:31:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 04:31:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140427093133.01F2D2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25042?compare_to=25032&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25042, Order: 207347, Start Time: 2014-04-27 04:55:45, End Time: 2014-04-27 09:38:15 To: 25032, Order: 207338, Start Time: 2014-04-27 00:08:35, End Time: 2014-04-27 04:50:47 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (161 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: 10.42% (0.1920 => 0.2120, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 9.62% (0.2080 => 0.2280, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.78% (0.3600 => 0.3880, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.27% (0.4400 => 0.4720, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/18-imp/imp: 5.31% (0.4520 => 0.4760, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.81% (0.7480 => 0.7840, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (1.0001 => 1.0241, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (1.4361 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.65% (1.4521 => 1.4761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.44% (1.3921 => 1.4121, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 1.30% (5.5520 => 5.6240, std.dev.: 0.0258) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.25% (0.9601 => 1.0201, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.27% (1.4121 => 1.4441, std.dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -9.52% (0.2520 => 0.2280, std.dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0070) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0075) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0072) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 500.00% (0.0040 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 320.73% (0.2320 => 0.9761, std.dev.: 0.0120) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 196.83% (0.2520 => 0.7480, std.dev.: 0.0187) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0036) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0073) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0052) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0074) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0041) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: 42.53% (1.3920 => 1.9840, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0058) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.64% (1.2160 => 1.5521, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (1.2321 => 1.5601, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (1.2481 => 1.5361, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.75% (1.2481 => 1.5321, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.33% (1.1441 => 1.3881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.28% (1.1841 => 1.4361, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.07% (1.1361 => 1.3641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.73% (1.1761 => 1.4081, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.23% (1.1441 => 1.3641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.42% (1.3681 => 1.6201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.40% (1.1521 => 1.3641, std.dev.: 0.0154) MultiSource/Applications/JM/ldecod/ldecod: 18.28% (8.5802 => 10.1483, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.18% (1.1881 => 1.4041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.00% (1.2001 => 1.4161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.89% (1.2521 => 1.4761, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.18% (1.3841 => 1.6081, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: 15.07% (19.5406 => 22.4847, std.dev.: 0.0491) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0061) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.62% (5.3360 => 6.1161, std.dev.: 0.0409) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 9.36% (6.2844 => 6.8724, std.dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.26% (0.4320 => 0.4720, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 8.82% (11.3843 => 12.3883, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (11.4440 => 12.3480, std.dev.: 0.0606) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.65% (0.6800 => 0.7320, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (5.6680 => 6.1000, std.dev.: 0.0406) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.61% (5.7280 => 6.1640, std.dev.: 0.0463) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.4760 => 1.5760, std.dev.: 0.0191) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.56% (9.5802 => 10.2082, std.dev.: 0.0529) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.7360 => 0.7840, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.16% (1.6240 => 1.7240, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/random: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.9800 => 1.0280, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (5.3840 => 5.6240, std.dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.13% (0.8721 => 0.9081, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3040 => 0.3160, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (6.8280 => 7.0960, std.dev.: 0.0451) MultiSource/Applications/lua/lua: 3.60% (4.7720 => 4.9440, std.dev.: 0.0482) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (49.1529 => 50.8329, std.dev.: 0.0780) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0070) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.02% (1.3240 => 1.3640, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.7320 => 1.7840, std.dev.: 0.0171) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.99% (1.3400 => 1.3800, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: 2.52% (19.2243 => 19.7083, std.dev.: 0.0644) MultiSource/Applications/sqlite3/sqlite3: 2.34% (24.7575 => 25.3375, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (2.0920 => 2.1400, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 1.56% (19.7491 => 20.0571, std.dev.: 0.0454) MultiSource/Benchmarks/Bullet/bullet: 1.37% (39.0726 => 39.6086, std.dev.: 0.0681) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (6.0124 => 6.0804, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0030) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.83% (3.9842 => 4.2963, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0274) MultiSource/Applications/siod/siod: 4.02% (2.9842 => 3.1042, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 3.75% (6.8204 => 7.0764, std.dev.: 0.0339) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (25.4536 => 25.8856, std.dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.0563 => 4.1203, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4041 => 1.4241, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 1.30% (7.3965 => 7.4925, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (4.8003 => 4.8523, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.78% (11.0207 => 2.0081, std.dev.: 0.0125) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.90% (21.6534 => 17.7771, std.dev.: 0.0780) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -9.68% (3.4722 => 3.1362, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0891) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.40% (2.5482 => 2.4362, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0169) MultiSource/Applications/aha/aha: -2.22% (2.8802 => 2.8162, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.81% (5.0963 => 5.0043, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7643 => 4.6923, std.dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0206) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 02:35:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 04:35:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427093541.ECC3A2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25043?compare_to=25041&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25043, Order: 207348, Start Time: 2014-04-27 04:58:20, End Time: 2014-04-27 09:42:24 To: 25041, Order: 207345, Start Time: 2014-04-27 04:25:03, End Time: 2014-04-27 09:04:33 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (101 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-02-04-DivRem: 400.00% (0.0040 => 0.0200, std.dev.: 0.0022) SingleSource/UnitTests/2005-11-29-LongSwitch: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/pointer_method2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.00% (0.0800 => 0.1000, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.00% (0.1000 => 0.1160, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.22% (4.5003 => 4.6003, std.dev.: 0.0255) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.1121 => 1.1241, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.70% (1.4121 => 1.3881, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.40% (4.0083 => 3.9522, std.dev.: 0.0133) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.87% (0.3680 => 0.4080, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.09% (1.2361 => 1.3361, std.dev.: 0.0158) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.69% (1.1441 => 1.2321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.66% (1.1481 => 1.2361, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0598) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0458) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0254) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0313) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0386) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0218) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.25% (2.8322 => 2.9242, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0383) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0572) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.53% (48.1088 => 49.3249, std.dev.: 0.0795) MultiSource/Applications/JM/lencod/lencod: 2.50% (17.6165 => 18.0565, std.dev.: 0.0495) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 1.94% (37.0925 => 37.8126, std.dev.: 0.0744) MultiSource/Applications/oggenc/oggenc: 1.86% (5.7964 => 5.9044, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1451, std.dev.: 0.0608) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (7.8562 => 7.9762, std.dev.: 0.0459) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0324) MultiSource/Applications/sqlite3/sqlite3: 1.08% (23.7574 => 24.0135, std.dev.: 0.0515) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 20.60% (0.9321 => 1.1241, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0621) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.13% (4.5043 => 4.6003, std.dev.: 0.0255) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0206) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0152) SingleSource/Regression/C++/EH/function_try_block: -37.50% (0.0320 => 0.0200, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -1.79% (1.3401 => 1.3161, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 02:57:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 04:57:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140427095700.089A72A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25044?compare_to=25034&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25044, Order: 207349, Start Time: 2014-04-27 05:18:17, End Time: 2014-04-27 10:03:44 To: 25034, Order: 207338, Start Time: 2014-04-27 00:28:41, End Time: 2014-04-27 05:13:19 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 19 (131 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1092 (946 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/BuiltinTypeInfo: 400.00% (0.0040 => 0.0200, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0042) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.98% (0.3280 => 0.3640, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.76% (2.2761 => 2.3161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.65% (2.1801 => 2.2161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.65% (1.9401 => 1.9721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.62% (2.2241 => 2.2601, std.dev.: 0.0102) MultiSource/Applications/siod/siod: 1.59% (2.7682 => 2.8122, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.50% (2.1361 => 2.1681, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.33% (2.4082 => 2.4402, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (12.2080 => 12.3600, std.dev.: 0.0538) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (2.1041 => 2.1281, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 5.17% (5.1803 => 5.4483, std.dev.: 0.0662) SingleSource/Benchmarks/Misc/mandel-2: 1.22% (0.9841 => 0.9961, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -1.43% (1.4001 => 1.3801, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.57% (17.6723 => 19.5402, std.dev.: 0.0738) MultiSource/Applications/sqlite3/sqlite3: 1406.36% (1.7001 => 25.6096, std.dev.: 0.0499) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.38% (50.1010 => 51.7930, std.dev.: 0.0800) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.22% (1.0520 => 1.1280, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (11.3920 => 12.3600, std.dev.: 0.0538) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0077) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0163, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0067) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0069) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 50.00% (0.0320 => 0.0480, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.66% (1.8281 => 2.0961, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 14.29% (0.1400 => 0.1600, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.94% (1.8081 => 2.0601, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 13.41% (0.3280 => 0.3720, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.32% (1.8921 => 2.1441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.30% (1.9241 => 2.1801, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.35% (0.3240 => 0.3640, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.38% (2.1441 => 2.3881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.8441 => 2.0401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.61% (1.7721 => 1.9601, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.8361 => 2.0241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.18% (1.8081 => 1.9921, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.80% (1.7961 => 1.9721, std.dev.: 0.0078) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.03% (1.9481 => 2.1241, std.dev.: 0.0182) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0062) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0264) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.78% (0.2360 => 0.2520, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (6.4800 => 6.8760, std.dev.: 0.0410) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.94% (1.2120 => 1.2840, std.dev.: 0.0274) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0190) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.12% (1.5640 => 1.6440, std.dev.: 0.0149) MultiSource/Applications/Burg/burg: 4.97% (1.5280 => 1.6040, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.95% (0.8881 => 0.9321, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.81% (1.7480 => 1.8320, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (5.8281 => 6.1041, std.dev.: 0.0278) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3560 => 0.3720, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.48% (1.6960 => 1.7720, std.dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (9.6042 => 10.0002, std.dev.: 0.0439) MultiSource/Applications/SIBsim4/SIBsim4: 4.04% (1.7841 => 1.8561, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (5.3960 => 5.5840, std.dev.: 0.0616) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (6.5320 => 6.7560, std.dev.: 0.0497) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 3.40% (10.2283 => 10.5764, std.dev.: 0.0321) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0107) MultiSource/Applications/treecc/treecc: 3.25% (2.5880 => 2.6720, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (3.0562 => 3.1522, std.dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 2.95% (7.0524 => 7.2605, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (16.3003 => 16.7083, std.dev.: 0.0576) MultiSource/Applications/SPASS/SPASS: 2.25% (18.5284 => 18.9445, std.dev.: 0.0446) MultiSource/Applications/siod/siod: 2.18% (2.7522 => 2.8122, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 2.12% (38.6366 => 39.4566, std.dev.: 0.1205) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (4.2243 => 4.3123, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 2.05% (22.2206 => 22.6767, std.dev.: 0.0603) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.88% (2.1240 => 2.1640, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 1.63% (19.8291 => 20.1531, std.dev.: 0.0481) MultiSource/Applications/lemon/lemon: 1.08% (1.4881 => 1.5041, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.99% (2.1201 => 2.4802, std.dev.: 0.0340) MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0151) MultiSource/Benchmarks/llubenchmark/llu: 7.67% (5.0603 => 5.4483, std.dev.: 0.0662) SingleSource/Benchmarks/Misc/salsa20: 4.12% (7.3725 => 7.6765, std.dev.: 0.0300) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 3.40% (6.5964 => 6.8204, std.dev.: 0.0293) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.98% (11.4967 => 11.7247, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/mandel-2: 1.63% (0.9801 => 0.9961, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.57% (8.1285 => 8.2565, std.dev.: 0.0222) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (4.0003 => 4.0563, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.0243 => 5.0803, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.42% (2.9562 => 0.9040, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.16% (94.8339 => 49.1591, std.dev.: 10.3057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.77% (49.9431 => 33.0781, std.dev.: 0.1826) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.71% (25.7136 => 17.0451, std.dev.: 0.1281) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.16% (37.0863 => 28.4978, std.dev.: 0.5049) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1052) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -14.89% (7.8165 => 6.6524, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0112) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0458) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.30% (4.2363 => 4.0963, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8043 => 4.6763, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.00% (2.8002 => 2.7442, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0133) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 03:18:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 05:18:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427101847.BDE162A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25045?compare_to=25035&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25045, Order: 207349, Start Time: 2014-04-27 05:39:18, End Time: 2014-04-27 10:25:33 To: 25035, Order: 207338, Start Time: 2014-04-27 00:46:17, End Time: 2014-04-27 05:32:41 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1090 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/stmtexpr: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/methcall: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Regression/C/sumarraymalloc: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.80% (0.2040 => 0.2240, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.09% (0.1760 => 0.1920, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.38% (0.1880 => 0.2000, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.08% (0.2360 => 0.2480, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.92% (0.2440 => 0.2560, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 3.62% (0.5520 => 0.5720, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.06% (1.7441 => 1.7801, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.95% (1.8441 => 1.8801, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.65% (1.7001 => 1.7281, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.34% (2.0961 => 2.1241, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: -46.15% (0.0520 => 0.0280, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -21.43% (0.7280 => 0.5720, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 04:08:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 06:08:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140427110809.D9AAA2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25046?compare_to=25036&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25046, Order: 207350, Start Time: 2014-04-27 06:26:57, End Time: 2014-04-27 11:14:52 To: 25036, Order: 207338, Start Time: 2014-04-27 01:34:26, End Time: 2014-04-27 06:21:59 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (126 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/divides: 200.00% (0.0080 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.13% (0.1240 => 0.1440, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.00% (0.1600 => 0.1760, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.52% (0.1680 => 0.1840, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 6.12% (0.1960 => 0.2080, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.08% (2.1161 => 2.1601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.80% (2.0041 => 2.0401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.51% (2.1241 => 2.1561, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (12.4280 => 12.6040, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.37% (2.0401 => 2.0681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.30% (2.1521 => 2.1801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.26% (2.2241 => 2.2521, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.16% (1.7281 => 1.7081, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/member-function-pointers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 297.39% (0.4560 => 1.8121, std.dev.: 0.0096) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0052) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.53% (1.7921 => 2.1601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.28% (1.6961 => 2.0401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.18% (1.7441 => 2.0961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.09% (1.7321 => 2.0801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.00% (1.7201 => 2.0641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.68% (1.7681 => 2.1161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.62% (1.6921 => 2.0241, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.51% (0.1640 => 0.1960, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.44% (1.7081 => 2.0401, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.38% (1.6721 => 1.9961, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.05% (1.6801 => 2.0001, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.03% (1.8081 => 2.1521, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.02% (1.7241 => 2.0521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.99% (1.9801 => 2.3561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.62% (1.8041 => 2.1401, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.60% (1.8281 => 2.1681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.31% (1.9881 => 2.3521, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.02% (1.8201 => 2.1481, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.61% (1.9761 => 2.3241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.61% (1.9081 => 2.2441, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.55% (1.9601 => 2.3041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.11% (1.9641 => 2.3001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.97% (1.9801 => 2.3161, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0035) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.66% (0.9920 => 1.0680, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (11.7880 => 12.6040, std.dev.: 0.0317) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (6.7200 => 7.1320, std.dev.: 0.0332) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (3.5002 => 3.7082, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.58% (0.8601 => 0.9081, std.dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (1.7280 => 1.8160, std.dev.: 0.0155) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (2.0680 => 2.1680, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.5240 => 1.5920, std.dev.: 0.0224) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.9842 => 10.4122, std.dev.: 0.0419) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 4.09% (4.7920 => 4.9880, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/ary3: 4.00% (0.3000 => 0.3120, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.5000 => 0.5200, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 3.93% (6.9124 => 7.1844, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (6.8321 => 7.0801, std.dev.: 0.0356) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.6801 => 1.7401, std.dev.: 0.0154) MultiSource/Applications/d/make_dparser: 3.53% (3.9641 => 4.1041, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.11% (1.4160 => 1.4600, std.dev.: 0.0154) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (10.3203 => 10.6284, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (2.0440 => 2.1040, std.dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: 2.83% (18.4924 => 19.0165, std.dev.: 0.0663) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.6287 => 23.2288, std.dev.: 0.0390) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.58% (51.1089 => 52.4289, std.dev.: 0.1569) MultiSource/Applications/kimwitu++/kc: 2.47% (19.7371 => 20.2251, std.dev.: 0.0481) MultiSource/Benchmarks/MallocBench/gs/gs: 2.16% (5.5480 => 5.6680, std.dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (3.0122 => 3.0762, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: 1.98% (38.9366 => 39.7086, std.dev.: 0.0773) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 1.76% (20.2445 => 20.6005, std.dev.: 0.0749) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.45% (16.5963 => 16.8363, std.dev.: 0.0659) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (6.0244 => 6.1084, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 1.16% (25.1895 => 25.4815, std.dev.: 0.0437) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.25% (1.2681 => 1.4361, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/bigfib: 10.77% (0.2600 => 0.2880, std.dev.: 0.0093) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 6.60% (1.2121 => 1.2921, std.dev.: 0.0214) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.04% (1.0881 => 1.1321, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 3.40% (6.8204 => 7.0524, std.dev.: 0.0397) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.39% (1.6521 => 1.7081, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.21% (3.4842 => 3.5962, std.dev.: 0.0371) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.45% (6.2884 => 0.8520, std.dev.: 0.0130) SingleSource/UnitTests/Vector/constpool: -81.45% (10.9087 => 2.0241, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.55% (3.1762 => 1.3801, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0119) MultiSource/Applications/obsequi/Obsequi: -22.36% (2.6481 => 2.0560, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.11% (7.4801 => 6.2000, std.dev.: 0.0539) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.53% (7.5041 => 6.2640, std.dev.: 0.0401) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -3.02% (13.5243 => 13.1163, std.dev.: 0.0417) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.11% (21.6534 => 17.9491, std.dev.: 0.0208) SingleSource/Benchmarks/Linpack/linpack-pc: -15.28% (7.8005 => 6.6084, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.67% (2.6082 => 2.3561, std.dev.: 0.0869) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (5.1603 => 5.0043, std.dev.: 0.0296) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.8002 => 3.7162, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -1.85% (11.6527 => 11.4367, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.43% (4.7603 => 4.6923, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -1.35% (8.3085 => 8.1965, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.7041 => 1.6841, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.17% (1.3681 => 1.3521, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 04:56:00 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 06:56:00 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427115600.83CAA2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25047?compare_to=25043&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25047, Order: 207350, Start Time: 2014-04-27 07:21:29, End Time: 2014-04-27 12:02:45 To: 25043, Order: 207348, Start Time: 2014-04-27 04:58:20, End Time: 2014-04-27 09:42:24 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (97 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct-bitfield-init: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/sieve: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Regression/C/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.12% (0.2640 => 0.2960, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.4080 => 0.4360, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4800 => 0.4960, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.59% (1.2361 => 1.2681, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.95% (0.6160 => 0.6280, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.22% (1.3161 => 1.3321, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.21% (3.9882 => 4.0763, std.dev.: 0.0338) MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (2.3081 => 2.3361, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0052) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/08-main/main: 11.39% (0.3160 => 0.3520, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0990) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0372) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0533) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0401) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (5.8400 => 6.0080, std.dev.: 0.0497) MultiSource/Applications/JM/lencod/lencod: 2.63% (17.6165 => 18.0805, std.dev.: 0.0369) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0128) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.23% (48.1088 => 49.1809, std.dev.: 0.0738) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0495) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8165, std.dev.: 0.0816) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0162) MultiSource/Applications/sqlite3/sqlite3: 1.30% (23.7574 => 24.0655, std.dev.: 0.0274) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0535) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.21% (25.8896 => 26.7217, std.dev.: 0.0335) MultiSource/Applications/lua/lua: 2.99% (21.1533 => 21.7854, std.dev.: 0.0844) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0232) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0067) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.70% (2.0561 => 1.9801, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.14% (3.9202 => 3.8362, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 05:05:22 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 05:05:22 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140427120522.BEFE25009A67@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19287 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207352 Blamelist: d0k BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: lib/CodeGen/SelectionDAG/SelectionDAG.cpp test/CodeGen/X86/vector-idiv.ll On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 04:51:32 Changed By: d0k Comments: SelectionDAG: Aggressively fold shuffles of constant splats.Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 05:05:22 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 05:05:22 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140427120522.C331A5009A68@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19287 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207352 Blamelist: d0k BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 05:05:22 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 05:05:22 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140427120522.815425009A61@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14850 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207352 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17843 of 17844) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17844 of 17844) 1 warning(s) in tests. Testing Time: 415.36s ******************** Failing Tests (1): LLVM :: CodeGen/ARM64/vshuffle.ll Expected Passes : 17694 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::vshuffle.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/ARM64/vshuffle.ll:54:10: error: expected string not found in input ; CHECK: lCPI2_0: ^ :75:2: note: scanning from here ret ^ :92:1: note: possible intended match here lCPI3_0: ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 05:05:22 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 05:05:22 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140427120522.8299C5009A62@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14850 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207352 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17843 of 17844) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17844 of 17844) 1 warning(s) in tests. Testing Time: 415.36s ******************** Failing Tests (1): LLVM :: CodeGen/ARM64/vshuffle.ll Expected Passes : 17694 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::vshuffle.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/ARM64/vshuffle.ll:54:10: error: expected string not found in input ; CHECK: lCPI2_0: ^ :75:2: note: scanning from here ret ^ :92:1: note: possible intended match here lCPI3_0: ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 05:38:26 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 05:38:26 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140427123827.1A96B5009ECA@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14851 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207353 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17843 of 17844) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17844 of 17844) 1 warning(s) in tests. Testing Time: 380.54s ******************** Failing Tests (1): LLVM :: CodeGen/ARM64/vshuffle.ll Expected Passes : 17694 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::vshuffle.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/ARM64/vshuffle.ll:54:10: error: expected string not found in input ; CHECK: lCPI2_0: ^ :75:2: note: scanning from here ret ^ :92:1: note: possible intended match here lCPI3_0: ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 06:11:12 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 06:11:12 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140427131112.D2BF9500A294@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19289 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207356 Blamelist: chapuni,d0k Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sun Apr 27 06:26:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 08:26:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427132602.0F14A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25048?compare_to=25039&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25048, Order: 207350, Start Time: 2014-04-27 08:50:21, End Time: 2014-04-27 13:32:48 To: 25039, Order: 207340, Start Time: 2014-04-27 04:03:05, End Time: 2014-04-27 08:45:32 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 12 (139 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/pi: 200.00% (0.0080 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: 66.67% (0.0240 => 0.0400, std.dev.: 0.0032) SingleSource/UnitTests/vla: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.67% (0.1680 => 0.1960, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 10.20% (0.1960 => 0.2160, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.2960 => 0.3080, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.9881 => 1.0161, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.92% (1.6681 => 1.7001, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.20% (1.6681 => 1.6881, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (9.9242 => 10.0242, std.dev.: 0.0345) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0095) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0128) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0105) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/UnitTests/vla: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0183) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.43% (0.4600 => 0.5080, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.83% (1.4241 => 1.5641, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.77% (1.0240 => 1.1240, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.72% (1.4401 => 1.5801, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0109) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0093) MultiSource/Applications/obsequi/Obsequi: 8.57% (1.8680 => 2.0280, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.44% (1.6121 => 1.7481, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.33% (0.2400 => 0.2600, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.02% (1.4961 => 1.6161, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.55% (1.4841 => 1.5961, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.43% (1.7761 => 1.9081, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.22% (1.1640 => 1.2480, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.14% (1.7361 => 1.8601, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.7480 => 0.8000, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.35% (1.4481 => 1.5401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.23% (1.5401 => 1.6361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (1.6921 => 1.7961, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.11% (0.5240 => 0.5560, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (6.4680 => 6.8600, std.dev.: 0.0341) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.74% (11.6440 => 12.3120, std.dev.: 0.0983) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (9.4842 => 10.0242, std.dev.: 0.0345) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (1.5480 => 1.6360, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.37% (1.4161 => 1.4921, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (2.0440 => 2.1480, std.dev.: 0.0190) MultiSource/Applications/Burg/burg: 5.04% (1.5080 => 1.5840, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (5.8121 => 6.1001, std.dev.: 0.0471) MultiSource/Benchmarks/MallocBench/gs/gs: 4.93% (5.3600 => 5.6240, std.dev.: 0.0385) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.4640 => 1.5360, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.40% (6.5440 => 6.8320, std.dev.: 0.0386) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0227) MultiSource/Applications/treecc/treecc: 4.33% (2.5840 => 2.6960, std.dev.: 0.0260) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (10.0443 => 10.4723, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (3.0282 => 3.1522, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.2960 => 0.3080, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.91% (1.7400 => 1.8080, std.dev.: 0.0210) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0136) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.57% (50.0290 => 51.8170, std.dev.: 0.0567) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (6.5080 => 6.7400, std.dev.: 0.0479) MultiSource/Applications/JM/lencod/lencod: 3.41% (21.9606 => 22.7088, std.dev.: 0.0623) MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.7921 => 1.8521, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0191) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 3.02% (38.4046 => 39.5646, std.dev.: 0.0760) MultiSource/Applications/SPASS/SPASS: 2.80% (18.4404 => 18.9564, std.dev.: 0.0490) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0071) MultiSource/Applications/lua/lua: 2.34% (4.7880 => 4.9000, std.dev.: 0.0376) MultiSource/Applications/kimwitu++/kc: 2.34% (19.6891 => 20.1491, std.dev.: 0.0174) MultiSource/Applications/ClamAV/clamscan: 2.18% (19.0444 => 19.4604, std.dev.: 0.0662) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (16.3483 => 16.6883, std.dev.: 0.0541) MultiSource/Applications/d/make_dparser: 2.02% (3.9681 => 4.0481, std.dev.: 0.0194) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.65% (2.1401 => 2.4322, std.dev.: 0.0518) MultiSource/Applications/siod/siod: 10.35% (2.8602 => 3.1562, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.61% (4.1003 => 4.2483, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (3.9922 => 4.0923, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (8.1845 => 8.3685, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 2.22% (6.6684 => 6.8164, std.dev.: 0.0458) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 2.02% (8.1245 => 8.2885, std.dev.: 0.0454) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.5087 => 11.7167, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.71% (3.9842 => 4.0523, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.87% (10.6247 => 2.0321, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.38% (0.6720 => 0.6560, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.43% (91.8497 => 49.2031, std.dev.: 10.1053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.47% (50.3031 => 32.9621, std.dev.: 0.2044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.24% (26.0616 => 17.1371, std.dev.: 0.1446) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.51% (42.1466 => 28.4458, std.dev.: 0.4680) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1138) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -14.49% (7.7845 => 6.6564, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0278) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.13% (4.1243 => 4.0363, std.dev.: 0.0149) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0012) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0189) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 07:16:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 09:16:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140427141645.EDDAF2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25049?compare_to=25042&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25049, Order: 207350, Start Time: 2014-04-27 09:41:27, End Time: 2014-04-27 14:23:31 To: 25042, Order: 207347, Start Time: 2014-04-27 04:55:45, End Time: 2014-04-27 09:38:15 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 12 (149 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/FloatPrecision: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 25.00% (0.0640 => 0.0800, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 23.08% (0.1040 => 0.1280, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 9.38% (0.1280 => 0.1400, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.83% (1.7400 => 1.8240, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3040 => 0.3160, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.32% (0.9081 => 0.9201, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.40% (0.8601 => 0.8721, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Threads/tls: -57.14% (0.0280 => 0.0120, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary2: -8.86% (0.3160 => 0.2880, std.dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2412.81% (0.0320 => 0.8041, std.dev.: 0.0070) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0059) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0118) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 200.00% (0.2520 => 0.7560, std.dev.: 0.0179) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 85.00% (0.0800 => 0.1480, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0070) SingleSource/Regression/C/test_indvars: 62.50% (0.0320 => 0.0520, std.dev.: 0.0070) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 53.85% (0.1040 => 0.1600, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Regression/C/bigstack: 46.15% (0.0520 => 0.0760, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 45.83% (0.0960 => 0.1400, std.dev.: 0.0022) MultiSource/Applications/obsequi/Obsequi: 44.25% (1.3920 => 2.0080, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0066) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 27.08% (0.1920 => 0.2440, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.00% (1.2321 => 1.5401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.87% (1.2401 => 1.5361, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 22.73% (0.0880 => 0.1080, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.05% (0.1520 => 0.1840, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.66% (1.2001 => 1.4481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.12% (1.2921 => 1.5521, std.dev.: 0.0128) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.00% (1.3001 => 1.5601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.00% (1.1401 => 1.3681, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.40% (1.1521 => 1.3641, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.24% (1.2281 => 1.4521, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 17.72% (8.5802 => 10.1003, std.dev.: 0.0421) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.57% (1.1841 => 1.3921, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 17.39% (0.0920 => 0.1080, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 15.18% (0.4480 => 0.5160, std.dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 14.62% (19.5406 => 22.3967, std.dev.: 0.0676) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.39% (5.3360 => 6.1041, std.dev.: 0.0294) MultiSource/Benchmarks/nbench/nbench: 13.31% (1.3521 => 1.5321, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0181) MultiSource/Benchmarks/mafft/pairlocalalign: 9.21% (11.3843 => 12.4323, std.dev.: 0.0292) MultiSource/Applications/oggenc/oggenc: 8.78% (6.2844 => 6.8364, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/05-eks/eks: 8.50% (0.6120 => 0.6640, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.19% (5.6680 => 6.1320, std.dev.: 0.0358) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.7280 => 6.1960, std.dev.: 0.0518) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.00% (11.4440 => 12.3600, std.dev.: 0.0463) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.41% (0.6480 => 0.6960, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.01% (9.5802 => 10.1562, std.dev.: 0.0391) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.6240 => 1.7080, std.dev.: 0.0306) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.50% (0.4440 => 0.4640, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3040 => 0.3160, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7600 => 1.8240, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (6.8280 => 7.0720, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0132) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0065) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.15% (49.1529 => 50.7009, std.dev.: 0.0965) MultiSource/Applications/lua/lua: 3.10% (4.7720 => 4.9200, std.dev.: 0.0447) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (5.3840 => 5.5280, std.dev.: 0.0528) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0123) MultiSource/Applications/ClamAV/clamscan: 2.50% (19.2243 => 19.7044, std.dev.: 0.0397) MultiSource/Applications/SIBsim4/SIBsim4: 2.12% (1.6961 => 1.7321, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 1.92% (24.7575 => 25.2335, std.dev.: 0.0376) MultiSource/Applications/kimwitu++/kc: 1.50% (19.7491 => 20.0451, std.dev.: 0.0446) MultiSource/Benchmarks/Bullet/bullet: 1.31% (39.0726 => 39.5846, std.dev.: 0.0775) MultiSource/Benchmarks/PAQ8p/paq8p: 1.17% (2.7282 => 2.7602, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0036) MultiSource/Applications/ALAC/decode/alacconvert-decode: 100.00% (0.0120 => 0.0240, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.63% (3.9842 => 4.2883, std.dev.: 0.0233) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0242) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (0.5920 => 0.6160, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0157) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0649) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (25.4536 => 25.9056, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.68% (4.0563 => 4.1243, std.dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0136) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.18% (21.6534 => 17.9331, std.dev.: 0.0391) SingleSource/Benchmarks/Linpack/linpack-pc: -16.59% (7.8605 => 6.5564, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -9.68% (3.4722 => 3.1362, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0811) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.10% (0.3280 => 0.3080, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.79% (4.5123 => 4.2963, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.69% (2.9242 => 2.8162, std.dev.: 0.0065) MultiSource/Applications/aha/aha: -2.22% (2.8802 => 2.8162, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.73% (5.0963 => 5.0083, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 07:44:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 09:44:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140427144453.107F02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25050?compare_to=25044&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25050, Order: 207350, Start Time: 2014-04-27 10:06:53, End Time: 2014-04-27 14:51:37 To: 25044, Order: 207349, Start Time: 2014-04-27 05:18:17, End Time: 2014-04-27 10:03:44 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 16 (138 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/div: 60.00% (0.0200 => 0.0320, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Perm: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: 16.67% (0.0960 => 0.1120, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.00% (0.1000 => 0.1160, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.31% (0.2600 => 0.2920, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.39% (0.3080 => 0.3400, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 5.08% (0.2360 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.00% (0.2400 => 0.2520, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 3.28% (0.4880 => 0.5040, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.99% (0.5360 => 0.5520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.61% (1.9921 => 2.0241, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.36% (2.0601 => 2.0881, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 5.38% (0.3720 => 0.3920, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.89% (17.6723 => 19.5962, std.dev.: 0.0454) MultiSource/Applications/sqlite3/sqlite3: 1409.18% (1.7001 => 25.6576, std.dev.: 0.0426) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.28% (50.1010 => 51.7450, std.dev.: 0.1036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.46% (1.0520 => 1.1200, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (11.3920 => 12.3240, std.dev.: 0.0588) SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3407 => 3.0242, std.dev.: 0.0148) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0203, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7244, std.dev.: 0.0140) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0076) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0063) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0035) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0030) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 17.86% (0.2240 => 0.2640, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.10% (1.8281 => 2.1041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.28% (1.8201 => 2.0801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.98% (1.8601 => 2.1201, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.32% (1.8921 => 2.1441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.11% (2.1361 => 2.4162, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.50% (0.2240 => 0.2520, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0088) MultiSource/Benchmarks/NPB-serial/is/is: 12.00% (0.1000 => 0.1120, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.95% (1.8081 => 2.0241, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.94% (1.9761 => 2.2121, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.57% (2.1441 => 2.3921, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0048) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.00% (1.9201 => 2.1121, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.89% (2.1041 => 2.3121, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2120 => 0.2320, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.03% (1.8601 => 2.0281, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.96% (0.2680 => 0.2920, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0075) MultiSource/Applications/obsequi/Obsequi: 8.53% (1.8760 => 2.0360, std.dev.: 0.0320) MultiSource/Benchmarks/McCat/09-vor/vor: 8.51% (0.3760 => 0.4080, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (1.0880 => 1.1760, std.dev.: 0.0290) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.76% (0.4640 => 0.5000, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.69% (0.7280 => 0.7840, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 7.09% (1.0160 => 1.0880, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: 6.78% (0.4720 => 0.5040, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.6960 => 1.8000, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (6.4800 => 6.8360, std.dev.: 0.0579) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (2.9721 => 3.1202, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.82% (0.9960 => 1.0440, std.dev.: 0.0115) MultiSource/Applications/Burg/burg: 4.71% (1.5280 => 1.6000, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (5.8281 => 6.0881, std.dev.: 0.0308) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (9.6042 => 10.0242, std.dev.: 0.0247) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.8280 => 0.8640, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.8440 => 1.9240, std.dev.: 0.0260) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (6.5320 => 6.8080, std.dev.: 0.0328) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.85% (0.4160 => 0.4320, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (10.2283 => 10.6164, std.dev.: 0.0314) MultiSource/Applications/hbd/hbd: 3.70% (1.7280 => 1.7920, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.7480 => 1.8120, std.dev.: 0.0242) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6641 => 1.7241, std.dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 3.59% (1.7841 => 1.8481, std.dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0338) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (5.3960 => 5.5720, std.dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 3.12% (7.0524 => 7.2725, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0398) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1600 => 2.2200, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (3.0562 => 3.1402, std.dev.: 0.0159) MultiSource/Benchmarks/Bullet/bullet: 2.59% (38.6366 => 39.6366, std.dev.: 0.0659) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (16.3003 => 16.6883, std.dev.: 0.0397) MultiSource/Applications/SPASS/SPASS: 2.35% (18.5284 => 18.9645, std.dev.: 0.0332) MultiSource/Applications/JM/lencod/lencod: 2.16% (22.2206 => 22.7007, std.dev.: 0.0495) MultiSource/Applications/d/make_dparser: 1.81% (3.9761 => 4.0481, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0091) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 1.55% (19.8291 => 20.1371, std.dev.: 0.0533) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (2.1201 => 2.4602, std.dev.: 0.0440) MultiSource/Applications/siod/siod: 10.06% (2.8642 => 3.1522, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 3.64% (6.5964 => 6.8364, std.dev.: 0.0377) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.91% (11.4967 => 11.7167, std.dev.: 0.0170) MultiSource/Applications/JM/lencod/lencod: 1.57% (8.1285 => 8.2565, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9684 => 6.0484, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.0243 => 5.0763, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.20% (94.8339 => 49.1271, std.dev.: 8.4410) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.18% (49.9431 => 32.8701, std.dev.: 0.2336) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.65% (25.7136 => 17.0611, std.dev.: 0.1454) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.28% (37.0863 => 28.4538, std.dev.: 0.4998) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -14.89% (7.8165 => 6.6524, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0128) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.30% (4.2363 => 4.0963, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8043 => 4.6763, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.00% (2.8002 => 2.7442, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0221) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.47% (2.4522 => 2.4162, std.dev.: 0.0127) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 07:58:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 09:58:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427145848.D12252A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25051?compare_to=25047&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25051, Order: 207351, Start Time: 2014-04-27 10:23:46, End Time: 2014-04-27 15:05:33 To: 25047, Order: 207350, Start Time: 2014-04-27 07:21:29, End Time: 2014-04-27 12:02:45 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (106 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 33.33% (0.0600 => 0.0800, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/misr: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/EH/except: 7.02% (0.2280 => 0.2440, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.71% (0.3400 => 0.3560, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 4.65% (0.3440 => 0.3600, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 3.15% (2.4160 => 2.4920, std.dev.: 0.0240) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.81% (1.5680 => 1.6120, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.27% (1.2321 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.16% (1.3761 => 1.3921, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.49% (0.7280 => 0.7680, std.dev.: 0.0110) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.05% (0.0760 => 0.0920, std.dev.: 0.0026) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: 11.39% (0.3160 => 0.3520, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.44% (1.2361 => 1.3281, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0337) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0725) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0402) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0226) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.32% (0.7400 => 0.7720, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0532) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0423) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.29% (5.8400 => 6.0320, std.dev.: 0.0253) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0465) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: 2.38% (17.6165 => 18.0365, std.dev.: 0.0601) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0139) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1930, std.dev.: 0.0746) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0262) MultiSource/Benchmarks/Bullet/bullet: 2.16% (37.0925 => 37.8926, std.dev.: 0.0865) MultiSource/Applications/kimwitu++/kc: 2.02% (18.8170 => 19.1971, std.dev.: 0.0442) MultiSource/Applications/oggenc/oggenc: 2.00% (5.7964 => 5.9124, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 1.31% (23.7574 => 24.0695, std.dev.: 0.0302) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0313) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.49% (0.7280 => 0.7680, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0208) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 3.10% (21.1533 => 21.8094, std.dev.: 0.1854) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.51% (4.5043 => 4.5723, std.dev.: 0.0262) MultiSource/Applications/minisat/minisat: 1.26% (6.6564 => 6.7404, std.dev.: 0.0215) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -26.67% (0.0600 => 0.0440, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: -2.60% (1.3841 => 1.3481, std.dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/health/health: -4.90% (0.4080 => 0.3880, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -3.89% (2.6762 => 2.5722, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 08:08:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 10:08:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427150826.41EA32A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25052?compare_to=25045&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25052, Order: 207351, Start Time: 2014-04-27 10:28:54, End Time: 2014-04-27 15:15:12 To: 25045, Order: 207349, Start Time: 2014-04-27 05:39:18, End Time: 2014-04-27 10:25:33 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1094 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/TestLoop: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/Regression/C/PR491: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 80.00% (0.0200 => 0.0360, std.dev.: 0.0053) SingleSource/UnitTests/Vector/sumarray: 60.00% (0.0200 => 0.0320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.29% (0.1120 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 10.00% (0.7600 => 0.8360, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2360 => 0.2520, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4440 => 0.4720, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.14% (1.7481 => 1.7681, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.11% (1.8081 => 1.8281, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 3.31% (0.9681 => 1.0001, std.dev.: 0.0111) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0130) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 08:52:03 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 08:52:03 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140427155204.26E71500BC30@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14857 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207363 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17843 of 17844) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17844 of 17844) 1 warning(s) in tests. Testing Time: 360.26s ******************** Failing Tests (1): Clang Tools :: clang-tidy/static-analyzer.cpp Expected Passes : 17694 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang Tools::static-analyzer.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:16:12: error: expected string not found in input // CHECK: warning: Attempt to free released memory [clang-analyzer-unix.Malloc] ^ :2:2: note: scanning from here delete p; ^ :13:171: note: possible intended match here /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:15:3: warning: Attempt to free released memory [clang-analyzer-alpha.unix.MallocWithAnnotations] ^ -- ******************** Last 15 lines of 'warnings (3)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests // CHECK: warning: Attempt to free released memory [clang-analyzer-unix.Malloc] /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:15:3: warning: Attempt to free released memory [clang-analyzer-alpha.unix.MallocWithAnnotations] From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 08:52:04 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 08:52:04 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140427155204.53D05500BC38@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19294 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207363 Blamelist: alexfh BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 08:52:04 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 08:52:04 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140427155204.53D4A500BC39@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19294 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207363 Blamelist: alexfh BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: test/clang-tidy/static-analyzer.cpp On: http://10.1.1.2/svn/llvm-project For: clang-tools-extra At: Sun 27 Apr 2014 08:35:32 Changed By: alexfh Comments: Specify checks in a more reliable way. Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 08:52:03 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 08:52:03 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140427155204.27F29500BC32@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14857 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207363 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17843 of 17844) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17844 of 17844) 1 warning(s) in tests. Testing Time: 360.26s ******************** Failing Tests (1): Clang Tools :: clang-tidy/static-analyzer.cpp Expected Passes : 17694 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'Clang Tools::static-analyzer.cpp': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:16:12: error: expected string not found in input // CHECK: warning: Attempt to free released memory [clang-analyzer-unix.Malloc] ^ :2:2: note: scanning from here delete p; ^ :13:171: note: possible intended match here /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:15:3: warning: Attempt to free released memory [clang-analyzer-alpha.unix.MallocWithAnnotations] ^ -- ******************** Last 15 lines of 'warnings (3)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests // CHECK: warning: Attempt to free released memory [clang-analyzer-unix.Malloc] /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang.src/tools/extra/test/clang-tidy/static-analyzer.cpp:15:3: warning: Attempt to free released memory [clang-analyzer-alpha.unix.MallocWithAnnotations] From llvm-testresults at cs.uiuc.edu Sun Apr 27 08:59:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 10:59:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140427155916.856092A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25053?compare_to=25046&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25053, Order: 207351, Start Time: 2014-04-27 11:18:10, End Time: 2014-04-27 16:06:01 To: 25046, Order: 207350, Start Time: 2014-04-27 06:26:57, End Time: 2014-04-27 11:14:52 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (132 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-12-Int64ToFP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C++/fixups: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C/casts: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 26.67% (0.0600 => 0.0760, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.60% (0.7680 => 0.7880, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.40% (2.0001 => 2.0281, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 23.33% (0.1200 => 0.1480, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0039) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.71% (1.6801 => 2.0281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.52% (1.6961 => 2.0441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.00% (1.7401 => 2.0881, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.72% (1.7241 => 2.0641, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.62% (1.6721 => 2.0001, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.49% (1.7441 => 2.0841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.42% (1.7921 => 2.1401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.38% (1.6921 => 2.0201, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.07% (1.7201 => 2.0481, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 18.94% (1.6681 => 1.9841, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.78% (1.7681 => 2.1001, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.62% (1.8041 => 2.1401, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 18.14% (1.8081 => 2.1361, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.80% (1.9761 => 2.3081, std.dev.: 0.0127) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.67% (0.1440 => 0.1680, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.53% (1.9601 => 2.2841, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1360 => 0.1560, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.44% (0.8601 => 0.9241, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.72% (11.7880 => 12.5800, std.dev.: 0.0457) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.25% (1.7280 => 1.8360, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (6.7200 => 7.1240, std.dev.: 0.0529) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.4160 => 1.4880, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.82% (0.3320 => 0.3480, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.5240 => 1.5960, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (1.6481 => 1.7201, std.dev.: 0.0121) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.23% (0.7560 => 0.7880, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (9.9842 => 10.3962, std.dev.: 0.0442) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.6801 => 1.7481, std.dev.: 0.0129) MultiSource/Applications/lua/lua: 4.01% (4.7920 => 4.9840, std.dev.: 0.0329) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.8201 => 1.8921, std.dev.: 0.0185) MultiSource/Applications/oggenc/oggenc: 3.93% (6.9124 => 7.1844, std.dev.: 0.0216) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.86% (1.3480 => 1.4000, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (6.8321 => 7.0921, std.dev.: 0.0338) MultiSource/Applications/treecc/treecc: 3.66% (2.6200 => 2.7160, std.dev.: 0.0196) MultiSource/Applications/d/make_dparser: 3.43% (3.9641 => 4.1001, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (2.0680 => 2.1360, std.dev.: 0.0205) MultiSource/Applications/JM/ldecod/ldecod: 3.26% (10.3203 => 10.6564, std.dev.: 0.0279) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0203) MultiSource/Benchmarks/MallocBench/gs/gs: 2.96% (5.5480 => 5.7120, std.dev.: 0.0324) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (1.1000 => 1.1320, std.dev.: 0.0117) MultiSource/Applications/SPASS/SPASS: 2.81% (18.4924 => 19.0125, std.dev.: 0.0630) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.58% (51.1089 => 52.4289, std.dev.: 0.0673) MultiSource/Applications/kimwitu++/kc: 2.51% (19.7371 => 20.2331, std.dev.: 0.0304) MultiSource/Applications/JM/lencod/lencod: 2.42% (22.6287 => 23.1767, std.dev.: 0.0511) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (1.0001 => 1.0241, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (3.0122 => 3.0762, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 2.00% (38.9366 => 39.7166, std.dev.: 0.0958) MultiSource/Applications/ClamAV/clamscan: 1.90% (20.2445 => 20.6285, std.dev.: 0.0507) MultiSource/Applications/siod/siod: 1.74% (2.7562 => 2.8042, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (16.5963 => 16.8603, std.dev.: 0.0526) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2203 => 4.2843, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.14% (25.1895 => 25.4775, std.dev.: 0.0501) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0128) MultiSource/Applications/siod/siod: 10.18% (2.8282 => 3.1162, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.02% (3.4842 => 3.6242, std.dev.: 0.0272) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0395) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.25% (5.5363 => 5.7164, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.69% (4.0203 => 4.0883, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.55% (1.2921 => 1.3121, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.32% (4.2443 => 4.3003, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.64% (6.2884 => 0.8400, std.dev.: 0.0119) SingleSource/UnitTests/Vector/constpool: -81.45% (10.9087 => 2.0241, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/nestedloop: -60.19% (2.9642 => 1.1801, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0121) SingleSource/UnitTests/2003-08-11-VaListArg: -50.00% (0.0400 => 0.0200, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0044) MultiSource/Applications/obsequi/Obsequi: -22.36% (2.6481 => 2.0560, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.36% (7.4801 => 6.2560, std.dev.: 0.0480) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.31% (7.5041 => 6.2800, std.dev.: 0.0392) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -3.14% (13.5243 => 13.1003, std.dev.: 0.0467) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.26% (21.6534 => 17.9171, std.dev.: 0.0449) SingleSource/Benchmarks/Linpack/linpack-pc: -15.23% (7.8005 => 6.6124, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.36% (2.6082 => 2.3641, std.dev.: 0.0881) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0054) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: -3.18% (5.1603 => 4.9963, std.dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.98% (2.6202 => 2.5682, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: -1.75% (11.6527 => 11.4487, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: -1.25% (8.3085 => 8.2045, std.dev.: 0.0245) MultiSource/Benchmarks/sim/sim: -1.12% (4.9883 => 4.9323, std.dev.: 0.0137) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 09:25:07 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 09:25:07 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140427162507.A158D500C05F@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19295 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207364 Blamelist: alexfh Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sun Apr 27 09:33:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 11:33:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427163312.C0A1B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25054?compare_to=25051&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25054, Order: 207352, Start Time: 2014-04-27 11:56:22, End Time: 2014-04-27 16:39:55 To: 25051, Order: 207351, Start Time: 2014-04-27 10:23:46, End Time: 2014-04-27 15:05:33 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (106 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/ms_struct_pack_layout: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4360 => 0.4560, std.dev.: 0.0047) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.65% (1.2080 => 1.2400, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.39% (2.0080 => 2.0560, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.27% (1.2561 => 1.2721, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (0.9721 => 0.9961, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.06% (5.6324 => 5.7484, std.dev.: 0.0344) SingleSource/Benchmarks/Misc/ffbench: 1.80% (0.8881 => 0.9041, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.76% (1.1281 => 1.2721, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0164) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0758) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0042) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0099) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0504) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0398) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0342) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 2.66% (17.6165 => 18.0845, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.5480 => 1.5880, std.dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 2.53% (0.9480 => 0.9720, std.dev.: 0.0084) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0153) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0234) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1929, std.dev.: 0.1251) MultiSource/Applications/kimwitu++/kc: 2.04% (18.8170 => 19.2011, std.dev.: 0.0432) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8486, std.dev.: 0.0625) MultiSource/Applications/oggenc/oggenc: 1.79% (5.7964 => 5.9004, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0125) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0374) MultiSource/Applications/sqlite3/sqlite3: 1.13% (23.7574 => 24.0255, std.dev.: 0.0613) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 35.00% (0.0800 => 0.1080, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0254) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 3.03% (21.1533 => 21.7934, std.dev.: 0.1525) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0106) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0149) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0571) MultiSource/Applications/lambda-0_1_3/lambda: 1.04% (5.0123 => 5.0643, std.dev.: 0.0146) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0025) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.5522 => 3.5162, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 09:46:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 11:46:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427164631.BA6E62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25055?compare_to=25054&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25055, Order: 207354, Start Time: 2014-04-27 12:13:56, End Time: 2014-04-27 16:53:14 To: 25054, Order: 207352, Start Time: 2014-04-27 11:56:22, End Time: 2014-04-27 16:39:55 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (109 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Towers: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.54% (0.1040 => 0.1160, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 11.11% (0.1080 => 0.1200, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 10.00% (0.1200 => 0.1320, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.69% (0.3120 => 0.3360, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.45% (0.3480 => 0.3600, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 20.83% (0.0960 => 0.1160, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 3.91% (0.5120 => 0.5320, std.dev.: 0.0069) MultiSource/Applications/obsequi/Obsequi: 3.10% (2.0641 => 2.1281, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.15% (1.7321 => 1.7121, std.dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0031) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/nestedloop: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.93% (0.1080 => 0.1360, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.81% (0.1240 => 0.1560, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0745) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0408) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0303) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7880 => 0.8200, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0329) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (10.4082 => 10.7242, std.dev.: 0.0486) MultiSource/Applications/siod/siod: 2.95% (2.5721 => 2.6481, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 2.50% (17.6165 => 18.0565, std.dev.: 0.0723) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2329, std.dev.: 0.0841) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9246, std.dev.: 0.0493) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0402) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (5.8400 => 5.9640, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0129) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0178) MultiSource/Applications/kimwitu++/kc: 1.53% (18.8170 => 19.1051, std.dev.: 0.0538) MultiSource/Applications/sqlite3/sqlite3: 1.52% (23.7574 => 24.1175, std.dev.: 0.0489) MultiSource/Applications/SPASS/SPASS: 1.03% (17.5484 => 17.7284, std.dev.: 0.0459) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/kimwitu++/kc: 133.33% (0.0120 => 0.0280, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 6.37% (1.0681 => 1.1361, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0358) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 3.08% (21.1533 => 21.8054, std.dev.: 0.1111) MultiSource/Applications/obsequi/Obsequi: 2.90% (2.0681 => 2.1281, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0149) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4842 => 3.5322, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0148) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0500) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0078) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -28.57% (0.0560 => 0.0400, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/health/health: -4.90% (0.4080 => 0.3880, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0085) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0344) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 09:51:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 11:51:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427165109.48C1F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25056?compare_to=25055&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25056, Order: 207356, Start Time: 2014-04-27 12:16:23, End Time: 2014-04-27 16:57:52 To: 25055, Order: 207354, Start Time: 2014-04-27 12:13:56, End Time: 2014-04-27 16:53:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (98 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 42.86% (0.0280 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 31.58% (0.0760 => 0.1000, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.26% (0.6840 => 0.7200, std.dev.: 0.0130) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.10% (1.4601 => 1.4761, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 29.17% (0.0960 => 0.1240, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 3.10% (1.2921 => 1.3321, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0058) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.55% (0.2200 => 0.2520, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.09% (1.2361 => 1.3361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.66% (1.1481 => 1.2361, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0629) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0450) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.6840 => 0.7240, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0227) MultiSource/Applications/lua/lua: 4.96% (4.5200 => 4.7440, std.dev.: 0.0368) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0207) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0324) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0201) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0389) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0556) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0135) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0407) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (5.8400 => 5.9760, std.dev.: 0.0392) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.31% (48.1088 => 49.2209, std.dev.: 0.0981) MultiSource/Benchmarks/Bullet/bullet: 2.24% (37.0925 => 37.9245, std.dev.: 0.0362) MultiSource/Applications/kimwitu++/kc: 2.00% (18.8170 => 19.1931, std.dev.: 0.0597) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (7.8562 => 7.9882, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0146) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (0.9561 => 0.9681, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.21% (23.7574 => 24.0455, std.dev.: 0.0511) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0168) MultiSource/Applications/lua/lua: 2.99% (21.1533 => 21.7854, std.dev.: 0.1205) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0091) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0141) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0201) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 11:05:19 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 11:05:19 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140427180522.C8988500CD3E@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/738 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 207065 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4617 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpVZmze0exe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmpVZmze0exe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp_KS8beexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp_KS8beexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Sun Apr 27 11:11:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 13:11:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427181159.0267B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25057?compare_to=25048&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25057, Order: 207356, Start Time: 2014-04-27 13:36:16, End Time: 2014-04-27 18:18:45 To: 25048, Order: 207350, Start Time: 2014-04-27 08:50:21, End Time: 2014-04-27 13:32:48 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (147 on baseline) Performance Improvements: 4 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2008-01-07-LongDouble: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.00% (0.0800 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.4520 => 0.4680, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.30% (1.5401 => 1.5601, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.26% (1.9081 => 1.9321, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 20.93% (0.1720 => 0.2080, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.07% (5.4083 => 5.5203, std.dev.: 0.0279) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.39% (4.2483 => 4.1043, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.11% (3.9922 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8162 => 2.7722, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.16% (2.7482 => 2.7162, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0111) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0148) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0069) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Regression/C/sumarray: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.81% (0.2920 => 0.3440, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 17.65% (0.1360 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.23% (1.0240 => 1.1800, std.dev.: 0.0222) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.05% (0.3320 => 0.3720, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.38% (1.0240 => 1.1200, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.18% (1.6121 => 1.7601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.04% (1.4601 => 1.5921, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.89% (1.4841 => 1.6161, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0118) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0045) MultiSource/Applications/obsequi/Obsequi: 8.35% (1.8680 => 2.0240, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.99% (1.5521 => 1.6761, std.dev.: 0.0142) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.73% (1.4481 => 1.5601, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.6121 => 1.7361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.04% (0.2840 => 0.3040, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.84% (1.5201 => 1.6241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (11.6440 => 12.4200, std.dev.: 0.0415) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (6.4680 => 6.8880, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.97% (0.2680 => 0.2840, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.95% (1.4801 => 1.5681, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.91% (1.6921 => 1.7921, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0068) MultiSource/Applications/Burg/burg: 5.84% (1.5080 => 1.5960, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.56% (1.5841 => 1.6721, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.45% (1.4681 => 1.5481, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.38% (1.5600 => 1.6440, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0201) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.10% (9.4842 => 9.9682, std.dev.: 0.0334) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (5.8121 => 6.1081, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.01% (1.4361 => 1.5081, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0219) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.5480 => 1.6240, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.83% (1.7400 => 1.8240, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9681 => 1.0081, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 3.86% (10.0443 => 10.4323, std.dev.: 0.0247) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.85% (0.3120 => 0.3240, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 3.70% (21.9606 => 22.7728, std.dev.: 0.0315) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (6.5080 => 6.7480, std.dev.: 0.0358) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (6.5440 => 6.7680, std.dev.: 0.0480) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0221) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.23% (50.0290 => 51.6450, std.dev.: 0.1082) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 3.01% (4.7880 => 4.9320, std.dev.: 0.0282) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (5.3600 => 5.5200, std.dev.: 0.0575) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0151) MultiSource/Benchmarks/Bullet/bullet: 2.82% (38.4046 => 39.4886, std.dev.: 0.0411) MultiSource/Applications/SPASS/SPASS: 2.63% (18.4404 => 18.9245, std.dev.: 0.0451) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (4.1843 => 4.2803, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 2.15% (19.6891 => 20.1131, std.dev.: 0.0620) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (16.3483 => 16.7003, std.dev.: 0.0567) MultiSource/Applications/ClamAV/clamscan: 2.06% (19.0444 => 19.4364, std.dev.: 0.0526) MultiSource/Applications/d/make_dparser: 1.51% (3.9681 => 4.0281, std.dev.: 0.0230) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0338) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.70% (2.1401 => 2.4762, std.dev.: 0.0423) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 10.21% (2.8602 => 3.1522, std.dev.: 0.0303) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (1.5921 => 1.6841, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.88% (6.6684 => 6.8604, std.dev.: 0.0338) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.10% (8.1845 => 8.3565, std.dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 1.87% (8.1245 => 8.2765, std.dev.: 0.0383) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.81% (3.9842 => 4.0563, std.dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: 1.67% (11.5087 => 11.7007, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9724 => 6.0604, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.10% (10.6247 => 2.0081, std.dev.: 0.0207) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.47% (91.8497 => 49.1671, std.dev.: 10.6706) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.39% (50.3031 => 33.0021, std.dev.: 0.1944) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.37% (26.0616 => 17.1051, std.dev.: 0.1177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.75% (42.1466 => 28.3418, std.dev.: 0.5685) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1117) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0088) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (4.1243 => 4.0483, std.dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.70% (2.8202 => 2.7722, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 12:02:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 14:02:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140427190237.E9EE42A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25058?compare_to=25049&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25058, Order: 207356, Start Time: 2014-04-27 14:27:03, End Time: 2014-04-27 19:09:23 To: 25049, Order: 207350, Start Time: 2014-04-27 09:41:27, End Time: 2014-04-27 14:23:31 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 16 (149 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/divides: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/Threads/tls: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 50.00% (0.0400 => 0.0600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_isamax: 20.00% (0.0800 => 0.0960, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.86% (0.4200 => 0.4320, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.36% (0.6920 => 0.7360, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.05% (0.9881 => 1.0281, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.70% (4.7163 => 4.7963, std.dev.: 0.0291) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.38% (0.5040 => 0.4920, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0093) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0081) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 322.46% (0.2320 => 0.9801, std.dev.: 0.0112) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 196.83% (0.2520 => 0.7480, std.dev.: 0.0141) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0051) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 92.31% (0.1040 => 0.2000, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0048) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0076) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0058) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 50.00% (0.7040 => 1.0560, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0048) MultiSource/Applications/obsequi/Obsequi: 42.53% (1.3920 => 1.9840, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0078) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.48% (1.2401 => 1.5561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0115) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.38% (1.2161 => 1.4761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.81% (1.2521 => 1.5001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.38% (1.3001 => 1.5521, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.18% (1.1441 => 1.3521, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/bh/bh: 18.09% (0.3760 => 0.4440, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.86% (1.2321 => 1.4521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 17.53% (1.2321 => 1.4481, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 17.53% (8.5802 => 10.0843, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.82% (1.2841 => 1.5001, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 15.84% (1.2881 => 1.4921, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 14.84% (19.5406 => 22.4407, std.dev.: 0.0306) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.69% (5.3360 => 6.1201, std.dev.: 0.0217) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.49% (1.7400 => 1.9400, std.dev.: 0.0250) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 8.97% (6.2844 => 6.8484, std.dev.: 0.0160) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (11.3843 => 12.4043, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.31% (5.7280 => 6.2040, std.dev.: 0.0305) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.21% (11.4440 => 12.3840, std.dev.: 0.0667) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.48% (5.6680 => 6.0920, std.dev.: 0.0551) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.41% (0.3240 => 0.3480, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 7.19% (0.5560 => 0.5960, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.06% (0.6800 => 0.7280, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.22% (9.5802 => 10.1762, std.dev.: 0.0495) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (1.4760 => 1.5640, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.89% (0.7360 => 0.7720, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (1.6240 => 1.6920, std.dev.: 0.0186) MultiSource/Applications/lua/lua: 3.52% (4.7720 => 4.9400, std.dev.: 0.0339) MultiSource/Benchmarks/MallocBench/gs/gs: 3.42% (5.3840 => 5.5680, std.dev.: 0.0565) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.19% (0.3760 => 0.3880, std.dev.: 0.0044) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.02% (49.1529 => 50.6369, std.dev.: 0.1260) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.93% (6.8280 => 7.0280, std.dev.: 0.0497) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.68% (2.0920 => 2.1480, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 2.41% (19.2243 => 19.6884, std.dev.: 0.0572) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 2.10% (24.7575 => 25.2775, std.dev.: 0.0701) MultiSource/Applications/kimwitu++/kc: 1.74% (19.7491 => 20.0931, std.dev.: 0.0460) MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (2.7282 => 2.7722, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (3.0402 => 3.0802, std.dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: 1.12% (39.0726 => 39.5086, std.dev.: 0.0833) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0128) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.54% (3.9842 => 4.3243, std.dev.: 0.0156) MultiSource/Applications/siod/siod: 4.16% (2.9842 => 3.1082, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.05% (0.9881 => 1.0281, std.dev.: 0.0106) MultiSource/Applications/minisat/minisat: 3.75% (6.8204 => 7.0764, std.dev.: 0.0332) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.38% (0.8281 => 0.8561, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0353) MultiSource/Benchmarks/Olden/power/power: 2.06% (1.3601 => 1.3881, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (25.4536 => 25.8816, std.dev.: 0.0214) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.0563 => 4.1203, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0140) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (1.2961 => 1.3121, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.56% (11.0207 => 2.0321, std.dev.: 0.0082) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.42% (21.6534 => 17.8811, std.dev.: 0.0424) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.82% (5.2763 => 4.9163, std.dev.: 0.0970) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -3.43% (0.7000 => 0.6760, std.dev.: 0.0085) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0165) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (5.0963 => 5.0203, std.dev.: 0.0197) MultiSource/Benchmarks/sim/sim: -1.12% (4.9963 => 4.9403, std.dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: -1.11% (11.5567 => 11.4287, std.dev.: 0.0196) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 12:34:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 12:34:46 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140427193446.34470500DC00@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19302 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207379 Blamelist: ctopper BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 12:34:45 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 12:34:45 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140427193446.0FD25500DBFA@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14865 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207379 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': make[2]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/CodeGen/Release+Asserts/Analysis.o] Error 1 1 error generated. In file included from /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/CodeGen/BasicTargetTransformInfo.cpp:20: In file included from /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include/llvm/Target/TargetLowering.h:29: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include/llvm/CodeGen/SelectionDAGNodes.h:1692:12: error: use of undeclared identifier 'NumOps' assert(NumOps == 5 && "wrong number of operations"); ^ /usr/include/assert.h:93:25: note: expanded from macro 'assert' (__builtin_expect(!(e), 0) ? __assert_rtn(__func__, __FILE__, __LINE__, #e) : (void)0) ^ make[2]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/CodeGen/Release+Asserts/AggressiveAntiDepBreaker.o] Error 1 1 error generated. make[2]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/CodeGen/Release+Asserts/BasicTargetTransformInfo.o] Error 1 make[1]: *** [CodeGen/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 12:34:45 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 12:34:45 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140427193446.0E95E500DBF9@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14865 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207379 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': make[2]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/CodeGen/Release+Asserts/Analysis.o] Error 1 1 error generated. In file included from /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/lib/CodeGen/BasicTargetTransformInfo.cpp:20: In file included from /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include/llvm/Target/TargetLowering.h:29: /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/include/llvm/CodeGen/SelectionDAGNodes.h:1692:12: error: use of undeclared identifier 'NumOps' assert(NumOps == 5 && "wrong number of operations"); ^ /usr/include/assert.h:93:25: note: expanded from macro 'assert' (__builtin_expect(!(e), 0) ? __assert_rtn(__func__, __FILE__, __LINE__, #e) : (void)0) ^ make[2]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/CodeGen/Release+Asserts/AggressiveAntiDepBreaker.o] Error 1 1 error generated. make[2]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/lib/CodeGen/Release+Asserts/BasicTargetTransformInfo.o] Error 1 make[1]: *** [CodeGen/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 12:34:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 12:34:46 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140427193446.3434A500DBFF@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19302 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207379 Blamelist: ctopper BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: include/llvm/CodeGen/SelectionDAG.h include/llvm/CodeGen/SelectionDAGNodes.h lib/CodeGen/SelectionDAG/SelectionDAG.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 12:31:32 Changed By: ctopper Comments: Const-correct SelectionDAG::getAtomic.Properties: Files: include/llvm/CodeGen/SelectionDAG.h lib/CodeGen/SelectionDAG/SelectionDAG.cpp lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp lib/Target/AArch64/AArch64ISelLowering.cpp lib/Target/ARM/ARMISelLowering.cpp lib/Target/ARM64/ARM64ISelLowering.cpp lib/Target/Hexagon/HexagonISelLowering.cpp lib/Target/Mips/MipsISelLowering.cpp lib/Target/Mips/MipsSEISelLowering.cpp lib/Target/NVPTX/NVPTXISelLowering.cpp lib/Target/PowerPC/PPCISelLowering.cpp lib/Target/R600/AMDGPUISelLowering.cpp lib/Target/R600/R600ISelLowering.cpp lib/Target/R600/SIISelLowering.cpp lib/Target/Sparc/SparcISelLowering.cpp lib/Target/SystemZ/SystemZISelLowering.cpp lib/Target/X86/X86ISelDAGToDAG.cpp lib/Target/X86/X86ISelLowering.cpp lib/Target/XCore/XCoreISelLowering.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 12:31:33 Changed By: ctopper Comments: Convert SelectionDAG::getMergeValues to use ArrayRef.Properties: Files: include/llvm/CodeGen/SelectionDAGNodes.h lib/CodeGen/SelectionDAG/SelectionDAG.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 12:31:33 Changed By: ctopper Comments: Convert SDNode constructor to use ArrayRef.Properties: Files: include/llvm/CodeGen/SelectionDAG.h lib/CodeGen/SelectionDAG/DAGCombiner.cpp lib/CodeGen/SelectionDAG/SelectionDAG.cpp lib/Target/X86/X86ISelLowering.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 12:31:33 Changed By: ctopper Comments: Convert one last signature of getNode to take an ArrayRef of SDUse.Properties: Files: include/llvm/CodeGen/SelectionDAG.h lib/CodeGen/SelectionDAG/SelectionDAG.cpp lib/Target/AArch64/AArch64ISelDAGToDAG.cpp lib/Target/ARM/ARMISelDAGToDAG.cpp lib/Target/ARM64/ARM64ISelDAGToDAG.cpp lib/Target/MSP430/MSP430ISelDAGToDAG.cpp lib/Target/PowerPC/PPCISelDAGToDAG.cpp lib/Target/R600/AMDGPUISelDAGToDAG.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 12:31:33 Changed By: ctopper Comments: Convert SelectionDAG::SelectNodeTo to use ArrayRef.Properties: Files: include/llvm/CodeGen/SelectionDAG.h lib/CodeGen/SelectionDAG/ScheduleDAGSDNodes.cpp lib/CodeGen/SelectionDAG/SelectionDAG.cpp lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp lib/Target/Mips/MipsSEISelLowering.cpp lib/Target/R600/SIISelLowering.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 12:31:33 Changed By: ctopper Comments: Convert SelectionDAG::MorphNodeTo to use ArrayRef.Properties: Files: include/llvm/CodeGen/SelectionDAGISel.h lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 12:31:33 Changed By: ctopper Comments: Convert SelectionDAGISel::MorphNode to use ArrayRef.Properties: LOGS: From llvm-testresults at cs.uiuc.edu Sun Apr 27 12:33:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 14:33:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140427193349.F11F0312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25059?compare_to=25050&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25059, Order: 207356, Start Time: 2014-04-27 14:55:11, End Time: 2014-04-27 19:40:34 To: 25050, Order: 207350, Start Time: 2014-04-27 10:06:53, End Time: 2014-04-27 14:51:37 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 8 (127 on baseline) Performance Improvements: 3 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: 12.12% (0.1320 => 0.1480, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.00% (0.3000 => 0.3120, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.54% (4.0963 => 4.2003, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.11% (4.6763 => 4.7283, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -7.58% (0.2640 => 0.2440, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.21% (4.3003 => 4.2483, std.dev.: 0.0181) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: -1.18% (2.3761 => 2.3481, std.dev.: 0.0106) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.82% (17.6723 => 19.5844, std.dev.: 0.0362) MultiSource/Applications/sqlite3/sqlite3: 1407.53% (1.7001 => 25.6296, std.dev.: 0.0411) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.99% (50.1010 => 51.6010, std.dev.: 0.1258) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (1.0520 => 1.0960, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (11.3920 => 12.2840, std.dev.: 0.0681) SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3407 => 3.0242, std.dev.: 0.0124) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0203, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0562) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0111) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0108) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0050) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/tsp/tsp: 15.62% (0.1280 => 0.1480, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.88% (1.8281 => 2.1001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.44% (1.8561 => 2.1241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.98% (1.8601 => 2.1201, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.85% (1.8201 => 2.0721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.49% (2.1361 => 2.4242, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.41% (2.0281 => 2.3001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.26% (1.9601 => 2.2201, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.11% (1.8921 => 2.1401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.94% (1.9161 => 2.1641, std.dev.: 0.0143) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.76% (1.9121 => 2.1561, std.dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.50% (0.4160 => 0.4680, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.50% (2.1121 => 2.3761, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.50% (1.8081 => 2.0161, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.06% (1.7721 => 1.9681, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.55% (1.8201 => 2.0121, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.41% (1.8441 => 2.0361, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3480 => 0.3840, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.32% (1.9761 => 2.1801, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.32% (1.9001 => 2.0961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.27% (2.1041 => 2.3201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.21% (1.9201 => 2.1161, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.06% (2.0681 => 2.2761, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.65% (1.9481 => 2.1361, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.37% (1.8361 => 2.0081, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 8.93% (0.2240 => 0.2440, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.70% (0.1840 => 0.2000, std.dev.: 0.0059) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: 7.89% (1.8760 => 2.0240, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 6.67% (0.1800 => 0.1920, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.80% (6.4800 => 6.8560, std.dev.: 0.0396) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (1.6960 => 1.7800, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/matrix: 4.29% (0.2800 => 0.2920, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (1.8440 => 1.9200, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4920 => 0.5120, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 4.04% (1.7841 => 1.8561, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.00% (9.6042 => 9.9882, std.dev.: 0.0312) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (6.5320 => 6.7920, std.dev.: 0.0478) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (5.8281 => 6.0561, std.dev.: 0.0370) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0072) MultiSource/Applications/Burg/burg: 3.66% (1.5280 => 1.5840, std.dev.: 0.0144) MultiSource/Applications/JM/ldecod/ldecod: 3.60% (10.2283 => 10.5964, std.dev.: 0.0353) MultiSource/Applications/hbd/hbd: 3.47% (1.7280 => 1.7880, std.dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0156) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.37% (1.6641 => 1.7201, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 3.19% (0.3760 => 0.3880, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 3.09% (2.5880 => 2.6680, std.dev.: 0.0256) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (5.3960 => 5.5560, std.dev.: 0.0353) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0469) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 2.67% (4.7920 => 4.9200, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (16.3003 => 16.7003, std.dev.: 0.0520) MultiSource/Applications/oggenc/oggenc: 2.38% (7.0524 => 7.2205, std.dev.: 0.0185) MultiSource/Applications/JM/lencod/lencod: 2.21% (22.2206 => 22.7127, std.dev.: 0.0437) MultiSource/Applications/SPASS/SPASS: 2.12% (18.5284 => 18.9205, std.dev.: 0.0384) MultiSource/Applications/d/make_dparser: 1.91% (3.9761 => 4.0521, std.dev.: 0.0229) MultiSource/Benchmarks/Bullet/bullet: 1.85% (38.6366 => 39.3526, std.dev.: 0.0515) MultiSource/Applications/kimwitu++/kc: 1.13% (19.8291 => 20.0531, std.dev.: 0.0450) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 200.00% (0.0080 => 0.0240, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.21% (2.1201 => 2.4002, std.dev.: 0.0451) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0351) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.98% (11.4967 => 11.7247, std.dev.: 0.0178) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.57% (8.1285 => 8.2565, std.dev.: 0.0371) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 1.12% (1.4241 => 1.4401, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (3.9442 => 3.9882, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.0243 => 5.0803, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.54% (10.4007 => 2.0241, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.83% (2.9562 => 0.8920, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.65% (0.6880 => 0.6560, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.18% (94.8339 => 49.1471, std.dev.: 9.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.15% (49.9431 => 32.8861, std.dev.: 0.1596) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.71% (25.7136 => 17.0451, std.dev.: 0.0959) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.81% (37.0863 => 28.6258, std.dev.: 0.3952) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.57% (1.2681 => 1.1721, std.dev.: 0.0079) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.58% (4.8043 => 4.7283, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 12:35:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 14:35:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427193538.3FC3A312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25060?compare_to=25056&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25060, Order: 207357, Start Time: 2014-04-27 15:02:33, End Time: 2014-04-27 19:42:19 To: 25056, Order: 207356, Start Time: 2014-04-27 12:16:23, End Time: 2014-04-27 16:57:52 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (111 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Towers: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.53% (0.2280 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.82% (1.0560 => 1.1280, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.2960 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (1.9800 => 2.0440, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.16% (1.3920 => 1.4360, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.52% (1.3201 => 1.3401, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (2.3161 => 2.3441, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.81% (0.1240 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.00% (0.4400 => 0.4840, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.02% (10.6960 => 11.3400, std.dev.: 0.0878) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.92% (6.0160 => 6.3720, std.dev.: 0.0469) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2320 => 0.2440, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.4120 => 0.4320, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0486) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0157) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0373) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0214) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0412) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0276) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0557) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.47% (5.8400 => 5.9840, std.dev.: 0.0504) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.44% (48.1088 => 49.2809, std.dev.: 0.0824) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 2.23% (18.8170 => 19.2371, std.dev.: 0.0338) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 2.06% (37.0925 => 37.8566, std.dev.: 0.0796) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0373) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 1.25% (23.7574 => 24.0535, std.dev.: 0.0435) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0352) MultiSource/Applications/lua/lua: 3.22% (21.1533 => 21.8334, std.dev.: 0.0992) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) MultiSource/Applications/obsequi/Obsequi: 2.13% (2.0681 => 2.1121, std.dev.: 0.0093) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0077) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0085) SingleSource/UnitTests/AtomicOps: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -26.32% (0.0760 => 0.0560, std.dev.: 0.0067) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.28% (2.0561 => 1.9681, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 12:47:25 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 14:47:25 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427194725.05ECF312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25061?compare_to=25060&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25061, Order: 207360, Start Time: 2014-04-27 15:12:18, End Time: 2014-04-27 19:54:08 To: 25060, Order: 207357, Start Time: 2014-04-27 15:02:33, End Time: 2014-04-27 19:42:19 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (100 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.67% (0.0960 => 0.1120, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.53% (0.2280 => 0.2520, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 7.14% (0.2800 => 0.3000, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2360 => 0.2520, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.5360 => 0.5560, std.dev.: 0.0076) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.96% (1.2160 => 1.2520, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.4360 => 1.4760, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.84% (1.3041 => 1.3281, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.16% (11.3400 => 11.4720, std.dev.: 0.0490) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0103) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0490) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0084) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.39% (1.1880 => 1.2520, std.dev.: 0.0136) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0309) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0219) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.8000 => 6.0160, std.dev.: 0.0454) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0249) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0495) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.9640 => 2.0200, std.dev.: 0.0204) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0456) MultiSource/Applications/siod/siod: 2.64% (2.5721 => 2.6401, std.dev.: 0.0158) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.53% (5.8400 => 5.9880, std.dev.: 0.0440) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0075) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.18% (48.1088 => 49.1570, std.dev.: 0.1118) MultiSource/Applications/kimwitu++/kc: 1.91% (18.8170 => 19.1771, std.dev.: 0.0489) MultiSource/Applications/sqlite3/sqlite3: 1.72% (23.7574 => 24.1655, std.dev.: 0.0302) MultiSource/Benchmarks/Bullet/bullet: 1.65% (37.0925 => 37.7045, std.dev.: 0.0724) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0240) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0405) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0309) MultiSource/Applications/lua/lua: 2.91% (21.1533 => 21.7694, std.dev.: 0.1934) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.70% (0.4440 => 0.4560, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (0.9601 => 0.9841, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.26% (6.6564 => 6.7404, std.dev.: 0.0292) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 12:58:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 14:58:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427195808.0F694312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25062?compare_to=25052&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25062, Order: 207361, Start Time: 2014-04-27 15:18:36, End Time: 2014-04-27 20:04:51 To: 25052, Order: 207351, Start Time: 2014-04-27 10:28:54, End Time: 2014-04-27 15:15:12 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1102 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3080 => 0.3200, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 2.87% (0.8360 => 0.8600, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.56% (0.6240 => 0.6400, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.70% (2.1120 => 2.1480, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 42.86% (0.0280 => 0.0400, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 1.61% (0.7440 => 0.7560, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/perlin: -15.00% (0.0800 => 0.0680, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.82% (0.7280 => 0.5400, std.dev.: 0.0130) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 13:27:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 13:27:46 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140427202746.F013A500E28D@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19303 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207380 Blamelist: ctopper Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sun Apr 27 13:50:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 15:50:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140427205031.3A855312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25063?compare_to=25053&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25063, Order: 207362, Start Time: 2014-04-27 16:09:27, End Time: 2014-04-27 20:57:14 To: 25053, Order: 207351, Start Time: 2014-04-27 11:18:10, End Time: 2014-04-27 16:06:01 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (129 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (945 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-11-VaListArg: 80.00% (0.0200 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.05% (0.0840 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/hash: 18.75% (0.0640 => 0.0760, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 10.53% (0.1520 => 0.1680, std.dev.: 0.0040) SingleSource/Regression/C/bigstack: 9.76% (0.1640 => 0.1800, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.61% (1.9841 => 2.0161, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 1.37% (1.7481 => 1.7721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.21% (2.3081 => 2.3361, std.dev.: 0.0089) MultiSource/Applications/d/make_dparser: 1.07% (4.1001 => 4.1441, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0761 => 1.0881, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0065) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0043) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/strcat: 100.00% (0.0200 => 0.0400, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.86% (1.6681 => 2.0161, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.71% (1.6801 => 2.0281, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.91% (1.7681 => 2.1201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.72% (1.7441 => 2.0881, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.59% (1.9801 => 2.3681, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.45% (1.7481 => 2.0881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.42% (1.7921 => 2.1401, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.07% (1.8881 => 2.2481, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.02% (1.7241 => 2.0521, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.91% (1.6921 => 2.0121, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.55% (1.9601 => 2.3041, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.63% (0.1640 => 0.1880, std.dev.: 0.0082) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.87% (0.1840 => 0.2040, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 10.53% (0.1520 => 0.1680, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.00% (0.2000 => 0.2160, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.31% (3.5002 => 3.7562, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.38% (0.1880 => 0.2000, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (11.7880 => 12.5240, std.dev.: 0.0665) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.9920 => 1.0520, std.dev.: 0.0194) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (6.7200 => 7.1160, std.dev.: 0.0584) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.5560 => 0.5840, std.dev.: 0.0071) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0226) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0158) MultiSource/Applications/d/make_dparser: 4.54% (3.9641 => 4.1441, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (9.9842 => 10.4242, std.dev.: 0.0575) MultiSource/Applications/lua/lua: 4.34% (4.7920 => 5.0000, std.dev.: 0.0344) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.20% (1.5240 => 1.5880, std.dev.: 0.0234) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (2.0680 => 2.1480, std.dev.: 0.0227) MultiSource/Applications/treecc/treecc: 3.82% (2.6200 => 2.7200, std.dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.70% (0.7560 => 0.7840, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.67% (1.4160 => 1.4680, std.dev.: 0.0177) MultiSource/Applications/JM/ldecod/ldecod: 3.61% (10.3203 => 10.6924, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (6.8321 => 7.0761, std.dev.: 0.0320) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (2.0440 => 2.1160, std.dev.: 0.0212) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.1440 => 1.1840, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.23% (0.3720 => 0.3840, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 3.18% (18.4924 => 19.0806, std.dev.: 0.0474) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.92% (3.0122 => 3.1002, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 2.79% (22.6287 => 23.2607, std.dev.: 0.0553) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (5.5480 => 5.6960, std.dev.: 0.0322) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.62% (51.1089 => 52.4489, std.dev.: 0.0938) MultiSource/Applications/kimwitu++/kc: 2.57% (19.7371 => 20.2451, std.dev.: 0.0382) MultiSource/Applications/ClamAV/clamscan: 2.43% (20.2445 => 20.7365, std.dev.: 0.0500) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2203 => 4.2963, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.61% (16.5963 => 16.8643, std.dev.: 0.0744) MultiSource/Benchmarks/Bullet/bullet: 1.61% (38.9366 => 39.5646, std.dev.: 0.0926) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0244 => 6.1164, std.dev.: 0.0208) MultiSource/Applications/sqlite3/sqlite3: 1.49% (25.1895 => 25.5656, std.dev.: 0.0431) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0117) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 5.61% (1.2121 => 1.2801, std.dev.: 0.0232) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.41% (1.0881 => 1.1361, std.dev.: 0.0180) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.40% (1.0921 => 1.1401, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.23% (6.8204 => 7.0404, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.88% (5.0963 => 5.1923, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (4.2443 => 4.3043, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.32% (6.2884 => 0.8600, std.dev.: 0.0137) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0122) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.38% (7.4801 => 6.1800, std.dev.: 0.0561) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.67% (7.5041 => 6.3280, std.dev.: 0.0443) SingleSource/Regression/C/sumarray2d: -10.06% (0.7160 => 0.6440, std.dev.: 0.0088) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -3.37% (13.5243 => 13.0683, std.dev.: 0.0568) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.88% (21.6534 => 17.7811, std.dev.: 0.0671) SingleSource/Benchmarks/Linpack/linpack-pc: -15.28% (7.8005 => 6.6084, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.82% (2.6082 => 2.3521, std.dev.: 0.0967) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0058) MultiSource/Applications/aha/aha: -3.30% (2.9122 => 2.8162, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (5.1603 => 5.0003, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.8002 => 3.7162, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: -1.88% (8.3085 => 8.1525, std.dev.: 0.0549) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7603 => 4.6883, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 14:20:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 16:20:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427212011.38D62312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25064?compare_to=25061&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25064, Order: 207365, Start Time: 2014-04-27 16:43:18, End Time: 2014-04-27 21:26:53 To: 25061, Order: 207360, Start Time: 2014-04-27 15:12:18, End Time: 2014-04-27 19:54:08 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (108 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/FloatPrecision: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/global_ctor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 10.00% (0.1600 => 0.1760, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2840 => 0.3080, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.20% (0.2440 => 0.2640, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.11% (0.1480 => 0.1600, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 7.69% (0.2080 => 0.2240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.2360 => 0.2480, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 4.82% (0.9960 => 1.0440, std.dev.: 0.0177) MultiSource/Benchmarks/McCat/18-imp/imp: 4.81% (0.4160 => 0.4360, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 10.70% (1.0841 => 1.2001, std.dev.: 0.0314) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.92% (5.6124 => 5.7764, std.dev.: 0.0565) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: 18.92% (0.1480 => 0.1760, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/mst/mst: 11.76% (0.1360 => 0.1520, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.53% (0.1520 => 0.1680, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.17% (1.2281 => 1.3161, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0596) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.98% (6.0160 => 6.3760, std.dev.: 0.0365) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 5.67% (0.9880 => 1.0440, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2160 => 0.2280, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0224) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0337) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0405) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0421) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0392) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0552) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0194) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0386) MultiSource/Applications/obsequi/Obsequi: 1.90% (1.2640 => 1.2880, std.dev.: 0.0093) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0209, std.dev.: 0.1365) MultiSource/Applications/kimwitu++/kc: 1.79% (18.8170 => 19.1531, std.dev.: 0.0497) MultiSource/Applications/sqlite3/sqlite3: 1.68% (23.7574 => 24.1575, std.dev.: 0.0349) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 1.36% (37.0925 => 37.5966, std.dev.: 0.0810) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0031) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.85% (0.7280 => 0.7560, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0322) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 2.89% (21.1533 => 21.7654, std.dev.: 0.1382) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0107) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0296) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0016) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0479) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.18% (0.1760 => 0.1440, std.dev.: 0.0117) SingleSource/Benchmarks/Stanford/Puzzle: -13.33% (0.1200 => 0.1040, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 15:01:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 17:01:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427220104.C60E4312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25065?compare_to=25064&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25065, Order: 207366, Start Time: 2014-04-27 17:26:26, End Time: 2014-04-27 22:07:48 To: 25064, Order: 207365, Start Time: 2014-04-27 16:43:18, End Time: 2014-04-27 21:26:53 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 4 (87 on baseline) Performance Improvements: 2 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (1001 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/class_hierarchy: 37.50% (0.0320 => 0.0440, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.82% (1.3161 => 1.3401, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/power/power: -13.64% (0.1760 => 0.1520, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.4562 => 2.4282, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0086) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0505) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (1.5200 => 1.6160, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.75% (1.2521 => 1.3241, std.dev.: 0.0176) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0164) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0288) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.8000 => 6.0200, std.dev.: 0.0398) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (10.4082 => 10.7442, std.dev.: 0.0404) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.09% (8.1441 => 8.3961, std.dev.: 0.0742) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (5.8400 => 6.0200, std.dev.: 0.0426) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0452) MultiSource/Applications/JM/lencod/lencod: 2.52% (17.6165 => 18.0605, std.dev.: 0.0338) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0106) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.99% (48.1088 => 49.0649, std.dev.: 0.0789) MultiSource/Benchmarks/Bullet/bullet: 1.98% (37.0925 => 37.8286, std.dev.: 0.0844) MultiSource/Applications/JM/ldecod/ldecod: 1.68% (7.8562 => 7.9882, std.dev.: 0.0326) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 1.55% (23.7574 => 24.1255, std.dev.: 0.0404) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 26.67% (0.0600 => 0.0760, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (25.8896 => 26.7857, std.dev.: 0.0469) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.89% (1.6601 => 1.7081, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 2.70% (21.1533 => 21.7254, std.dev.: 0.1365) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.4562 => 2.4282, std.dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 15:14:34 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 15:14:34 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140427221438.0FD5A500EEF7@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/739 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 207330 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4618 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp2fXhZPexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp2fXhZPexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmppi_r6xexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmppi_r6xexe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Sun Apr 27 15:15:11 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 17:15:11 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140427221511.E770D312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25066?compare_to=25065&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25066, Order: 207367, Start Time: 2014-04-27 17:43:07, End Time: 2014-04-27 22:21:53 To: 25065, Order: 207366, Start Time: 2014-04-27 17:26:26, End Time: 2014-04-27 22:07:48 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 22 (108 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 500.00% (0.0040 => 0.0240, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bisort/bisort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.55% (0.2120 => 0.2280, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.58% (0.9120 => 0.9720, std.dev.: 0.0171) SingleSource/Benchmarks/Linpack/linpack-pc: 5.19% (0.3080 => 0.3240, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.00% (0.3200 => 0.3360, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 5.00% (0.3200 => 0.3360, std.dev.: 0.0049) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.61% (1.2280 => 1.2600, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.11% (1.3241 => 1.3521, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.73% (0.9241 => 0.9401, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.60% (1.2521 => 1.2721, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 1.42% (5.0640 => 5.1360, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.28% (1.2521 => 1.2681, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.27% (1.0361 => 1.1321, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7081 => 1.7281, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/NP/np: 100.00% (0.0120 => 0.0240, std.dev.: 0.0018) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0166) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0570) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0528) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0070) MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.06% (1.1880 => 1.2600, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9200 => 0.9720, std.dev.: 0.0171) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 5.17% (0.2320 => 0.2440, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0452) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (4.9200 => 5.1360, std.dev.: 0.0211) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0352) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0329) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0316) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0484) MultiSource/Benchmarks/Bullet/bullet: 2.42% (37.0925 => 37.9885, std.dev.: 0.0800) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.5480 => 1.5840, std.dev.: 0.0128) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.04% (48.1088 => 49.0890, std.dev.: 0.0863) MultiSource/Benchmarks/nbench/nbench: 1.92% (1.2480 => 1.2720, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0444) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.8562 => 8.0002, std.dev.: 0.0490) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1211, std.dev.: 0.0622) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0169) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0362) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0276) MultiSource/Applications/lua/lua: 2.70% (21.1533 => 21.7254, std.dev.: 0.0616) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.53% (0.6320 => 0.6480, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.56% (6.6564 => 6.7604, std.dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0195) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0076) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 15:59:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 17:59:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140427225902.2C021312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25067?compare_to=25057&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25067, Order: 207367, Start Time: 2014-04-27 18:23:04, End Time: 2014-04-27 23:05:48 To: 25057, Order: 207356, Start Time: 2014-04-27 13:36:16, End Time: 2014-04-27 18:18:45 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 22 (158 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (925 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-03-15-IndirectGoto: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 28.57% (0.0560 => 0.0720, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bisort/bisort: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.33% (0.1200 => 0.1360, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.36% (0.1760 => 0.1960, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists1: 4.49% (0.3560 => 0.3720, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.73% (1.1800 => 1.2240, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.09% (2.1080 => 2.1520, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.86% (1.5081 => 1.5361, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7682 => 2.8122, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.54% (1.0361 => 1.0521, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 1.19% (4.0281 => 4.0761, std.dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 42.86% (0.0280 => 0.0400, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.95% (0.1720 => 0.1960, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0142) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0098) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0095) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0057) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0049) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0035) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bisort/bisort: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.55% (0.2920 => 0.3520, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.53% (1.0240 => 1.2240, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 17.65% (0.1360 => 0.1600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.20% (0.1640 => 0.1840, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.09% (0.3640 => 0.4080, std.dev.: 0.0161) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.32% (0.4240 => 0.4720, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.79% (1.8161 => 2.0121, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (1.5241 => 1.6721, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/05-eks/eks: 9.70% (0.6600 => 0.7240, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.6200 => 0.6800, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.01% (1.7761 => 1.9361, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0133) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.68% (1.6121 => 1.7521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0286) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.83% (1.7361 => 1.8721, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0107) MultiSource/Applications/obsequi/Obsequi: 7.49% (1.8680 => 2.0080, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0090) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.63% (1.4481 => 1.5441, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (6.4680 => 6.8800, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 6.16% (0.5840 => 0.6200, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.92% (1.4201 => 1.5041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.91% (1.6921 => 1.7921, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (11.6440 => 12.3200, std.dev.: 0.0862) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (5.8121 => 6.1281, std.dev.: 0.0297) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (2.0440 => 2.1520, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.21% (0.7680 => 0.8080, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0241) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0132) MultiSource/Applications/Burg/burg: 5.04% (1.5080 => 1.5840, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0103) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.77% (9.4842 => 9.9362, std.dev.: 0.0527) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 4.18% (2.5840 => 2.6920, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (6.5440 => 6.8120, std.dev.: 0.0412) MultiSource/Applications/JM/ldecod/ldecod: 4.02% (10.0443 => 10.4483, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/hash2: 3.97% (0.5040 => 0.5240, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 3.94% (21.9606 => 22.8248, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (6.5080 => 6.7560, std.dev.: 0.0406) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.7921 => 1.8601, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (5.3600 => 5.5560, std.dev.: 0.0408) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6601 => 1.7201, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0062) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.41% (50.0290 => 51.7330, std.dev.: 0.1150) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0145) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0181) MultiSource/Benchmarks/Bullet/bullet: 3.29% (38.4046 => 39.6686, std.dev.: 0.0483) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0197) MultiSource/Applications/oggenc/oggenc: 3.21% (6.9844 => 7.2085, std.dev.: 0.0253) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.14% (1.0201 => 1.0521, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (16.3483 => 16.8243, std.dev.: 0.0288) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0155) MultiSource/Applications/SPASS/SPASS: 2.76% (18.4404 => 18.9485, std.dev.: 0.0517) MultiSource/Applications/d/make_dparser: 2.72% (3.9681 => 4.0761, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 2.56% (19.6891 => 20.1931, std.dev.: 0.0405) MultiSource/Applications/ClamAV/clamscan: 2.35% (19.0444 => 19.4924, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (4.1843 => 4.2763, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (6.1044 => 6.1964, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 28.14% (0.9241 => 1.1841, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.77% (2.1401 => 2.4562, std.dev.: 0.0314) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0320) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (8.1845 => 8.3605, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 2.11% (3.9842 => 4.0683, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (3.9922 => 4.0763, std.dev.: 0.0225) MultiSource/Applications/JM/lencod/lencod: 1.87% (8.1245 => 8.2765, std.dev.: 0.0507) MultiSource/Applications/hexxagon/hexxagon: 1.77% (11.5087 => 11.7127, std.dev.: 0.0168) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.06% (91.8497 => 49.5471, std.dev.: 10.5486) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.93% (26.0616 => 16.9571, std.dev.: 0.1379) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.36% (50.3031 => 33.0181, std.dev.: 0.1677) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.59% (42.1466 => 28.4098, std.dev.: 0.6818) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1131) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0041) SingleSource/Benchmarks/Linpack/linpack-pc: -14.34% (7.7845 => 6.6684, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (4.1243 => 4.0403, std.dev.: 0.0103) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3561 => 2.3161, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 16:49:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 18:49:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140427234938.1E122312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25068?compare_to=25058&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25068, Order: 207372, Start Time: 2014-04-27 19:13:44, End Time: 2014-04-27 23:56:22 To: 25058, Order: 207356, Start Time: 2014-04-27 14:27:03, End Time: 2014-04-27 19:09:23 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 20 (160 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Bubblesort: 83.33% (0.0240 => 0.0440, std.dev.: 0.0035) SingleSource/UnitTests/2006-01-23-UnionInit: 60.00% (0.0200 => 0.0320, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.00% (0.3000 => 0.3240, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.88% (0.2040 => 0.2160, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.76% (1.0920 => 1.1440, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.41% (1.4921 => 1.5281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.98% (1.6161 => 1.6481, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.55% (1.5521 => 1.5761, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 1.39% (10.0843 => 10.2243, std.dev.: 0.0288) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.37% (7.0280 => 7.1240, std.dev.: 0.0344) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.69% (0.1160 => 0.1400, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.81% (0.2960 => 0.3280, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.44% (0.4920 => 0.5040, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.34% (0.8561 => 0.8761, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 2.16% (2.2241 => 2.2721, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.85% (5.4123 => 5.5123, std.dev.: 0.0378) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.69% (0.9441 => 0.9281, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0088) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0072) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 319.01% (0.2320 => 0.9721, std.dev.: 0.0132) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 195.24% (0.2520 => 0.7440, std.dev.: 0.0209) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0059) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0088) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0075) SingleSource/Regression/C/bigstack: 53.85% (0.0520 => 0.0800, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0030) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 49.43% (0.7040 => 1.0520, std.dev.: 0.0217) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0172) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 28.95% (0.1520 => 0.1960, std.dev.: 0.0076) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/dt: 25.00% (0.0480 => 0.0600, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.68% (1.2481 => 1.5561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.67% (1.2321 => 1.5361, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.63% (1.1841 => 1.4521, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.22% (0.1080 => 0.1320, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 21.16% (1.1721 => 1.4201, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.77% (1.1361 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.48% (1.1521 => 1.3881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.48% (1.1721 => 1.4121, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.47% (1.3681 => 1.6481, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.93% (1.1441 => 1.3721, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.49% (1.2521 => 1.4961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 19.16% (8.5802 => 10.2243, std.dev.: 0.0288) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.63% (1.2881 => 1.5281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.84% (1.1881 => 1.4001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.47% (1.3841 => 1.6121, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 15.72% (19.5406 => 22.6127, std.dev.: 0.0489) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0047) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.47% (5.3360 => 6.1081, std.dev.: 0.0373) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 13.31% (1.3521 => 1.5321, std.dev.: 0.0165) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.57% (1.7400 => 1.9240, std.dev.: 0.0266) MultiSource/Benchmarks/mafft/pairlocalalign: 9.35% (11.3843 => 12.4483, std.dev.: 0.0262) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.73% (5.7280 => 6.2280, std.dev.: 0.0340) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (5.6680 => 6.1440, std.dev.: 0.0421) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.32% (11.4440 => 12.3960, std.dev.: 0.0464) SingleSource/UnitTests/Vectorizer/gcc-loops: 7.91% (0.5560 => 0.6000, std.dev.: 0.0099) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.65% (0.6800 => 0.7320, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (9.5802 => 10.2122, std.dev.: 0.0448) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6120 => 0.6480, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.76% (0.7640 => 0.8080, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.6240 => 1.7120, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.00% (0.8000 => 0.8400, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.4760 => 1.5480, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.76% (1.0920 => 1.1440, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.34% (6.8280 => 7.1240, std.dev.: 0.0344) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 4.19% (4.7720 => 4.9720, std.dev.: 0.0340) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (5.3840 => 5.5800, std.dev.: 0.0484) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0171) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.34% (49.1529 => 50.7969, std.dev.: 0.0912) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (1.3400 => 1.3840, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0215) MultiSource/Applications/ClamAV/clamscan: 3.16% (19.2243 => 19.8324, std.dev.: 0.0567) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.7600 => 1.8120, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (1.5280 => 1.5720, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 2.75% (24.7575 => 25.4375, std.dev.: 0.0536) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0103) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (2.7282 => 2.7962, std.dev.: 0.0151) MultiSource/Applications/kimwitu++/kc: 2.27% (19.7491 => 20.1971, std.dev.: 0.0385) MultiSource/Benchmarks/Bullet/bullet: 1.96% (39.0726 => 39.8366, std.dev.: 0.0626) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0124 => 6.0924, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (3.0402 => 3.0762, std.dev.: 0.0090) MultiSource/Applications/SPASS/SPASS: 1.17% (18.7966 => 19.0164, std.dev.: 0.0260) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.81% (1.2401 => 1.4361, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.33% (0.3000 => 0.3280, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.87% (1.6521 => 1.7161, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0600) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 1.87% (4.0563 => 4.1323, std.dev.: 0.0213) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.85% (5.4123 => 5.5123, std.dev.: 0.0378) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (25.4536 => 25.8776, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.56% (11.0207 => 2.0321, std.dev.: 0.0076) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -18.89% (8.9566 => 7.2645, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.83% (21.6534 => 17.7931, std.dev.: 0.0586) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0904) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: -3.92% (2.5482 => 2.4482, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -1.96% (5.0963 => 4.9963, std.dev.: 0.0173) MultiSource/Benchmarks/sim/sim: -1.36% (4.9963 => 4.9283, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 17:29:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 17:29:42 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140428002942.4B57E50100C6@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19308 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207385 Blamelist: chandlerc BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: lib/IR/LegacyPassManager.cpp lib/Support/Unix/TimeValue.inc On: http://10.1.1.2/svn/llvm-project For: llvm At: Sun 27 Apr 2014 17:11:32 Changed By: chandlerc Comments: Teach the pass manager's execution dump to print the current time before each line. This is particularly nice for tracking which run of a particular pass over a particular function was slow. This also required making the TimeValue string much more useful. First, there is a standard format for writing out a date and time. Let's use that rather than strings that would have to be parsed. Second, actually output the nanosecond resolution that timevalue claims to have. This is proving useful working on PR19499, so I figured it would be generally useful to commit.Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 17:29:41 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 17:29:41 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428002942.0191D50100C1@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14871 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207385 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17845 of 17845) 1 warning(s) in tests. Testing Time: 346.31s ******************** Failing Tests (2): LLVM :: Object/archive-toc.test LLVM :: Object/extract.ll Expected Passes : 17694 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::archive-toc.test': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/Object/archive-toc.test:4:11: error: expected string not found in input GNU: rw-r--r-- 500/500 8 Nov 19 02:57 2004 evenlen ^ :1:1: note: scanning from here rw-r--r-- 500/500 8 2004-11-19 02:57:37.000000000 evenlen ^ -- ******************** Last 15 lines of 'LLVM::extract.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/Object/extract.ll:47:8: error: expected string not found in input CHECK: 1465 Nov 19 03:01 2004 very_long_bytecode_file_name.bc ^ :1:1: note: scanning from here rwxr-xr-x 501/20 1465 2004-11-19 03:01:31.000000000 very_long_bytecode_file_name.bc ^ :1:38: note: possible intended match here rwxr-xr-x 501/20 1465 2004-11-19 03:01:31.000000000 very_long_bytecode_file_name.bc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 17:29:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 17:29:42 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140428002942.4C1FB50100C7@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19308 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207385 Blamelist: chandlerc BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 17:29:41 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 17:29:41 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428002942.004EE50100C0@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14871 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207385 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17845 of 17845) 1 warning(s) in tests. Testing Time: 346.31s ******************** Failing Tests (2): LLVM :: Object/archive-toc.test LLVM :: Object/extract.ll Expected Passes : 17694 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::archive-toc.test': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/Object/archive-toc.test:4:11: error: expected string not found in input GNU: rw-r--r-- 500/500 8 Nov 19 02:57 2004 evenlen ^ :1:1: note: scanning from here rw-r--r-- 500/500 8 2004-11-19 02:57:37.000000000 evenlen ^ -- ******************** Last 15 lines of 'LLVM::extract.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/Object/extract.ll:47:8: error: expected string not found in input CHECK: 1465 Nov 19 03:01 2004 very_long_bytecode_file_name.bc ^ :1:1: note: scanning from here rwxr-xr-x 501/20 1465 2004-11-19 03:01:31.000000000 very_long_bytecode_file_name.bc ^ :1:38: note: possible intended match here rwxr-xr-x 501/20 1465 2004-11-19 03:01:31.000000000 very_long_bytecode_file_name.bc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Sun Apr 27 17:30:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 19:30:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428003056.2FFD9312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25069?compare_to=25066&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25069, Order: 207380, Start Time: 2014-04-27 19:58:40, End Time: 2014-04-28 00:37:39 To: 25066, Order: 207367, Start Time: 2014-04-27 17:43:07, End Time: 2014-04-27 22:21:53 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (99 on baseline) Performance Improvements: 3 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-4: 66.67% (0.0240 => 0.0400, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 11.24% (0.3560 => 0.3960, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4200 => 0.4400, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 42.86% (0.0280 => 0.0400, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.34% (0.2320 => 0.2560, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -28.57% (0.0560 => 0.0400, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/five11/five11: -1.36% (2.3481 => 2.3161, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0043) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/09-vor/vor: 10.00% (0.3600 => 0.3960, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0777) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (6.0160 => 6.3480, std.dev.: 0.0557) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3800 => 1.4400, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0378) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0360) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0452) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0313) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 2.72% (17.6165 => 18.0965, std.dev.: 0.0543) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0314) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.07% (23.7574 => 24.2495, std.dev.: 0.0327) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.02% (48.1088 => 49.0809, std.dev.: 0.1022) MultiSource/Benchmarks/nbench/nbench: 1.92% (1.2480 => 1.2720, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 1.76% (37.0925 => 37.7446, std.dev.: 0.0977) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0108) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: 1.38% (18.8170 => 19.0770, std.dev.: 0.0445) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0524) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0265) MultiSource/Applications/lua/lua: 3.06% (21.1533 => 21.8014, std.dev.: 0.0456) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.94% (3.5322 => 3.6362, std.dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -6.86% (0.4080 => 0.3800, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0278) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 17:37:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 19:37:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140428003705.311A8312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25070?compare_to=25059&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25070, Order: 207380, Start Time: 2014-04-27 19:58:39, End Time: 2014-04-28 00:43:52 To: 25059, Order: 207356, Start Time: 2014-04-27 14:55:11, End Time: 2014-04-27 19:40:34 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 7 (136 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (938 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR640: 100.00% (0.0160 => 0.0320, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/family/family: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: 33.33% (0.0480 => 0.0640, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.14% (0.8920 => 0.9200, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (4.2483 => 4.2963, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.38% (17.6723 => 19.6842, std.dev.: 0.0468) MultiSource/Applications/sqlite3/sqlite3: 1420.71% (1.7001 => 25.8536, std.dev.: 0.0329) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.31% (50.1010 => 51.7610, std.dev.: 0.0795) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.64% (11.3920 => 12.1480, std.dev.: 0.1014) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0098) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0083, std.dev.: 0.0274) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0087) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0065) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 45.45% (0.0440 => 0.0640, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 30.00% (0.0800 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 25.00% (0.0800 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.1160 => 0.1360, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 14.29% (0.1400 => 0.1600, std.dev.: 0.0053) SingleSource/Benchmarks/SmallPT/smallpt: 14.29% (0.1400 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.28% (1.9601 => 2.2401, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.28% (1.8201 => 2.0801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.16% (1.8361 => 2.0961, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.05% (2.1361 => 2.4362, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.78% (1.9161 => 2.1801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.72% (1.8081 => 2.0561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.11% (1.9521 => 2.2081, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.11% (1.8921 => 2.1401, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.76% (1.9121 => 2.1561, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.68% (1.9241 => 2.1681, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4042, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.00% (0.1000 => 0.1120, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.83% (2.0681 => 2.2921, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.33% (2.0521 => 2.2641, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.02% (1.8361 => 2.0201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.00% (1.8801 => 2.0681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.79% (1.9201 => 2.1081, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: 9.38% (1.8760 => 2.0520, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.35% (1.7961 => 1.9641, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0175) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.7040 => 0.7480, std.dev.: 0.0079) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (2.9721 => 3.1402, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.31% (6.4800 => 6.8240, std.dev.: 0.0401) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.17% (0.2320 => 0.2440, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 5.12% (1.0160 => 1.0680, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 4.97% (1.5280 => 1.6040, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.95% (1.2120 => 1.2720, std.dev.: 0.0219) MultiSource/Applications/hbd/hbd: 4.86% (1.7280 => 1.8120, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.76% (0.3360 => 0.3520, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.7080 => 0.7400, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (6.5320 => 6.8160, std.dev.: 0.0510) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0370) MultiSource/Applications/SIBsim4/SIBsim4: 4.26% (1.7841 => 1.8601, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (5.8281 => 6.0641, std.dev.: 0.0427) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (1.6960 => 1.7640, std.dev.: 0.0251) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0149) MultiSource/Applications/JM/ldecod/ldecod: 3.87% (10.2283 => 10.6244, std.dev.: 0.0347) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0316) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (2.1600 => 2.2360, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4640 => 0.4800, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.37% (6.5360 => 6.7560, std.dev.: 0.0413) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3960 => 5.5760, std.dev.: 0.0512) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0106) MultiSource/Applications/treecc/treecc: 3.09% (2.5880 => 2.6680, std.dev.: 0.0307) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (16.3003 => 16.7883, std.dev.: 0.0516) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 2.78% (7.0524 => 7.2485, std.dev.: 0.0205) MultiSource/Applications/d/make_dparser: 2.62% (3.9761 => 4.0801, std.dev.: 0.0175) MultiSource/Applications/SPASS/SPASS: 2.48% (18.5284 => 18.9885, std.dev.: 0.0463) MultiSource/Applications/JM/lencod/lencod: 2.47% (22.2206 => 22.7687, std.dev.: 0.0504) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.45% (2.1240 => 2.1760, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: 2.09% (38.6366 => 39.4446, std.dev.: 0.1214) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: 1.27% (19.8291 => 20.0811, std.dev.: 0.0708) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 22.73% (0.0880 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0489) MultiSource/Applications/siod/siod: 10.19% (2.8642 => 3.1562, std.dev.: 0.0377) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.46% (6.5964 => 6.8244, std.dev.: 0.0147) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.88% (11.4967 => 11.7127, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 1.43% (8.1285 => 8.2445, std.dev.: 0.0375) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.0243 => 5.0763, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.54% (10.4007 => 2.0241, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.88% (2.9562 => 0.9200, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.16% (94.8339 => 49.1631, std.dev.: 9.3394) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.97% (49.9431 => 32.9781, std.dev.: 0.1723) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.74% (25.7136 => 17.0371, std.dev.: 0.1333) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.42% (37.0863 => 28.7698, std.dev.: 0.5067) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0109) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.64% (5.6124 => 5.5203, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.50% (4.8043 => 4.7323, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.01% (2.7722 => 2.7442, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 17:50:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 19:50:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140428005041.5C368312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25071?compare_to=25062&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25071, Order: 207380, Start Time: 2014-04-27 20:10:47, End Time: 2014-04-28 00:57:27 To: 25062, Order: 207361, Start Time: 2014-04-27 15:18:36, End Time: 2014-04-27 20:04:51 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1097 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/pointer_method: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C/ConstructorDestructorAttributes: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (1.0081 => 1.0401, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.08% (1.7321 => 1.7681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.06% (1.7441 => 1.7801, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.23% (1.9481 => 1.9721, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 21.43% (0.1120 => 0.1360, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0139) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 18:07:01 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 18:07:01 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428010707.649FA5010577@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14872 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207386 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17845 of 17845) 1 warning(s) in tests. Testing Time: 373.54s ******************** Failing Tests (2): LLVM :: Object/archive-toc.test LLVM :: Object/extract.ll Expected Passes : 17694 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 2 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::archive-toc.test': -- Exit Code: 1 Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/Object/archive-toc.test:4:11: error: expected string not found in input GNU: rw-r--r-- 500/500 8 Nov 19 02:57 2004 evenlen ^ :1:1: note: scanning from here rw-r--r-- 500/500 8 2004-11-19 02:57:37.000000000 evenlen ^ -- ******************** Last 15 lines of 'LLVM::extract.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/Object/extract.ll:47:8: error: expected string not found in input CHECK: 1465 Nov 19 03:01 2004 very_long_bytecode_file_name.bc ^ :1:1: note: scanning from here rwxr-xr-x 501/20 1465 2004-11-19 03:01:31.000000000 very_long_bytecode_file_name.bc ^ :1:38: note: possible intended match here rwxr-xr-x 501/20 1465 2004-11-19 03:01:31.000000000 very_long_bytecode_file_name.bc ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvm-testresults at cs.uiuc.edu Sun Apr 27 18:19:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 20:19:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428011940.16127312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25072?compare_to=25069&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25072, Order: 207381, Start Time: 2014-04-27 20:44:47, End Time: 2014-04-28 01:26:23 To: 25069, Order: 207380, Start Time: 2014-04-27 19:58:40, End Time: 2014-04-28 00:37:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (105 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C/testtrace: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/lowercase: 75.00% (0.0160 => 0.0280, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bisort/bisort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.62% (0.2320 => 0.2520, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.69% (0.9360 => 1.0080, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 3.05% (0.7880 => 0.8120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.86% (1.2881 => 1.3121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.55% (1.2881 => 1.3081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.50% (1.3361 => 1.3561, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (0.9801 => 1.0041, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: -83.33% (0.0240 => 0.0040, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0048) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.25% (1.2081 => 1.3561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0112) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (10.6960 => 11.4960, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0175) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0471) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (5.8000 => 6.0760, std.dev.: 0.0351) MultiSource/Benchmarks/McCat/05-eks/eks: 4.71% (0.6800 => 0.7120, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.2880 => 0.3000, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0359) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0467) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 3.05% (0.7880 => 0.8120, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0361) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0547) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0315) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8966, std.dev.: 0.0814) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0103) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.93% (48.1088 => 49.0370, std.dev.: 0.0873) MultiSource/Applications/sqlite3/sqlite3: 1.87% (23.7574 => 24.2015, std.dev.: 0.0330) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 1.85% (18.8170 => 19.1651, std.dev.: 0.0351) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0158) MultiSource/Applications/SPASS/SPASS: 1.14% (17.5484 => 17.7484, std.dev.: 0.0300) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.67% (2.8802 => 3.2162, std.dev.: 0.0214) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.58% (0.9601 => 1.0041, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (25.8896 => 26.7817, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 2.95% (21.1533 => 21.7774, std.dev.: 0.1572) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.57% (4.4683 => 4.2643, std.dev.: 0.0277) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -3.89% (2.6762 => 2.5722, std.dev.: 0.0093) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.6165 => 8.4765, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 18:44:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 20:44:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140428014430.DED19312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25073?compare_to=25063&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25073, Order: 207381, Start Time: 2014-04-27 21:03:07, End Time: 2014-04-28 01:51:17 To: 25063, Order: 207362, Start Time: 2014-04-27 16:09:27, End Time: 2014-04-27 20:57:14 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (141 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/build: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.30% (0.3440 => 0.3760, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.82% (0.3520 => 0.3760, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 1.84% (0.8680 => 0.8840, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.56% (2.0521 => 2.0841, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.52% (1.0521 => 1.0681, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.16% (2.0601 => 2.0841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.07% (2.2521 => 2.2761, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.28% (0.1720 => 0.2000, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.25% (0.9401 => 0.9801, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.69% (0.9441 => 0.9281, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0072) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/ary3: 29.41% (0.0680 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.17% (1.7321 => 2.1161, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.04% (1.6881 => 2.0601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 21.54% (1.7641 => 2.1441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.48% (1.6761 => 2.0361, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.19% (1.6801 => 2.0361, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.16% (1.7201 => 2.0841, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.89% (1.8001 => 2.1761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.88% (1.7241 => 2.0841, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.59% (1.7681 => 2.1321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.53% (1.7921 => 2.1601, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.46% (1.7201 => 2.0721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.42% (1.7241 => 2.0761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.40% (1.8041 => 2.1721, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.35% (1.8081 => 2.1761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.95% (1.8041 => 2.1641, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.90% (1.6681 => 2.0001, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.82% (1.8361 => 2.2001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.34% (1.8201 => 2.1721, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.29% (1.9081 => 2.2761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.25% (1.8281 => 2.1801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.03% (1.9761 => 2.3521, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.52% (0.1080 => 0.1280, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.96% (1.9601 => 2.3121, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0128) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0073) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.51% (0.1880 => 0.2040, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.05% (0.3480 => 0.3760, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.82% (0.3520 => 0.3760, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.63% (0.7840 => 0.8360, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.9920 => 1.0560, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.31% (11.7880 => 12.5320, std.dev.: 0.0466) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.83% (6.7200 => 7.1120, std.dev.: 0.0468) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.83% (3.5002 => 3.7042, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.81% (1.2400 => 1.3120, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (1.6481 => 1.7401, std.dev.: 0.0064) MultiSource/Applications/spiff/spiff: 5.49% (1.0200 => 1.0760, std.dev.: 0.0217) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.1440 => 1.2000, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0229) MultiSource/Benchmarks/nbench/nbench: 4.83% (1.8201 => 1.9081, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (9.9842 => 10.4562, std.dev.: 0.0345) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (2.0680 => 2.1640, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 3.99% (6.9124 => 7.1884, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0125) MultiSource/Applications/lua/lua: 3.84% (4.7920 => 4.9760, std.dev.: 0.0374) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0147) MultiSource/Applications/d/make_dparser: 3.63% (3.9641 => 4.1081, std.dev.: 0.0255) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (6.8321 => 7.0761, std.dev.: 0.0395) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (10.3203 => 10.6884, std.dev.: 0.0284) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.4560 => 0.4720, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 3.33% (1.5600 => 1.6120, std.dev.: 0.0189) MultiSource/Applications/minisat/minisat: 3.27% (0.8560 => 0.8840, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: 3.18% (18.4924 => 19.0805, std.dev.: 0.0578) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (2.0440 => 2.1040, std.dev.: 0.0201) MultiSource/Applications/JM/lencod/lencod: 2.90% (22.6287 => 23.2847, std.dev.: 0.0431) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.42% (51.1089 => 52.3449, std.dev.: 0.1275) MultiSource/Benchmarks/Bullet/bullet: 2.35% (38.9366 => 39.8526, std.dev.: 0.0665) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (5.5480 => 5.6760, std.dev.: 0.0283) MultiSource/Applications/kimwitu++/kc: 2.25% (19.7371 => 20.1811, std.dev.: 0.0427) MultiSource/Applications/ClamAV/clamscan: 2.09% (20.2445 => 20.6685, std.dev.: 0.0481) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (3.0122 => 3.0722, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.81% (16.5963 => 16.8963, std.dev.: 0.0512) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.54% (25.1895 => 25.5776, std.dev.: 0.0552) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.33% (4.2203 => 4.2763, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0244 => 6.1004, std.dev.: 0.0202) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 13.64% (0.1760 => 0.2000, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.93% (1.2681 => 1.4321, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0285) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1761 => 2.2521, std.dev.: 0.0162) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0311) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.94% (0.9521 => 0.9801, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.81% (0.9961 => 1.0241, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.88% (5.0963 => 5.1923, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.26% (4.1323 => 4.1843, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: -81.37% (10.9087 => 2.0321, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/nestedloop: -60.19% (2.9642 => 1.1801, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.19% (1.5881 => 1.1721, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.63% (7.4801 => 6.2360, std.dev.: 0.0365) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.47% (7.5041 => 6.2680, std.dev.: 0.0609) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: -3.22% (13.5243 => 13.0883, std.dev.: 0.0438) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -46.67% (0.0600 => 0.0320, std.dev.: 0.0077) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.33% (21.6534 => 17.9011, std.dev.: 0.0368) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.36% (2.6082 => 2.3641, std.dev.: 0.0887) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0099) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (5.1603 => 5.0043, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.8002 => 3.7162, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -1.93% (8.3085 => 8.1485, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 19:12:17 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 19:12:17 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140428021229.3A1645010DE2@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19310 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207388 Blamelist: chandlerc Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Sun Apr 27 20:45:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 22:45:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428034546.A39AE312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25074?compare_to=25072&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25074, Order: 207382, Start Time: 2014-04-27 23:08:48, End Time: 2014-04-28 03:52:30 To: 25072, Order: 207381, Start Time: 2014-04-27 20:44:47, End Time: 2014-04-28 01:26:23 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (94 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (996 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 27.27% (0.0440 => 0.0560, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 26.67% (0.0600 => 0.0760, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.55% (1.2921 => 1.3121, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.50% (1.3321 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.48% (1.3481 => 1.3681, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 500.00% (0.0040 => 0.0240, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 23.81% (0.0840 => 0.1040, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.72% (1.1601 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.41% (1.2321 => 1.3481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0740) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (4.9200 => 5.1480, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.48% (5.8000 => 6.0600, std.dev.: 0.0262) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0584) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0415) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0247) MultiSource/Applications/lambda-0_1_3/lambda: 3.55% (0.7880 => 0.8160, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0409) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0211) MultiSource/Applications/JM/lencod/lencod: 2.68% (17.6165 => 18.0885, std.dev.: 0.0685) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0381) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0088) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.07% (48.1088 => 49.1048, std.dev.: 0.0701) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.85% (5.8400 => 5.9480, std.dev.: 0.0409) MultiSource/Benchmarks/Bullet/bullet: 1.80% (37.0925 => 37.7606, std.dev.: 0.1003) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1491, std.dev.: 0.0565) MultiSource/Applications/sqlite3/sqlite3: 1.50% (23.7574 => 24.1135, std.dev.: 0.0549) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.6321 => 1.6561, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0136) MultiSource/Applications/SPASS/SPASS: 1.19% (17.5484 => 17.7564, std.dev.: 0.0314) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0219) MultiSource/Applications/lua/lua: 2.76% (21.1533 => 21.7374, std.dev.: 0.1225) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/2003-06-08-VirtualFunctions: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/cast-bug: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 20:47:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 22:47:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140428034741.DAEBB312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25075?compare_to=25067&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25075, Order: 207382, Start Time: 2014-04-27 23:11:58, End Time: 2014-04-28 03:54:28 To: 25067, Order: 207367, Start Time: 2014-04-27 18:23:04, End Time: 2014-04-27 23:05:48 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (145 on baseline) Performance Improvements: 2 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (937 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.00% (0.1000 => 0.1160, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.61% (0.2640 => 0.2920, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 8.33% (0.3840 => 0.4160, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.36% (0.2240 => 0.2360, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 3.57% (0.4480 => 0.4640, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (6.7560 => 6.8320, std.dev.: 0.0204) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.04% (0.9801 => 1.0001, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/pi: 1.65% (0.7280 => 0.7400, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.03% (6.1964 => 6.1324, std.dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.69% (0.9441 => 0.9281, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0100) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0149) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 297.41% (0.4600 => 1.8281, std.dev.: 0.0118) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Queens: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 20.00% (0.1200 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.67% (0.3360 => 0.3920, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.41% (1.0240 => 1.1920, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0170) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.05% (1.4841 => 1.6481, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.97% (0.6200 => 0.6880, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (1.6521 => 1.8321, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (1.0240 => 1.1280, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.70% (1.6081 => 1.7641, std.dev.: 0.0103) MultiSource/Applications/obsequi/Obsequi: 9.64% (1.8680 => 2.0480, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.42% (1.5281 => 1.6721, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.20% (0.3480 => 0.3800, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.09% (0.7040 => 0.7680, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.97% (0.3120 => 0.3400, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.96% (0.2680 => 0.2920, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.01% (1.4481 => 1.5641, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0145) MultiSource/Applications/spiff/spiff: 7.94% (1.0080 => 1.0880, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.82% (1.4841 => 1.6001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.75% (1.5481 => 1.6681, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.37% (1.5201 => 1.6321, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (0.2200 => 0.2360, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (6.4680 => 6.9040, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (11.6440 => 12.3760, std.dev.: 0.0604) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.91% (1.6921 => 1.7921, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (9.4842 => 10.0082, std.dev.: 0.0339) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.8881 => 0.9361, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (5.8121 => 6.1241, std.dev.: 0.0330) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.7400 => 1.8280, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (6.5080 => 6.8320, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0072) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0241) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.5480 => 1.6200, std.dev.: 0.0202) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.27% (1.3120 => 1.3680, std.dev.: 0.0198) MultiSource/Applications/JM/lencod/lencod: 4.17% (21.9606 => 22.8768, std.dev.: 0.0694) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.4640 => 1.5240, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 3.98% (10.0443 => 10.4443, std.dev.: 0.0471) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0109) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0130) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0084) MultiSource/Applications/treecc/treecc: 3.87% (2.5840 => 2.6840, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (6.5440 => 6.7960, std.dev.: 0.0703) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 3.76% (4.7880 => 4.9680, std.dev.: 0.0398) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0144) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.44% (50.0290 => 51.7490, std.dev.: 0.0948) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0141) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.9681 => 1.0001, std.dev.: 0.0112) MultiSource/Applications/d/make_dparser: 3.23% (3.9681 => 4.0961, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 3.05% (38.4046 => 39.5766, std.dev.: 0.0547) MultiSource/Applications/SPASS/SPASS: 2.78% (18.4404 => 18.9524, std.dev.: 0.0566) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.74% (1.0201 => 1.0481, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 2.73% (19.0444 => 19.5644, std.dev.: 0.0530) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (16.3483 => 16.7243, std.dev.: 0.0443) MultiSource/Applications/kimwitu++/kc: 2.05% (19.6891 => 20.0931, std.dev.: 0.0322) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.14% (2.1401 => 2.4642, std.dev.: 0.0554) MultiSource/Applications/siod/siod: 10.49% (2.8602 => 3.1602, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++/bigfib: 10.45% (0.2680 => 0.2960, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: 3.07% (7.4205 => 7.6485, std.dev.: 0.0237) MultiSource/Applications/minisat/minisat: 2.76% (6.6684 => 6.8524, std.dev.: 0.0259) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (3.9922 => 4.0923, std.dev.: 0.0238) MultiSource/Applications/sqlite3/sqlite3: 2.31% (3.9842 => 4.0763, std.dev.: 0.0229) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (8.1845 => 8.3725, std.dev.: 0.0324) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: 2.04% (0.9801 => 1.0001, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.5087 => 11.7207, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 1.82% (8.1245 => 8.2725, std.dev.: 0.0212) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4361 => 1.4521, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.87% (10.6247 => 2.0321, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.89% (2.9442 => 0.9160, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.30% (91.8497 => 49.3271, std.dev.: 9.5870) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.27% (50.3031 => 33.0661, std.dev.: 0.1494) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.01% (26.0616 => 17.1971, std.dev.: 0.1243) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -33.04% (42.1466 => 28.2218, std.dev.: 0.6704) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.04% (3.1122 => 2.3641, std.dev.: 0.1087) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.37% (1.2481 => 1.1561, std.dev.: 0.0188) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.07% (4.0283 => 3.8642, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.84% (2.8202 => 2.7682, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 21:11:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 23:11:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428041139.47BC1312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25076?compare_to=25074&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25076, Order: 207383, Start Time: 2014-04-27 23:38:59, End Time: 2014-04-28 04:18:23 To: 25074, Order: 207382, Start Time: 2014-04-27 23:08:48, End Time: 2014-04-28 03:52:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (100 on baseline) Performance Improvements: 4 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Perm: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 23.53% (0.0680 => 0.0840, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.05% (0.0840 => 0.1000, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.38% (0.1040 => 0.1200, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.29% (0.0840 => 0.0960, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.7200 => 0.7360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.9481 => 0.9681, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2005-05-13-SDivTwo: -60.00% (0.0200 => 0.0080, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.05% (1.3641 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.83% (1.3121 => 1.2881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.75% (1.3681 => 1.3441, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0072) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 33.33% (0.1080 => 0.1440, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0117) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.02% (1.1961 => 1.2801, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0559) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.32% (6.0160 => 6.3960, std.dev.: 0.0593) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.24% (0.7640 => 0.8040, std.dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0607) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0374) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0267) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0369) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0104) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0369) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (48.1088 => 49.2970, std.dev.: 0.0670) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0371) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0200) MultiSource/Benchmarks/Bullet/bullet: 2.01% (37.0925 => 37.8366, std.dev.: 0.1122) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: 1.70% (23.7574 => 24.1615, std.dev.: 0.0433) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1211, std.dev.: 0.0618) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0222) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0092) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0261) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (25.8896 => 26.7297, std.dev.: 0.0292) MultiSource/Applications/lua/lua: 2.87% (21.1533 => 21.7614, std.dev.: 0.0949) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0293) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.80% (6.6564 => 6.7764, std.dev.: 0.0200) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0083) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0553) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.67% (1.2601 => 1.1761, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0075) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 21:37:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 23:37:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140428043758.C7A50312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25077?compare_to=25068&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25077, Order: 207383, Start Time: 2014-04-28 00:02:25, End Time: 2014-04-28 04:44:45 To: 25068, Order: 207372, Start Time: 2014-04-27 19:13:44, End Time: 2014-04-27 23:56:22 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (155 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.74% (0.0920 => 0.1120, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: 13.04% (0.0920 => 0.1040, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.57% (0.1400 => 0.1520, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.33% (0.6000 => 0.6200, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.94% (1.6481 => 1.6161, std.dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0084) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0090) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0107) SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 203.17% (0.2520 => 0.7640, std.dev.: 0.0132) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0052) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 96.15% (0.1040 => 0.2040, std.dev.: 0.0098) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0037) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0158) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: 45.40% (1.3920 => 2.0240, std.dev.: 0.0159) MultiSource/Benchmarks/NPB-serial/is/is: 44.44% (0.0720 => 0.1040, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 40.00% (0.0600 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 34.62% (0.1040 => 0.1400, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 31.58% (0.0760 => 0.1000, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.41% (0.0680 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.00% (1.2321 => 1.5401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.19% (1.2401 => 1.5401, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.75% (1.2481 => 1.5321, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.43% (1.2481 => 1.5281, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.48% (1.1721 => 1.4121, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.36% (1.1361 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.53% (1.1441 => 1.3561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 18.32% (8.5802 => 10.1523, std.dev.: 0.0346) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.18% (0.0880 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 17.96% (1.1361 => 1.3401, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.89% (1.2521 => 1.4761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.89% (1.2521 => 1.4761, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.18% (1.3841 => 1.6081, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.15% (1.2881 => 1.4961, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 16.00% (0.1000 => 0.1160, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 15.25% (19.5406 => 22.5207, std.dev.: 0.0435) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0049) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.95% (0.1720 => 0.1960, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.57% (5.3360 => 6.0601, std.dev.: 0.0504) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.76% (0.6800 => 0.7600, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.76% (0.1360 => 0.1520, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0055) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.49% (1.7400 => 1.9400, std.dev.: 0.0236) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 11.24% (1.3521 => 1.5041, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 9.03% (11.3843 => 12.4123, std.dev.: 0.0269) MultiSource/Applications/oggenc/oggenc: 8.47% (6.2844 => 6.8164, std.dev.: 0.0191) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.33% (0.4320 => 0.4680, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.24% (5.7280 => 6.2000, std.dev.: 0.0499) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.97% (5.6680 => 6.1200, std.dev.: 0.0476) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.9800 => 1.0560, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (11.4440 => 12.2920, std.dev.: 0.0803) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.47% (9.5802 => 10.2002, std.dev.: 0.0412) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.40% (1.6240 => 1.7280, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.17% (0.3240 => 0.3440, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.8721 => 0.9161, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 4.31% (0.8360 => 0.8720, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 3.94% (5.3840 => 5.5960, std.dev.: 0.0619) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.3240 => 1.3760, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 3.44% (4.7720 => 4.9360, std.dev.: 0.0301) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.30% (49.1529 => 50.7769, std.dev.: 0.0511) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.87% (6.8280 => 7.0240, std.dev.: 0.0539) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: 2.66% (19.2243 => 19.7363, std.dev.: 0.0525) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 2.59% (24.7575 => 25.3975, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (2.2081 => 2.2521, std.dev.: 0.0097) MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (2.7282 => 2.7722, std.dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: 1.54% (39.0726 => 39.6726, std.dev.: 0.0953) MultiSource/Applications/kimwitu++/kc: 1.50% (19.7491 => 20.0451, std.dev.: 0.0436) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.24% (3.9842 => 4.3123, std.dev.: 0.0214) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.28% (0.8281 => 0.8801, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0207) SingleSource/Benchmarks/McGill/queens: 3.67% (2.1801 => 2.2601, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0370) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.91% (1.1001 => 1.1321, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0255) MultiSource/Applications/sqlite3/sqlite3: 1.97% (4.0563 => 4.1363, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (25.4536 => 25.8856, std.dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0141) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0119) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -18.94% (8.9566 => 7.2605, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.42% (21.6534 => 17.8811, std.dev.: 0.0430) SingleSource/Benchmarks/Linpack/linpack-pc: -16.54% (7.8605 => 6.5604, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -9.68% (3.4722 => 3.1362, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.97% (5.2763 => 4.9083, std.dev.: 0.0829) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.88% (5.0963 => 5.0003, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.76% (4.7643 => 4.6803, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: -1.07% (11.5567 => 11.4327, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 21:49:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Apr 2014 23:49:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428044936.64DEE312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25078?compare_to=25076&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25078, Order: 207384, Start Time: 2014-04-28 00:14:53, End Time: 2014-04-28 04:56:20 To: 25076, Order: 207383, Start Time: 2014-04-27 23:38:59, End Time: 2014-04-28 04:18:23 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (102 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 66.67% (0.0240 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C/bigstack: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0560 => 0.0720, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Towers: 27.27% (0.0440 => 0.0560, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 26.67% (0.0600 => 0.0760, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 6.78% (0.2360 => 0.2520, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (1.9880 => 2.0440, std.dev.: 0.0120) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.61% (1.2401 => 1.2601, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.56% (1.2841 => 1.3041, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 66.67% (0.0240 => 0.0400, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0061) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.09% (1.2361 => 1.3361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.57% (1.2161 => 1.3081, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (6.0160 => 6.4520, std.dev.: 0.0455) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0834) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0132) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0341) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0313) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0458) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 2.76% (4.9200 => 5.0560, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4520 => 0.4640, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.63% (17.6165 => 18.0805, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0371) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.34% (48.1088 => 49.2329, std.dev.: 0.0753) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8965, std.dev.: 0.0569) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 1.84% (23.7574 => 24.1935, std.dev.: 0.0299) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1131, std.dev.: 0.0549) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 2.91% (21.1533 => 21.7694, std.dev.: 0.0978) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0139) MultiSource/Applications/minisat/minisat: 1.44% (6.6564 => 6.7524, std.dev.: 0.0328) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0033) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 22:17:25 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 22:17:25 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428051726.0AC2A50127B1@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14880 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207396 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': if (SyntaxTool.run(newFrontendActionFactory()) != 0) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/tools/extra/clang-modernize/tool/../../../../include/clang/Tooling/Tooling.h:283:23: note: passing argument to parameter 'Action' here int run(ToolAction *Action); ^ 1 error generated. make[6]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/ClangModernize.o] Error 1 make[6]: *** Waiting for unfinished jobs.... rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseNullptr/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseAuto/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../AddOverride/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../LoopConvert/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../PassByValue/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../ReplaceAutoPtr/.objdir make[5]: *** [all] Error 1 make[4]: *** [all] Error 1 make[3]: *** [extra/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 22:17:26 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 22:17:26 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140428051726.40C8750127B8@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19317 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207396 Blamelist: nico BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 22:17:26 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 22:17:26 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140428051726.3F6BD50127B7@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19317 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207396 Blamelist: nico BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: include/clang/Tooling/Tooling.h tools/clang-check/ClangCheck.cpp On: http://10.1.1.2/svn/llvm-project For: cfe At: Sun 27 Apr 2014 22:05:32 Changed By: nico Comments: Follow-up to r207071: Let newFrontendActionFactory() return a unique_ptr. This exposed a leak, fix that. Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 22:17:25 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 22:17:25 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428051726.0B54450127B2@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14880 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207396 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': if (SyntaxTool.run(newFrontendActionFactory()) != 0) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/tools/extra/clang-modernize/tool/../../../../include/clang/Tooling/Tooling.h:283:23: note: passing argument to parameter 'Action' here int run(ToolAction *Action); ^ 1 error generated. make[6]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/ClangModernize.o] Error 1 make[6]: *** Waiting for unfinished jobs.... rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseNullptr/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseAuto/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../AddOverride/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../LoopConvert/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../PassByValue/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../ReplaceAutoPtr/.objdir make[5]: *** [all] Error 1 make[4]: *** [all] Error 1 make[3]: *** [extra/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Sun Apr 27 22:15:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 00:15:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428051556.05C61312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25079?compare_to=25078&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25079, Order: 207386, Start Time: 2014-04-28 00:43:33, End Time: 2014-04-28 05:22:39 To: 25078, Order: 207384, Start Time: 2014-04-28 00:14:53, End Time: 2014-04-28 04:56:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (101 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/UnitTests/2003-08-11-VaListArg: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.63% (0.1640 => 0.1880, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.93% (1.2441 => 1.2681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.87% (1.2801 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.58% (1.2641 => 1.2841, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5842 => 2.6202, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 1.25% (7.9682 => 8.0682, std.dev.: 0.0290) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 23.81% (0.0840 => 0.1040, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.96% (3.9282 => 4.0443, std.dev.: 0.0351) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0061) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 14.00% (0.2000 => 0.2280, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.82% (1.2281 => 1.3241, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.36% (0.6520 => 0.7000, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.24% (1.2161 => 1.3041, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0421) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.16% (1.3641 => 1.4481, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0151) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (6.0160 => 6.3600, std.dev.: 0.0421) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0268) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0544) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.30% (1.0920 => 1.1280, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0434) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (10.4082 => 10.7162, std.dev.: 0.0429) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0290) MultiSource/Applications/JM/lencod/lencod: 2.68% (17.6165 => 18.0885, std.dev.: 0.0453) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0511) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0329) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.05% (48.1088 => 49.0969, std.dev.: 0.0607) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 1.90% (37.0925 => 37.7965, std.dev.: 0.0311) MultiSource/Applications/sqlite3/sqlite3: 1.75% (23.7574 => 24.1735, std.dev.: 0.0425) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1131, std.dev.: 0.0354) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 17.59% (0.9321 => 1.0961, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (25.8896 => 26.7297, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 2.80% (21.1533 => 21.7454, std.dev.: 0.1726) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0092) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0352) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.1139) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0073) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 22:28:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 00:28:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140428052819.974E2312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25080?compare_to=25070&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25080, Order: 207386, Start Time: 2014-04-28 00:49:44, End Time: 2014-04-28 05:35:06 To: 25070, Order: 207380, Start Time: 2014-04-27 19:58:39, End Time: 2014-04-28 00:43:52 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 15 (135 on baseline) Performance Improvements: 1 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/pointer_member: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.64% (0.1760 => 0.2000, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/exptree: 12.00% (0.1000 => 0.1120, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.70% (6.8240 => 6.9400, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (12.1480 => 12.3200, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.15% (2.0801 => 2.1041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.09% (2.2081 => 2.2321, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.31% (1.7281 => 1.6881, std.dev.: 0.0138) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.32% (17.6723 => 19.6723, std.dev.: 0.0378) MultiSource/Applications/sqlite3/sqlite3: 1417.65% (1.7001 => 25.8016, std.dev.: 0.0340) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.10% (50.1010 => 51.6530, std.dev.: 0.1272) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.15% (11.3920 => 12.3200, std.dev.: 0.0335) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0106) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0243, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7204, std.dev.: 0.0110) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0091) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0028) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0038) SingleSource/Regression/C/PR640: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 31.25% (0.0640 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.14% (0.1160 => 0.1440, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (1.8201 => 2.1041, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.05% (1.8601 => 2.1401, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.50% (1.8761 => 2.1481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.40% (1.9161 => 2.1921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.40% (1.9721 => 2.2561, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0066) SingleSource/Benchmarks/SmallPT/smallpt: 14.29% (0.1400 => 0.1600, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.94% (1.8361 => 2.0921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.58% (1.8561 => 2.1081, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.53% (1.8921 => 2.1481, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.47% (1.9601 => 2.2241, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.18% (1.9121 => 2.1641, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.82% (2.0281 => 2.2881, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.50% (1.8081 => 2.0161, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.13% (1.9761 => 2.1961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.02% (2.0681 => 2.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.83% (1.7721 => 1.9641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0124) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.58% (0.4160 => 0.4600, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.21% (1.9201 => 2.1161, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.00% (1.8801 => 2.0681, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.68% (1.9001 => 2.0841, std.dev.: 0.0185) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0133) MultiSource/Applications/obsequi/Obsequi: 8.96% (1.8760 => 2.0440, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.60% (0.3720 => 0.4040, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (6.4800 => 6.9400, std.dev.: 0.0265) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.78% (0.2360 => 0.2520, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0066) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (1.6960 => 1.7960, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.68% (0.7040 => 0.7440, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0263) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.33% (1.6641 => 1.7361, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (5.8281 => 6.0801, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.09% (1.5640 => 1.6280, std.dev.: 0.0212) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (10.2283 => 10.6324, std.dev.: 0.0377) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (9.6042 => 9.9802, std.dev.: 0.0478) MultiSource/Applications/hexxagon/hexxagon: 3.89% (1.1320 => 1.1760, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (6.5320 => 6.7680, std.dev.: 0.0630) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0179) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0299) MultiSource/Applications/SIBsim4/SIBsim4: 3.59% (1.7841 => 1.8481, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (5.3960 => 5.5840, std.dev.: 0.0464) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0090) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.04% (1.3160 => 1.3560, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0577) MultiSource/Applications/treecc/treecc: 2.94% (2.5880 => 2.6640, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 2.84% (7.0524 => 7.2525, std.dev.: 0.0157) MultiSource/Applications/JM/lencod/lencod: 2.65% (22.2206 => 22.8087, std.dev.: 0.0449) MultiSource/Applications/d/make_dparser: 2.62% (3.9761 => 4.0801, std.dev.: 0.0234) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (2.1600 => 2.2160, std.dev.: 0.0197) MultiSource/Applications/SPASS/SPASS: 2.48% (18.5284 => 18.9885, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (16.3003 => 16.6923, std.dev.: 0.0487) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: 1.90% (38.6366 => 39.3726, std.dev.: 0.1011) MultiSource/Applications/siod/siod: 1.60% (2.7522 => 2.7962, std.dev.: 0.0121) MultiSource/Applications/kimwitu++/kc: 1.47% (19.8291 => 20.1211, std.dev.: 0.0326) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.33% (4.2243 => 4.2803, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.23% (2.1201 => 2.4642, std.dev.: 0.0463) MultiSource/Applications/siod/siod: 10.33% (2.8642 => 3.1602, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0111) MultiSource/Applications/minisat/minisat: 3.64% (6.5964 => 6.8364, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.20% (1.0921 => 1.1161, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 1.64% (11.4967 => 11.6847, std.dev.: 0.0225) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.3801 => 1.4001, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.43% (8.1285 => 8.2445, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.24% (8.3605 => 8.4645, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.0243 => 5.0763, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (3.9442 => 3.9842, std.dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.28% (2.9562 => 0.9080, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.17% (94.8339 => 49.1511, std.dev.: 9.6638) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.71% (49.9431 => 33.1061, std.dev.: 0.1286) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.31% (25.7136 => 17.1491, std.dev.: 0.0868) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.93% (37.0863 => 28.5818, std.dev.: 0.4588) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -10.04% (2.7482 => 2.4722, std.dev.: 0.0856) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.69% (0.9441 => 0.9281, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.67% (4.8043 => 4.7243, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 22:42:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 00:42:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140428054255.AC178312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25081?compare_to=25071&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25081, Order: 207386, Start Time: 2014-04-28 01:03:23, End Time: 2014-04-28 05:49:42 To: 25071, Order: 207380, Start Time: 2014-04-27 20:10:47, End Time: 2014-04-28 00:57:27 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1104 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 10.13% (0.3160 => 0.3480, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (2.1080 => 2.1400, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 12.16% (0.2960 => 0.3320, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 8.09% (0.6920 => 0.7480, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/health/health: 5.26% (0.3800 => 0.4000, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray: -4.00% (0.4000 => 0.3840, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 128.07% (0.2280 => 0.5200, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0123) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Apr 27 23:18:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 01:18:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428061857.33FC0312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25082?compare_to=25079&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25082, Order: 207388, Start Time: 2014-04-28 01:44:21, End Time: 2014-04-28 06:25:41 To: 25079, Order: 207386, Start Time: 2014-04-28 00:43:33, End Time: 2014-04-28 05:22:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (99 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.23% (0.1040 => 0.1240, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ReedSolomon: 8.16% (0.1960 => 0.2120, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 4.72% (0.5080 => 0.5320, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: 2.19% (1.0961 => 1.1201, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0960 => 0.1120, std.dev.: 0.0062) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.2200 => 0.2440, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.00% (0.1600 => 0.1760, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (6.0160 => 6.3600, std.dev.: 0.0597) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0169) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0244) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.8000 => 6.0240, std.dev.: 0.0479) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0527) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (10.4082 => 10.7082, std.dev.: 0.0536) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (5.8400 => 6.0000, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0473) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: 1.84% (23.7574 => 24.1935, std.dev.: 0.0221) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.77% (48.1088 => 48.9609, std.dev.: 0.0946) MultiSource/Benchmarks/Bullet/bullet: 1.62% (37.0925 => 37.6925, std.dev.: 0.0596) MultiSource/Applications/kimwitu++/kc: 1.42% (18.8170 => 19.0851, std.dev.: 0.0431) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.36% (2.8802 => 3.2362, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (25.8896 => 26.7337, std.dev.: 0.0313) MultiSource/Applications/lua/lua: 2.72% (21.1533 => 21.7294, std.dev.: 0.1551) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0110) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0088) SingleSource/Benchmarks/SmallPT/smallpt: 1.31% (14.0009 => 14.1849, std.dev.: 0.0662) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0105) SingleSource/UnitTests/SignlessTypes/div: -44.44% (0.0360 => 0.0200, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: -16.67% (0.0720 => 0.0600, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 23:29:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 23:29:52 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428063008.621D4501318C@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14881 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207397 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': if (SyntaxTool.run(newFrontendActionFactory()) != 0) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/tools/extra/clang-modernize/tool/../../../../include/clang/Tooling/Tooling.h:283:23: note: passing argument to parameter 'Action' here int run(ToolAction *Action); ^ 1 error generated. make[6]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/ClangModernize.o] Error 1 make[6]: *** Waiting for unfinished jobs.... rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseAuto/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../AddOverride/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../PassByValue/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseNullptr/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../LoopConvert/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../ReplaceAutoPtr/.objdir make[5]: *** [all] Error 1 make[4]: *** [all] Error 1 make[3]: *** [extra/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Sun Apr 27 23:38:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 01:38:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140428063807.BC7C4312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25083?compare_to=25073&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25083, Order: 207388, Start Time: 2014-04-28 01:56:49, End Time: 2014-04-28 06:44:54 To: 25073, Order: 207381, Start Time: 2014-04-27 21:03:07, End Time: 2014-04-28 01:51:17 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (139 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/ccc: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_shift: 44.44% (0.0360 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.00% (0.1200 => 0.1320, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.41% (0.2720 => 0.2840, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 6.21% (1.2241 => 1.3001, std.dev.: 0.0250) MultiSource/Benchmarks/Olden/tsp/tsp: 1.83% (1.3081 => 1.3321, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0033) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 35.71% (0.0560 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.93% (1.6961 => 2.0681, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 21.08% (1.7081 => 2.0681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.23% (1.7401 => 2.0921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.20% (1.9801 => 2.3801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.95% (1.7241 => 2.0681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.92% (1.9881 => 2.3841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.81% (1.6961 => 2.0321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.72% (1.7441 => 2.0881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.52% (1.6801 => 2.0081, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.42% (1.7921 => 2.1401, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.12% (1.8201 => 2.1681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.00% (1.7681 => 2.1041, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.92% (1.9641 => 2.3161, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.37% (1.9801 => 2.3241, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0243) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0267) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.86% (3.5002 => 3.7402, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.77% (1.2400 => 1.3240, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (1.5240 => 1.6160, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (6.7200 => 7.1160, std.dev.: 0.0485) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (11.7880 => 12.4800, std.dev.: 0.0798) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0132) MultiSource/Benchmarks/nbench/nbench: 5.49% (1.8201 => 1.9201, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.7800 => 0.8200, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0076) MultiSource/Applications/d/make_dparser: 4.54% (3.9641 => 4.1441, std.dev.: 0.0193) MultiSource/Applications/SIBsim4/SIBsim4: 4.52% (1.6801 => 1.7561, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.41% (0.2720 => 0.2840, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.7280 => 1.8040, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.1440 => 1.1920, std.dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 4.17% (6.9124 => 7.2005, std.dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (9.9842 => 10.4002, std.dev.: 0.0591) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0137) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0212) MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (6.8321 => 7.1041, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0051) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.3203 => 10.7004, std.dev.: 0.0346) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0459) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (2.0440 => 2.1120, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (2.0680 => 2.1360, std.dev.: 0.0251) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0325) MultiSource/Applications/SPASS/SPASS: 3.07% (18.4924 => 19.0605, std.dev.: 0.0534) MultiSource/Applications/JM/lencod/lencod: 3.02% (22.6287 => 23.3128, std.dev.: 0.0610) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0051) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (51.1089 => 52.3729, std.dev.: 0.0875) MultiSource/Applications/kimwitu++/kc: 2.33% (19.7371 => 20.1971, std.dev.: 0.0437) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 2.17% (20.2445 => 20.6845, std.dev.: 0.0644) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (3.0122 => 3.0762, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: 2.09% (5.5480 => 5.6640, std.dev.: 0.0364) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.93% (16.5963 => 16.9163, std.dev.: 0.0662) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.79% (6.0244 => 6.1324, std.dev.: 0.0168) MultiSource/Benchmarks/Bullet/bullet: 1.73% (38.9366 => 39.6086, std.dev.: 0.0787) MultiSource/Applications/sqlite3/sqlite3: 1.72% (25.1895 => 25.6216, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.30% (1.2681 => 1.4241, std.dev.: 0.0159) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.26% (1.2121 => 1.3001, std.dev.: 0.0250) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.76% (1.0921 => 1.1441, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0124) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0407) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1761 => 2.2521, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.44% (3.4842 => 3.6042, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: 1.52% (1.3121 => 1.3321, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.26% (4.1323 => 4.1843, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0923 => 4.1363, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -81.37% (10.9087 => 2.0321, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0043) MultiSource/Applications/obsequi/Obsequi: -21.76% (2.6481 => 2.0720, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.53% (7.4801 => 6.2440, std.dev.: 0.0595) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.42% (7.5041 => 6.2720, std.dev.: 0.0565) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -2.99% (13.5243 => 13.1203, std.dev.: 0.0266) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: -20.00% (0.0600 => 0.0480, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.20% (21.6534 => 17.9291, std.dev.: 0.0182) SingleSource/Benchmarks/Linpack/linpack-pc: -15.28% (7.8005 => 6.6084, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.27% (2.2241 => 2.0401, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0101) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -2.87% (5.1603 => 5.0123, std.dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -1.89% (11.6527 => 11.4327, std.dev.: 0.0208) MultiSource/Applications/JM/lencod/lencod: -1.88% (8.3085 => 8.1525, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.7041 => 1.6841, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Sun Apr 27 23:51:48 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Sun, 27 Apr 2014 23:51:48 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428065202.81D8C5013419@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14882 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207398 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': if (SyntaxTool.run(newFrontendActionFactory()) != 0) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/tools/extra/clang-modernize/tool/../../../../include/clang/Tooling/Tooling.h:283:23: note: passing argument to parameter 'Action' here int run(ToolAction *Action); ^ 1 error generated. make[6]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/ClangModernize.o] Error 1 make[6]: *** Waiting for unfinished jobs.... rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseAuto/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../AddOverride/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../PassByValue/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseNullptr/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../LoopConvert/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../ReplaceAutoPtr/.objdir make[5]: *** [all] Error 1 make[4]: *** [all] Error 1 make[3]: *** [extra/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 00:15:42 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 00:15:42 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase4 - validation Message-ID: <20140428071559.037565013703@lab.llvm.org> The Buildbot has detected a build exception on builder phase4 - validation while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase4%20-%20validation/builds/1692 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207356 Blamelist: akirtzidis,alexfh,chandlerc,chapuni,compnerd,d0k,dblaikie,djasper,sylvestre BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 00:15:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 00:15:46 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase2 - living Message-ID: <20140428071559.04C5B5013704@lab.llvm.org> The Buildbot has detected a build exception on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7591 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207395 Blamelist: tfiala BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 00:15:16 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 00:15:16 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase3 - tree health Message-ID: <20140428071559.0CB185013705@lab.llvm.org> The Buildbot has detected a build exception on builder phase3 - tree health while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase3%20-%20tree%20health/builds/2345 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207392 Blamelist: adrian,akirtzidis,alexfh,alp,chandlerc,chapuni,compnerd,ctopper,d0k,dblaikie,rafael,sylvestre BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 01:10:20 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 01:10:20 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428081035.7D43A5013E2E@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14883 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207401 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': if (SyntaxTool.run(newFrontendActionFactory()) != 0) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/tools/extra/clang-modernize/tool/../../../../include/clang/Tooling/Tooling.h:283:23: note: passing argument to parameter 'Action' here int run(ToolAction *Action); ^ 1 error generated. make[6]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/ClangModernize.o] Error 1 make[6]: *** Waiting for unfinished jobs.... rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseAuto/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../AddOverride/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../PassByValue/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseNullptr/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../LoopConvert/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../ReplaceAutoPtr/.objdir make[5]: *** [all] Error 1 make[4]: *** [all] Error 1 make[3]: *** [extra/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 01:32:16 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 01:32:16 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428083216.758AF50140F5@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14884 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207402 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': if (SyntaxTool.run(newFrontendActionFactory()) != 0) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/tools/extra/clang-modernize/tool/../../../../include/clang/Tooling/Tooling.h:283:23: note: passing argument to parameter 'Action' here int run(ToolAction *Action); ^ 1 error generated. make[6]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/ClangModernize.o] Error 1 make[6]: *** Waiting for unfinished jobs.... rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseAuto/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../AddOverride/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../PassByValue/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseNullptr/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../LoopConvert/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../ReplaceAutoPtr/.objdir make[5]: *** [all] Error 1 make[4]: *** [all] Error 1 make[3]: *** [extra/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Mon Apr 28 01:37:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 03:37:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428083709.4B4F5312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25084?compare_to=25082&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25084, Order: 207393, Start Time: 2014-04-28 03:59:55, End Time: 2014-04-28 08:43:49 To: 25082, Order: 207388, Start Time: 2014-04-28 01:44:21, End Time: 2014-04-28 06:25:41 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (102 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/div: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.90% (0.1240 => 0.1400, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.29% (0.2720 => 0.3000, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.46% (0.2960 => 0.3240, std.dev.: 0.0090) SingleSource/Benchmarks/SmallPT/smallpt: 8.82% (0.1360 => 0.1480, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 4.23% (0.2840 => 0.2960, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.29% (2.4440 => 2.5000, std.dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: 1.39% (2.0161 => 2.0441, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.99% (3.9122 => 4.0683, std.dev.: 0.0595) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0049) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.3000 => 0.3240, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (10.6960 => 11.4240, std.dev.: 0.0687) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (6.0160 => 6.3640, std.dev.: 0.0467) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0294) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0254) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0266) MultiSource/Applications/Burg/burg: 4.38% (1.4600 => 1.5240, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0125) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0504) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0226) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0487) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0420) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.63% (0.6080 => 0.6240, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.60% (5.8400 => 5.9920, std.dev.: 0.0582) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0368) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0350) MultiSource/Benchmarks/Bullet/bullet: 2.07% (37.0925 => 37.8605, std.dev.: 0.0475) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0066) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.68% (48.1088 => 48.9169, std.dev.: 0.1040) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1211, std.dev.: 0.0701) MultiSource/Applications/sqlite3/sqlite3: 1.45% (23.7574 => 24.1015, std.dev.: 0.0491) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0316) MultiSource/Applications/lua/lua: 3.03% (21.1533 => 21.7934, std.dev.: 0.1737) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 1.68% (6.6564 => 6.7684, std.dev.: 0.0302) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.24% (10.8967 => 2.0441, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0059) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.70% (2.0561 => 1.9801, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.86% (1.2601 => 1.2241, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 01:37:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 03:37:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140428083723.ECC5C312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25085?compare_to=25075&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25085, Order: 207393, Start Time: 2014-04-28 04:01:41, End Time: 2014-04-28 08:44:00 To: 25075, Order: 207382, Start Time: 2014-04-27 23:11:58, End Time: 2014-04-28 03:54:28 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 11 (148 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2002-05-02-CastTest2: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.47% (0.2360 => 0.2560, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 8.16% (0.1960 => 0.2120, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.83% (0.6560 => 0.6680, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.71% (0.9361 => 0.9521, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.12% (1.7921 => 1.8121, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 16.00% (0.1000 => 0.1160, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/mst/mst: 11.54% (0.1040 => 0.1160, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.60% (1.0001 => 0.9841, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.29% (11.3687 => 3.0362, std.dev.: 0.0119) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0125) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 295.67% (0.4600 => 1.8201, std.dev.: 0.0090) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0030) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 133.33% (0.0120 => 0.0280, std.dev.: 0.0018) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/2002-05-02-CastTest2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 20.45% (0.1760 => 0.2120, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.93% (1.6521 => 1.8161, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.89% (0.3640 => 0.4000, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.31% (1.4601 => 1.5961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.28% (1.5521 => 1.6961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (1.1640 => 1.2680, std.dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.78% (1.5481 => 1.6841, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.71% (1.6081 => 1.7481, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.7040 => 0.7640, std.dev.: 0.0225) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.49% (0.4240 => 0.4600, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.44% (1.6121 => 1.7481, std.dev.: 0.0131) MultiSource/Applications/sgefa/sgefa: 8.22% (0.5840 => 0.6320, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.14% (1.5241 => 1.6481, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0108) MultiSource/Applications/obsequi/Obsequi: 7.92% (1.8680 => 2.0160, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.66% (1.7761 => 1.9121, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.82% (1.5841 => 1.6921, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.74% (1.4841 => 1.5841, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 6.63% (1.5080 => 1.6080, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.46% (11.6440 => 12.3960, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.29% (0.7000 => 0.7440, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.21% (1.4161 => 1.5041, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0368) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.85% (1.4361 => 1.5201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.77% (1.4561 => 1.5401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.73% (0.7680 => 0.8120, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.71% (5.8121 => 6.1441, std.dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.52% (9.4842 => 10.0082, std.dev.: 0.0406) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.7400 => 1.8360, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.2920 => 0.3080, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.5480 => 1.6320, std.dev.: 0.0195) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (2.0440 => 2.1520, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (5.3600 => 5.6080, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.0443 => 10.4843, std.dev.: 0.0289) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2760 => 0.2880, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 4.24% (1.7921 => 1.8681, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.23% (0.2840 => 0.2960, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (6.5440 => 6.8120, std.dev.: 0.0573) MultiSource/Applications/treecc/treecc: 4.02% (2.5840 => 2.6880, std.dev.: 0.0261) MultiSource/Applications/JM/lencod/lencod: 3.97% (21.9606 => 22.8328, std.dev.: 0.0610) MultiSource/Applications/lua/lua: 3.84% (4.7880 => 4.9720, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (6.5080 => 6.7440, std.dev.: 0.0432) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0129) MultiSource/Applications/oggenc/oggenc: 3.55% (6.9844 => 7.2325, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.43% (3.0282 => 3.1322, std.dev.: 0.0118) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.41% (50.0290 => 51.7330, std.dev.: 0.1027) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0138) MultiSource/Applications/SPASS/SPASS: 3.06% (18.4404 => 19.0045, std.dev.: 0.0403) MultiSource/Benchmarks/Bullet/bullet: 3.02% (38.4046 => 39.5646, std.dev.: 0.0854) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (4.1843 => 4.2923, std.dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5284, std.dev.: 0.0765) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (16.3483 => 16.7523, std.dev.: 0.0325) MultiSource/Applications/kimwitu++/kc: 2.36% (19.6891 => 20.1531, std.dev.: 0.0378) MultiSource/Applications/d/make_dparser: 2.32% (3.9681 => 4.0601, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.07% (2.1240 => 2.1680, std.dev.: 0.0170) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (13.0563 => 13.1923, std.dev.: 0.0307) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.9241 => 1.1681, std.dev.: 0.0331) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.96% (2.1401 => 2.4602, std.dev.: 0.0341) MultiSource/Applications/siod/siod: 10.35% (2.8602 => 3.1562, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.78% (0.3600 => 0.3880, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.00% (0.7200 => 0.7560, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0293) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 3.07% (7.4205 => 7.6485, std.dev.: 0.0341) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (8.1845 => 8.3765, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0359) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (3.9922 => 4.0803, std.dev.: 0.0288) MultiSource/Applications/JM/lencod/lencod: 1.92% (8.1245 => 8.2805, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.81% (3.9842 => 4.0563, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 1.60% (11.5087 => 11.6927, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.84% (10.6247 => 2.0361, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.89% (2.9442 => 0.9160, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.37% (91.8497 => 49.2551, std.dev.: 9.9763) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -35.16% (26.0616 => 16.8971, std.dev.: 0.1539) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.26% (50.3031 => 33.0701, std.dev.: 0.1284) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.18% (42.1466 => 28.5818, std.dev.: 0.5709) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1078) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.73% (1.2481 => 1.1641, std.dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (4.1243 => 4.0403, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.70% (2.8202 => 2.7722, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3561 => 2.3161, std.dev.: 0.0123) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 02:05:59 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 02:05:59 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on libcxx_clang-x86_64-darwin11-RA Message-ID: <20140428090603.5911B5014519@lab.llvm.org> The Buildbot has detected a failed build on builder libcxx_clang-x86_64-darwin11-RA while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/libcxx_clang-x86_64-darwin11-RA/builds/740 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve4 Build Reason: Triggerable(phase4-stage0) Build Source Stamp: 207356 Blamelist: BUILD FAILED: failed test.libcxx.system sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp ******************** Failing Tests (2): libc++ :: thread/futures/futures.future_error/what.pass.cpp libc++ :: thread/futures/futures.promise/dtor.pass.cpp Expected Passes : 4618 Expected Failures : 39 Unexpected Passes : 6 Unexpected Failures: 2 Last 15 lines of 'libc++::get.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::get_chart.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/get_chart.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::ignore_0xff.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/ignore_0xff.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::read.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/read.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::readsome.pass.cpp': ******************** TEST 'libc++ :: input.output/iostream.format/input.streams/istream.unformatted/readsome.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::stream_input.pass.cpp': ******************** TEST 'libc++ :: numerics/complex.number/complex.ops/stream_input.pass.cpp' FAILED ******************** ******************** Last 15 lines of 'libc++::what.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.future_error/what.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmppnNsaOexe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmppnNsaOexe' Exit Code: -6 Standard Error: -- Assertion failed: (std::strcmp(f.what(), "The associated promise has been destructed prior " "to the associated state becoming ready.") == 0), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.future_error/what.pass.cpp, line 25. -- Compiled test failed unexpectedly! ******************** Last 15 lines of 'libc++::dtor.pass.cpp': ******************** TEST 'libc++ :: thread/futures/futures.promise/dtor.pass.cpp' FAILED ******************** Compiled With: '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/host-compiler/bin/clang++' '-o' '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp3_DZf8exe' '/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp' '-nostdinc++' '-std=c++0x' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/include' '-I/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/support' '-nodefaultlibs' '-L/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/lib' '-lc++' '-lc++abi' '-lSystem' Command: '/var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/tmp3_DZf8exe' Exit Code: -6 Standard Error: -- Assertion failed: (e.code() == make_error_code(std::future_errc::broken_promise)), function main, file /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.libcxx_clang-x86_64-darwin11-RA/sources/test/thread/futures/futures.promise/dtor.pass.cpp, line 103. -- Compiled test failed unexpectedly! ******************** From llvm-testresults at cs.uiuc.edu Mon Apr 28 02:00:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 04:00:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428090055.1B654312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25086?compare_to=25084&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25086, Order: 207394, Start Time: 2014-04-28 04:28:06, End Time: 2014-04-28 09:07:35 To: 25084, Order: 207393, Start Time: 2014-04-28 03:59:55, End Time: 2014-04-28 08:43:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (100 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.00% (0.0800 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 4.50% (0.4440 => 0.4640, std.dev.: 0.0061) MultiSource/Benchmarks/sim/sim: 3.49% (0.3440 => 0.3560, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.5560 => 1.5920, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 2.19% (0.7320 => 0.7480, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 1.09% (1.1041 => 1.1161, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0093) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (10.6960 => 11.3960, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0423) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0171) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0432) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0174) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 4.38% (1.4600 => 1.5240, std.dev.: 0.0142) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0337) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0349) MultiSource/Benchmarks/MallocBench/gs/gs: 3.09% (4.9200 => 5.0720, std.dev.: 0.0523) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.5480 => 1.5920, std.dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: 2.77% (17.6165 => 18.1045, std.dev.: 0.0504) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0305) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0273) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.10% (48.1088 => 49.1170, std.dev.: 0.0488) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 1.83% (37.0925 => 37.7726, std.dev.: 0.0754) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1331, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 1.52% (23.7574 => 24.1175, std.dev.: 0.0495) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0346) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 20.00% (0.0600 => 0.0720, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 2.86% (21.1533 => 21.7574, std.dev.: 0.1403) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0134) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0455) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -3.89% (2.6762 => 2.5722, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 02:25:01 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 02:25:01 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428092501.C42A0501478D@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14885 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207403 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': if (SyntaxTool.run(newFrontendActionFactory()) != 0) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/tools/extra/clang-modernize/tool/../../../../include/clang/Tooling/Tooling.h:283:23: note: passing argument to parameter 'Action' here int run(ToolAction *Action); ^ 1 error generated. make[6]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/ClangModernize.o] Error 1 make[6]: *** Waiting for unfinished jobs.... rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseAuto/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../AddOverride/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../PassByValue/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseNullptr/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../LoopConvert/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../ReplaceAutoPtr/.objdir make[5]: *** [all] Error 1 make[4]: *** [all] Error 1 make[3]: *** [extra/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Mon Apr 28 02:29:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 04:29:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140428092950.D90C2312800A@llvm.org> http://llvm.org/perf/db_default/v4/nts/25087?compare_to=25077&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25087, Order: 207394, Start Time: 2014-04-28 04:54:07, End Time: 2014-04-28 09:36:37 To: 25077, Order: 207383, Start Time: 2014-04-28 00:02:25, End Time: 2014-04-28 04:44:45 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 7 (148 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/llubenchmark/llu: 45.45% (0.0440 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Towers: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.25% (0.1920 => 0.2040, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.06% (0.3160 => 0.3320, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: 1.19% (2.0121 => 2.0361, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/class_hierarchy: -41.67% (0.0480 => 0.0280, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2337.50% (0.0320 => 0.7800, std.dev.: 0.0133) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0092) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 979.08% (0.0760 => 0.8201, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0082) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0148) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0072) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0045) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0053) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0039) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0114) SingleSource/Regression/C/test_indvars: 50.00% (0.0320 => 0.0480, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.97% (1.2321 => 1.5521, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.62% (1.1841 => 1.4401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.45% (1.1561 => 1.4041, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.09% (1.1761 => 1.4241, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.66% (1.2001 => 1.4481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.93% (1.1441 => 1.3721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.80% (1.2321 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.00% (1.3681 => 1.6281, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.00% (1.2001 => 1.4281, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.89% (1.2281 => 1.4601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.58% (1.1841 => 1.4041, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.27% (1.1601 => 1.3721, std.dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 18.18% (8.5802 => 10.1403, std.dev.: 0.0347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 17.75% (1.1721 => 1.3801, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.93% (1.2521 => 1.4641, std.dev.: 0.0174) MultiSource/Applications/JM/lencod/lencod: 15.07% (19.5406 => 22.4847, std.dev.: 0.0979) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.09% (5.3360 => 6.0881, std.dev.: 0.0293) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.70% (0.2920 => 0.3320, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 13.02% (1.3521 => 1.5281, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.7400 => 1.9560, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.11% (0.1800 => 0.2000, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0162) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0219) MultiSource/Benchmarks/mafft/pairlocalalign: 8.71% (11.3843 => 12.3763, std.dev.: 0.0346) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.64% (0.6480 => 0.7040, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.69% (5.6680 => 6.1040, std.dev.: 0.0478) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.41% (0.3240 => 0.3480, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.26% (5.7280 => 6.1440, std.dev.: 0.0558) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.24% (11.4440 => 12.2720, std.dev.: 0.0868) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0121) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.39% (9.5802 => 10.1922, std.dev.: 0.0472) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.7640 => 0.8120, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3000 => 0.3160, std.dev.: 0.0062) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.59% (0.8721 => 0.9121, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 4.02% (4.7720 => 4.9640, std.dev.: 0.0228) MultiSource/Applications/spiff/spiff: 3.82% (1.0480 => 1.0880, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/football/football: 3.75% (1.0680 => 1.1080, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (6.8280 => 7.0800, std.dev.: 0.0356) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (0.4560 => 0.4720, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0554) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.82% (49.1529 => 50.5369, std.dev.: 0.1464) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.65% (0.4520 => 0.4640, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.62% (1.5280 => 1.5680, std.dev.: 0.0152) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 2.52% (19.2243 => 19.7084, std.dev.: 0.0751) MultiSource/Applications/sqlite3/sqlite3: 2.49% (24.7575 => 25.3735, std.dev.: 0.0415) MultiSource/Benchmarks/Bullet/bullet: 1.40% (39.0726 => 39.6206, std.dev.: 0.0507) MultiSource/Applications/kimwitu++/kc: 1.36% (19.7491 => 20.0171, std.dev.: 0.0413) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.77% (1.2401 => 1.4481, std.dev.: 0.0145) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.83% (3.9842 => 4.2963, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 4.29% (2.9842 => 3.1122, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: 2.70% (6.8204 => 7.0044, std.dev.: 0.0455) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (25.4536 => 25.8896, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0563 => 4.1163, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.05% (4.5563 => 4.6043, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.52% (11.0207 => 2.0361, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.48% (21.6534 => 17.8691, std.dev.: 0.0439) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -9.68% (3.4722 => 3.1362, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0907) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0356) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7643 => 4.6923, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.0963 => 5.0363, std.dev.: 0.0159) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 02:46:27 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 02:46:27 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140428094627.39D665014A88@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14886 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207404 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': if (SyntaxTool.run(newFrontendActionFactory()) != 0) ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/tools/clang/tools/extra/clang-modernize/tool/../../../../include/clang/Tooling/Tooling.h:283:23: note: passing argument to parameter 'Action' here int run(ToolAction *Action); ^ 1 error generated. make[6]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/ClangModernize.o] Error 1 make[6]: *** Waiting for unfinished jobs.... rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseAuto/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../AddOverride/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../PassByValue/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../UseNullptr/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../LoopConvert/.objdir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/tools/extra/clang-modernize/tool/Release+Asserts/../ReplaceAutoPtr/.objdir make[5]: *** [all] Error 1 make[4]: *** [all] Error 1 make[3]: *** [extra/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 07:50:22 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 07:50:22 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140428145041.910745016EA9@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19326 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207418 Blamelist: aaronballman,chandlerc,d0k,kcc,patha,rafael,tnorthover,vkutuzov Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Mon Apr 28 08:30:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 10:30:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140428153042.800D62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25088?compare_to=25087&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25088, Order: 207409, Start Time: 2014-04-28 10:55:02, End Time: 2014-04-28 15:37:26 To: 25087, Order: 207394, Start Time: 2014-04-28 04:54:07, End Time: 2014-04-28 09:36:37 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 11 (152 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (934 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/Regression/C/testtrace: 133.33% (0.0120 => 0.0280, std.dev.: 0.0047) SingleSource/Regression/C++/EH/exception_spec_test: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 30.77% (0.0520 => 0.0680, std.dev.: 0.0036) SingleSource/Regression/C/test_indvars: 25.00% (0.0480 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.39% (0.0920 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.33% (0.1440 => 0.1560, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 2.82% (0.8520 => 0.8760, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/obsequi/Obsequi: 2.12% (2.0721 => 2.1161, std.dev.: 0.0151) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2375.00% (0.0320 => 0.7920, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/Puzzle: 1200.08% (0.1240 => 1.6121, std.dev.: 0.0080) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 994.87% (0.0760 => 0.8321, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0092) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 200.00% (0.2520 => 0.7560, std.dev.: 0.0103) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0062) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0076) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0087) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.14% (0.7040 => 1.0640, std.dev.: 0.0178) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 47.37% (0.0760 => 0.1120, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 44.54% (1.3920 => 2.0120, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 40.00% (0.0600 => 0.0840, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0092) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0115) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.43% (1.2481 => 1.5281, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 21.43% (0.0560 => 0.0680, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.45% (1.1721 => 1.4001, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 18.66% (1.1361 => 1.3481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 18.37% (8.5802 => 10.1563, std.dev.: 0.0352) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 17.86% (1.2321 => 1.4521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.54% (1.3681 => 1.6081, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.25% (1.2521 => 1.4681, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.91% (0.1760 => 0.2040, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 14.96% (19.5406 => 22.4647, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.84% (5.3360 => 6.1281, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0056) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: 10.71% (0.4480 => 0.4960, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.59% (0.6800 => 0.7520, std.dev.: 0.0141) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.35% (0.5560 => 0.6080, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 8.91% (6.2844 => 6.8444, std.dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: 8.50% (11.3843 => 12.3523, std.dev.: 0.0491) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.90% (5.6680 => 6.1160, std.dev.: 0.0581) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.89% (5.7280 => 6.1800, std.dev.: 0.0419) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.7640 => 0.8200, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.2840 => 0.3040, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0248) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.90% (1.6240 => 1.7360, std.dev.: 0.0236) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.85% (11.4440 => 12.2280, std.dev.: 0.0975) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.89% (9.5802 => 10.1442, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0057) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0156) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (6.8280 => 7.0920, std.dev.: 0.0331) MultiSource/Applications/lua/lua: 3.86% (4.7720 => 4.9560, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/hash: 3.48% (0.4600 => 0.4760, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3840 => 5.5640, std.dev.: 0.0521) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.25% (1.4760 => 1.5240, std.dev.: 0.0155) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.15% (49.1529 => 50.7009, std.dev.: 0.1005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.7440 => 0.7640, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (2.2081 => 2.2601, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 2.31% (24.7575 => 25.3295, std.dev.: 0.0468) MultiSource/Applications/ClamAV/clamscan: 2.29% (19.2243 => 19.6644, std.dev.: 0.0721) MultiSource/Applications/kimwitu++/kc: 2.05% (19.7491 => 20.1531, std.dev.: 0.0534) MultiSource/Benchmarks/Bullet/bullet: 1.64% (39.0726 => 39.7126, std.dev.: 0.0711) MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (2.7282 => 2.7722, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0180) MultiSource/Applications/SPASS/SPASS: 1.06% (18.7966 => 18.9965, std.dev.: 0.0325) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.2401 => 1.4401, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/strcat: 12.50% (0.1280 => 0.1440, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.84% (3.9842 => 4.3363, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.8281 => 0.8721, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0286) MultiSource/Applications/minisat/minisat: 3.81% (6.8204 => 7.0804, std.dev.: 0.0311) MultiSource/Applications/siod/siod: 3.75% (2.9842 => 3.0962, std.dev.: 0.0131) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0290) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (25.4536 => 25.8736, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 1.35% (7.3965 => 7.4965, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-10-13-BadLoad: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0200 => 0.0000, std.dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.26% (21.6534 => 17.9171, std.dev.: 0.0351) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0621) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0074) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0190) MultiSource/Applications/lambda-0_1_3/lambda: -2.12% (5.0963 => 4.9883, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0246) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0150) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 08:30:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 10:30:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140428153052.5AAB32A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25089?compare_to=25085&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25089, Order: 207409, Start Time: 2014-04-28 10:55:04, End Time: 2014-04-28 15:37:34 To: 25085, Order: 207393, Start Time: 2014-04-28 04:01:41, End Time: 2014-04-28 08:44:00 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 7 (143 on baseline) Performance Improvements: 3 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.00% (0.1600 => 0.1760, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.2960 => 0.3080, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 3.31% (0.4840 => 0.5000, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0001 => 1.0241, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -2.78% (1.8681 => 1.8161, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.92% (1.6681 => 1.6361, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.85% (1.7321 => 1.7001, std.dev.: 0.0119) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0099) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0110) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 295.67% (0.4600 => 1.8201, std.dev.: 0.0083) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0025) SingleSource/UnitTests/2003-07-08-BitOpsTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0061) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Regression/C/sumarray2d: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.2360 => 0.2640, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0173) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.23% (0.7040 => 0.7760, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.49% (1.5601 => 1.7081, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.31% (1.4601 => 1.5961, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.19% (1.5241 => 1.6641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.03% (1.8161 => 1.9801, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.89% (1.4841 => 1.6161, std.dev.: 0.0130) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.36% (1.4841 => 1.6081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.29% (1.4961 => 1.6201, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: 8.26% (0.4840 => 0.5240, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.25% (1.1640 => 1.2600, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.25% (1.5521 => 1.6801, std.dev.: 0.0161) MultiSource/Applications/obsequi/Obsequi: 8.14% (1.8680 => 2.0200, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.01% (1.5481 => 1.6721, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.94% (1.6121 => 1.7401, std.dev.: 0.0139) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.07% (1.5281 => 1.6361, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.49% (1.4801 => 1.5761, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (6.4680 => 6.8800, std.dev.: 0.0305) MultiSource/Applications/Burg/burg: 6.37% (1.5080 => 1.6040, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: 6.12% (0.1960 => 0.2080, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.08% (1.5801 => 1.6761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (11.6440 => 12.3360, std.dev.: 0.0677) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.93% (1.4841 => 1.5721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (5.8121 => 6.1361, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.7400 => 1.8360, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.4640 => 1.5400, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/strcat: 5.08% (0.2360 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.01% (1.4361 => 1.5081, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0243) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0177) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (9.4842 => 9.8842, std.dev.: 0.0491) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.2960 => 0.3080, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 3.96% (5.3600 => 5.5720, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.94% (1.4201 => 1.4761, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.87% (0.7240 => 0.7520, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 3.86% (10.0443 => 10.4323, std.dev.: 0.0431) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.9681 => 1.0041, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 3.68% (21.9606 => 22.7688, std.dev.: 0.0714) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.4440 => 0.4600, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (6.5080 => 6.7320, std.dev.: 0.0270) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0145) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (50.0290 => 51.7410, std.dev.: 0.0653) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.7480 => 0.7720, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 3.19% (0.3760 => 0.3880, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 3.17% (4.7880 => 4.9400, std.dev.: 0.0304) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.12% (6.5440 => 6.7480, std.dev.: 0.0325) MultiSource/Benchmarks/Bullet/bullet: 3.07% (38.4046 => 39.5846, std.dev.: 0.0581) MultiSource/Applications/SPASS/SPASS: 2.99% (18.4404 => 18.9926, std.dev.: 0.0413) MultiSource/Applications/treecc/treecc: 2.94% (2.5840 => 2.6600, std.dev.: 0.0225) MultiSource/Applications/ClamAV/clamscan: 2.33% (19.0444 => 19.4883, std.dev.: 0.0481) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (4.1843 => 4.2803, std.dev.: 0.0134) MultiSource/Applications/siod/siod: 2.21% (2.7162 => 2.7762, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 2.17% (19.6891 => 20.1171, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (16.3483 => 16.6323, std.dev.: 0.0515) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (6.1044 => 6.1684, std.dev.: 0.0240) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0383) MultiSource/Applications/siod/siod: 9.93% (2.8602 => 3.1442, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.91% (1.6521 => 1.7001, std.dev.: 0.0119) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0396) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (3.9922 => 4.0803, std.dev.: 0.0229) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.20% (8.1845 => 8.3645, std.dev.: 0.0181) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.74% (11.5087 => 11.7087, std.dev.: 0.0120) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.61% (3.9842 => 4.0483, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 1.58% (8.1245 => 8.2525, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.95% (10.6247 => 2.0241, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.57% (2.9442 => 0.8960, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.18% (91.8497 => 49.4311, std.dev.: 10.6922) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.63% (50.3031 => 32.8821, std.dev.: 0.1723) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.60% (26.0616 => 17.0451, std.dev.: 0.1779) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.87% (42.1466 => 28.2938, std.dev.: 0.6230) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1137) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0154) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.07% (4.0283 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (4.8083 => 4.6763, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (4.1243 => 4.0403, std.dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (5.1563 => 5.0723, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0143) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 08:48:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 10:48:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428154801.B2E7A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25090?compare_to=25086&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25090, Order: 207410, Start Time: 2014-04-28 11:15:49, End Time: 2014-04-28 15:54:46 To: 25086, Order: 207394, Start Time: 2014-04-28 04:28:06, End Time: 2014-04-28 09:07:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (102 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 21.05% (0.0760 => 0.0920, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.2480 => 0.2640, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.45% (0.2200 => 0.2320, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.88% (1.2761 => 1.3001, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.22% (1.3161 => 1.3321, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 100.00% (0.0160 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.41% (0.8521 => 0.8641, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.39% (4.0403 => 4.0963, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -2.91% (1.6521 => 1.6041, std.dev.: 0.0145) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0054) SingleSource/UnitTests/2003-04-22-Switch: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0058) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.37% (0.1960 => 0.2320, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.55% (1.2721 => 1.3681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.56% (1.2801 => 1.3641, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.45% (1.3641 => 1.4521, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.02% (10.6960 => 11.3400, std.dev.: 0.0761) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0245) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0582) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (10.4082 => 10.7602, std.dev.: 0.0291) MultiSource/Applications/lua/lua: 3.27% (4.5200 => 4.6680, std.dev.: 0.0337) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0289) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 2.18% (17.6165 => 18.0005, std.dev.: 0.0494) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.12% (4.9000 => 5.0040, std.dev.: 0.0352) MultiSource/Applications/sqlite3/sqlite3: 2.09% (23.7574 => 24.2535, std.dev.: 0.0291) MultiSource/Benchmarks/Bullet/bullet: 1.95% (37.0925 => 37.8165, std.dev.: 0.0918) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.93% (5.8000 => 5.9120, std.dev.: 0.0415) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0483) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.80% (48.1088 => 48.9730, std.dev.: 0.0989) MultiSource/Applications/kimwitu++/kc: 1.68% (18.8170 => 19.1331, std.dev.: 0.0271) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 1.04% (5.7964 => 5.8564, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0243) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0224) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 2.44% (21.1533 => 21.6694, std.dev.: 0.1191) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0289) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0093) SingleSource/Benchmarks/Stanford/Puzzle: -13.33% (0.1200 => 0.1040, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 09:04:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 11:04:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428160440.C5A072A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25091?compare_to=25090&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25091, Order: 207411, Start Time: 2014-04-28 11:30:19, End Time: 2014-04-28 16:11:26 To: 25090, Order: 207410, Start Time: 2014-04-28 11:15:49, End Time: 2014-04-28 15:54:46 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (102 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/Regression/C/casts: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 30.77% (0.0520 => 0.0680, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 15.38% (0.1040 => 0.1200, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.78% (0.2360 => 0.2520, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.95% (0.6720 => 0.7120, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary2: 5.63% (0.2840 => 0.3000, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.15% (0.3880 => 0.4080, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 3.59% (0.7800 => 0.8080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.29% (1.2401 => 1.2561, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -28.57% (0.0560 => 0.0400, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1480 => 0.1680, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.49% (1.2321 => 1.3121, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (6.0160 => 6.3640, std.dev.: 0.0496) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0483) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0181) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0248) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0373) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0183) MultiSource/Applications/lua/lua: 3.19% (4.5200 => 4.6640, std.dev.: 0.0312) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (10.4082 => 10.7122, std.dev.: 0.0422) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.55% (5.8000 => 5.9480, std.dev.: 0.0389) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.29% (17.6165 => 18.0205, std.dev.: 0.0571) MultiSource/Benchmarks/Bullet/bullet: 1.92% (37.0925 => 37.8046, std.dev.: 0.0812) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0413) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0375) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.82% (48.1088 => 48.9848, std.dev.: 0.0940) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1451, std.dev.: 0.0215) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.58% (0.3040 => 0.3240, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0252) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 2.55% (21.1533 => 21.6934, std.dev.: 0.1269) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 1.62% (6.6564 => 6.7644, std.dev.: 0.0301) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0040) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0511) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: -9.80% (0.4080 => 0.3680, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.70% (0.9401 => 0.9241, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 09:19:41 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 11:19:41 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428161941.DFBAD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25092?compare_to=25091&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25092, Order: 207412, Start Time: 2014-04-28 11:45:24, End Time: 2014-04-28 16:26:26 To: 25091, Order: 207411, Start Time: 2014-04-28 11:30:19, End Time: 2014-04-28 16:11:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (98 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.00% (0.0800 => 0.1000, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 7.89% (0.1520 => 0.1640, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 2.64% (2.4240 => 2.4880, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.21% (1.3241 => 1.3401, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/health/health: 6.52% (0.3680 => 0.3920, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.26% (0.2160 => 0.2360, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0675) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0499) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0518) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0156) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.91% (0.9200 => 0.9560, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0187) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0281) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0359) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.8000 => 5.9600, std.dev.: 0.0398) MultiSource/Applications/sqlite3/sqlite3: 2.64% (23.7574 => 24.3855, std.dev.: 0.0472) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0336) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0349) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0152) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.09% (48.1088 => 49.1129, std.dev.: 0.0609) MultiSource/Benchmarks/Bullet/bullet: 1.84% (37.0925 => 37.7765, std.dev.: 0.0986) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: 1.59% (18.8170 => 19.1171, std.dev.: 0.0463) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0513) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 20.60% (0.9321 => 1.1241, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (25.8896 => 26.7177, std.dev.: 0.0366) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1921 => 2.2241, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0199) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -3.43% (0.7000 => 0.6760, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 10:05:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 12:05:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428170504.DFC462A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25093?compare_to=25092&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25093, Order: 207413, Start Time: 2014-04-28 12:32:54, End Time: 2014-04-28 17:11:49 To: 25092, Order: 207412, Start Time: 2014-04-28 11:45:24, End Time: 2014-04-28 16:26:26 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (98 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/Vector/sumarray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 35.71% (0.0560 => 0.0760, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 27.78% (0.0720 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 5.71% (0.2800 => 0.2960, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.13% (0.3120 => 0.3280, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 2.82% (0.7080 => 0.7280, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.58% (1.2681 => 1.2881, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 21.43% (0.0560 => 0.0680, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.31% (1.2081 => 1.2481, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.68% (4.6323 => 4.7563, std.dev.: 0.0413) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -13.56% (0.2360 => 0.2040, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -3.27% (1.3441 => 1.3001, std.dev.: 0.0144) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0033) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.57% (1.2161 => 1.3081, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.04% (1.1361 => 1.2161, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0302) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.47% (10.6960 => 11.3880, std.dev.: 0.0807) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.39% (1.2521 => 1.3321, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0214) MultiSource/Applications/Burg/burg: 4.66% (1.4600 => 1.5280, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0551) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0406) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0497) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.7360 => 1.7880, std.dev.: 0.0193) MultiSource/Applications/JM/lencod/lencod: 2.84% (17.6165 => 18.1165, std.dev.: 0.0386) MultiSource/Applications/sqlite3/sqlite3: 2.44% (23.7574 => 24.3375, std.dev.: 0.0292) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.8322 => 2.8882, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: 1.92% (37.0925 => 37.8045, std.dev.: 0.0658) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.68% (48.1088 => 48.9169, std.dev.: 0.1155) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0152) MultiSource/Applications/kimwitu++/kc: 1.57% (18.8170 => 19.1130, std.dev.: 0.0264) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/treeadd/treeadd: 14.29% (0.2240 => 0.2560, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0185) MultiSource/Benchmarks/FreeBench/distray/distray: 7.69% (0.1560 => 0.1680, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0251) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 2.31% (21.1533 => 21.6414, std.dev.: 0.1169) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1921 => 2.2241, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.38% (3.4842 => 3.5322, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0223) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0056) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 10:12:05 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 10:12:05 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase2 - living Message-ID: <20140428171217.C7832501800B@lab.llvm.org> The Buildbot has detected a restored build on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7592 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207418 Blamelist: aaronballman,chandlerc,ctopper,d0k,delcypher,djasper,haoliu,kcc,nico,patha,rafael,tfiala,tnorthover,vkutuzov Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 11:26:16 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 11:26:16 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase2 - living Message-ID: <20140428182714.D30B15018AF0@lab.llvm.org> The Buildbot has detected a build exception on builder phase2 - living while building lab.llvm.org. Full details are available at: http://lab.llvm.org:8013/builders/phase2%20-%20living/builds/7593 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207423 Blamelist: aaronballman,mcrosier,rafael,tnorthover BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 11:26:47 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 11:26:47 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140428182714.598125018AEF@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19332 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207427 Blamelist: nico BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 11:51:48 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 11:51:48 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140428185200.55FFF5018ED6@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19333 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207429 Blamelist: joerg,pcc Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 12:17:36 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 12:17:36 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140428191800.D0A79501924C@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19334 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207430 Blamelist: ributzka BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 12:34:33 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 12:34:33 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140428193446.777925019473@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19335 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207432 Blamelist: qcolombet Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Mon Apr 28 13:17:42 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 15:17:42 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140428201742.695712A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25094?compare_to=25089&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25094, Order: 207422, Start Time: 2014-04-28 15:41:27, End Time: 2014-04-28 20:24:11 To: 25089, Order: 207409, Start Time: 2014-04-28 10:55:04, End Time: 2014-04-28 15:37:34 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 30 (151 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1082 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/BuiltinTypeInfo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 60.00% (0.0200 => 0.0320, std.dev.: 0.0020) SingleSource/UnitTests/SignlessTypes/div: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) MultiSource/Benchmarks/llubenchmark/llu: 41.67% (0.0480 => 0.0680, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/objinst: 40.00% (0.0400 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.00% (0.1000 => 0.1240, std.dev.: 0.0050) SingleSource/UnitTests/SignlessTypes/rem: 9.38% (0.1280 => 0.1400, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.57% (1.1200 => 1.2160, std.dev.: 0.0301) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 5.77% (0.2080 => 0.2200, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.08% (0.7880 => 0.8280, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.71% (0.3400 => 0.3560, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 3.61% (0.3320 => 0.3440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4720 => 0.4880, std.dev.: 0.0057) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.04% (1.3160 => 1.3560, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.39% (1.5081 => 1.5441, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.23% (2.1480 => 2.1960, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.96% (1.6361 => 1.6681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.61% (1.7401 => 1.7681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.48% (1.6201 => 1.6441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.25% (1.5961 => 1.6161, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (9.8842 => 10.0042, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.21% (1.9801 => 2.0041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.02% (1.5721 => 1.5881, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.39% (0.0920 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: 2.73% (0.7320 => 0.7520, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.65% (1.7001 => 1.7281, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0087) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 294.80% (0.4600 => 1.8161, std.dev.: 0.0088) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0056) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/div: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 30.77% (0.0520 => 0.0680, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/objinst: 27.27% (0.0440 => 0.0560, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.00% (0.0960 => 0.1200, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 20.00% (0.1200 => 0.1440, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.80% (1.0240 => 1.1960, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.07% (0.2920 => 0.3360, std.dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 14.55% (0.6600 => 0.7560, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.33% (0.1800 => 0.2040, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: 13.04% (0.1840 => 0.2080, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/neural/neural: 12.24% (0.1960 => 0.2200, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.02% (1.5601 => 1.7321, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.4561 => 1.6161, std.dev.: 0.0087) SingleSource/Regression/C/bigstack: 10.87% (0.1840 => 0.2040, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.68% (1.4601 => 1.6161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0064) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.35% (1.8161 => 2.0041, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.97% (1.4841 => 1.6321, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.89% (1.4961 => 1.6441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.68% (1.6121 => 1.7681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.16% (1.5281 => 1.6681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.96% (1.1160 => 1.2160, std.dev.: 0.0301) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.79% (0.3640 => 0.3960, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.78% (1.7761 => 1.9321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.76% (1.5521 => 1.6881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (1.1640 => 1.2640, std.dev.: 0.0205) MultiSource/Applications/obsequi/Obsequi: 8.57% (1.8680 => 2.0280, std.dev.: 0.0290) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.45% (1.4201 => 1.5401, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 8.33% (1.0080 => 1.0920, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.81% (0.7680 => 0.8280, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.62% (1.7841 => 1.9201, std.dev.: 0.0143) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (1.5401 => 1.6561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.52% (1.4361 => 1.5441, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.39% (0.7040 => 0.7560, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.7000 => 0.7480, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.84% (1.5801 => 1.6881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.81% (1.4681 => 1.5681, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (6.4680 => 6.9000, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.67% (1.7401 => 1.8561, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.63% (11.6440 => 12.4160, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0089) SingleSource/Benchmarks/Linpack/linpack-pc: 6.17% (0.3240 => 0.3440, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.99% (5.8121 => 6.1601, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.93% (1.4161 => 1.5001, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.7400 => 1.8400, std.dev.: 0.0249) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (1.4201 => 1.5001, std.dev.: 0.0167) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.48% (9.4842 => 10.0042, std.dev.: 0.0270) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 5.45% (5.3600 => 5.6520, std.dev.: 0.0334) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (2.0440 => 2.1480, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0309) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 4.18% (10.0443 => 10.4643, std.dev.: 0.0304) MultiSource/Applications/JM/lencod/lencod: 4.14% (21.9606 => 22.8688, std.dev.: 0.0431) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.09% (3.0282 => 3.1522, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: 3.98% (1.5080 => 1.5680, std.dev.: 0.0195) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 3.84% (6.9844 => 7.2525, std.dev.: 0.0185) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.81% (50.0290 => 51.9330, std.dev.: 0.1184) MultiSource/Applications/treecc/treecc: 3.72% (2.5840 => 2.6800, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.61% (2.3281 => 2.4122, std.dev.: 0.0186) MultiSource/Benchmarks/Bullet/bullet: 3.50% (38.4046 => 39.7486, std.dev.: 0.0752) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4720 => 0.4880, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0177) MultiSource/Applications/SPASS/SPASS: 3.38% (18.4404 => 19.0646, std.dev.: 0.0367) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.35% (1.3120 => 1.3560, std.dev.: 0.0150) MultiSource/Applications/lua/lua: 3.34% (4.7880 => 4.9480, std.dev.: 0.0426) MultiSource/Applications/siod/siod: 3.09% (2.7162 => 2.8002, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.07% (6.5080 => 6.7080, std.dev.: 0.0338) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.81% (6.5440 => 6.7280, std.dev.: 0.0575) MultiSource/Applications/kimwitu++/kc: 2.68% (19.6891 => 20.2171, std.dev.: 0.0273) MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (1.7921 => 1.8401, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: 2.50% (19.0444 => 19.5204, std.dev.: 0.0453) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (16.3483 => 16.7283, std.dev.: 0.0396) MultiSource/Applications/d/make_dparser: 1.92% (3.9681 => 4.0441, std.dev.: 0.0293) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.31% (6.1044 => 6.1844, std.dev.: 0.0191) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (13.0563 => 13.2243, std.dev.: 0.0264) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.52% (2.1401 => 2.4722, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 9.65% (2.8602 => 3.1362, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.53% (1.5921 => 1.6801, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (8.1845 => 8.3725, std.dev.: 0.0089) MultiSource/Applications/minisat/minisat: 2.28% (6.6684 => 6.8204, std.dev.: 0.0352) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (3.9922 => 4.0723, std.dev.: 0.0247) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.5087 => 11.7167, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.51% (3.9842 => 4.0443, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.38% (8.1245 => 8.2365, std.dev.: 0.0091) MultiSource/Applications/lua/lua: 1.18% (21.7374 => 21.9934, std.dev.: 0.0917) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.30% (2.9442 => 0.9040, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.76% (1.5641 => 1.0361, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.23% (91.8497 => 49.3831, std.dev.: 10.1840) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.60% (50.3031 => 32.8981, std.dev.: 0.1715) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.40% (26.0616 => 17.0971, std.dev.: 0.0918) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.42% (42.1466 => 28.4818, std.dev.: 0.6973) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1084) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -14.44% (7.7845 => 6.6604, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0271) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0360) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (4.1243 => 4.0403, std.dev.: 0.0161) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.17% (2.7442 => 2.7122, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 13:20:49 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 15:20:49 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428202049.6777F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25095?compare_to=25093&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25095, Order: 207422, Start Time: 2014-04-28 15:43:44, End Time: 2014-04-28 20:27:29 To: 25093, Order: 207413, Start Time: 2014-04-28 12:32:54, End Time: 2014-04-28 17:11:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 22 (93 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0025) SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Regression/C/sumarray: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.64% (0.0880 => 0.1000, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.76% (0.2040 => 0.2280, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 7.89% (0.1520 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1960 => 0.2080, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 5.94% (0.4040 => 0.4280, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary3: 4.05% (0.2960 => 0.3080, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.03% (1.3880 => 1.4440, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.30% (1.2161 => 1.2441, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.52% (4.9840 => 5.0600, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.49% (1.3441 => 1.3641, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 50.00% (0.0480 => 0.0720, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 34.62% (0.1040 => 0.1400, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 11.08% (1.3001 => 1.4441, std.dev.: 0.0275) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 9.85% (1.0961 => 1.2041, std.dev.: 0.0376) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -1.27% (3.4562 => 3.4122, std.dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0038) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.14% (1.1441 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.00% (0.4400 => 0.4840, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (1.1881 => 1.2801, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.62% (1.2601 => 1.3561, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (10.6960 => 11.3800, std.dev.: 0.0671) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (1.3760 => 1.4440, std.dev.: 0.0214) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0362) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0120) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0342) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0419) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 2.79% (17.6165 => 18.1085, std.dev.: 0.0479) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.8000 => 5.9560, std.dev.: 0.0385) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8886, std.dev.: 0.0750) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.06% (48.1088 => 49.1009, std.dev.: 0.0749) MultiSource/Applications/sqlite3/sqlite3: 1.94% (23.7574 => 24.2175, std.dev.: 0.0640) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (7.8562 => 8.0042, std.dev.: 0.0325) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.8322 => 2.8842, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0111) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0363) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0181) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 6.18% (1.3601 => 1.4441, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 2.29% (21.1533 => 21.6374, std.dev.: 0.1428) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0246) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/life/life: -18.18% (0.0880 => 0.0720, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.68% (0.1240 => 0.1120, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 13:22:09 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 15:22:09 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140428202209.219A52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25096?compare_to=25080&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25096, Order: 207422, Start Time: 2014-04-28 15:43:37, End Time: 2014-04-28 20:28:48 To: 25080, Order: 207386, Start Time: 2014-04-28 00:49:44, End Time: 2014-04-28 05:35:06 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (141 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count-2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.11% (0.1440 => 0.1600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.11% (0.1080 => 0.1200, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.34% (0.1160 => 0.1280, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3040 => 0.3160, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 3.91% (0.5120 => 0.5320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.80% (0.3160 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.66% (0.9841 => 1.0201, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -1.73% (1.8481 => 1.8161, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.05% (17.6723 => 19.6244, std.dev.: 0.0723) MultiSource/Applications/sqlite3/sqlite3: 1419.77% (1.7001 => 25.8376, std.dev.: 0.0274) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.30% (50.1010 => 51.7530, std.dev.: 0.1104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.67% (11.3920 => 12.3800, std.dev.: 0.0570) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0117) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0243, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0110) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0105) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0076) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0026) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.00% (0.1000 => 0.1200, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.54% (1.8281 => 2.1121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.25% (1.8361 => 2.1161, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.04% (1.8081 => 2.0801, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.87% (1.8561 => 2.1321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.60% (1.9721 => 2.2601, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.34% (1.9521 => 2.2321, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.28% (1.8201 => 2.0801, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.07% (1.8761 => 2.1401, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.81% (1.9121 => 2.1761, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.72% (1.9241 => 2.1881, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.67% (1.9601 => 2.2281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.15% (1.9161 => 2.1681, std.dev.: 0.0168) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.69% (2.1121 => 2.3801, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.32% (2.1441 => 2.4082, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.17% (1.8081 => 2.0281, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0084) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.11% (1.8361 => 2.0401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.06% (1.7721 => 1.9681, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/08-main/main: 10.98% (0.3280 => 0.3640, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.3720 => 0.4120, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0360) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.27% (1.9481 => 2.1481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.06% (0.6360 => 0.7000, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.06% (2.0681 => 2.2761, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0187) MultiSource/Applications/obsequi/Obsequi: 9.38% (1.8760 => 2.0520, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.20% (0.3480 => 0.3800, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.19% (1.0880 => 1.1880, std.dev.: 0.0231) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.70% (0.1840 => 0.2000, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.2920 => 0.3160, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.3760 => 0.4040, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (1.6960 => 1.8080, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (6.4800 => 6.8840, std.dev.: 0.0341) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.9960 => 1.0560, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (5.8281 => 6.1041, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.35% (1.7480 => 1.8240, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.1320 => 1.1800, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0109) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 3.83% (10.2283 => 10.6204, std.dev.: 0.0399) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.79% (9.6042 => 9.9682, std.dev.: 0.0433) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 3.77% (0.8480 => 0.8800, std.dev.: 0.0095) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.69% (1.3000 => 1.3480, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/football/football: 3.69% (1.0840 => 1.1240, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0201) MultiSource/Applications/lambda-0_1_3/lambda: 3.38% (0.8280 => 0.8560, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (6.5320 => 6.7520, std.dev.: 0.0334) MultiSource/Applications/oggenc/oggenc: 2.95% (7.0524 => 7.2605, std.dev.: 0.0185) MultiSource/Applications/treecc/treecc: 2.94% (2.5880 => 2.6640, std.dev.: 0.0221) MultiSource/Applications/lua/lua: 2.92% (4.7920 => 4.9320, std.dev.: 0.0347) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0100) MultiSource/Applications/d/make_dparser: 2.82% (3.9761 => 4.0881, std.dev.: 0.0168) MultiSource/Applications/SPASS/SPASS: 2.81% (18.5284 => 19.0486, std.dev.: 0.0543) MultiSource/Benchmarks/Bullet/bullet: 2.56% (38.6366 => 39.6246, std.dev.: 0.0748) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.41% (2.1600 => 2.2120, std.dev.: 0.0165) MultiSource/Applications/JM/lencod/lencod: 2.39% (22.2206 => 22.7527, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (16.3003 => 16.6843, std.dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (3.0562 => 3.1242, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (6.5360 => 6.6720, std.dev.: 0.0478) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.7841 => 1.8161, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0129) MultiSource/Applications/kimwitu++/kc: 1.49% (19.8291 => 20.1251, std.dev.: 0.0526) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (13.0363 => 13.1723, std.dev.: 0.0368) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0399) MultiSource/Applications/siod/siod: 9.78% (2.8642 => 3.1442, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0051) MultiSource/Benchmarks/llubenchmark/llu: 5.06% (5.0603 => 5.3163, std.dev.: 0.0816) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0393) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 1.77% (11.4967 => 11.7007, std.dev.: 0.0202) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (8.3605 => 8.4565, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.0243 => 5.0803, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6880 => 0.6600, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.25% (94.8339 => 49.0751, std.dev.: 8.8907) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.79% (25.7136 => 17.0251, std.dev.: 0.1717) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.75% (49.9431 => 33.0861, std.dev.: 0.1836) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.45% (37.0863 => 28.3898, std.dev.: 0.6014) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1103) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -14.89% (7.8165 => 6.6524, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.75% (2.7482 => 2.4802, std.dev.: 0.0873) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0000) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0216) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.67% (4.8043 => 4.7243, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.01% (2.7722 => 2.7442, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 13:25:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 15:25:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140428202507.8A7032A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25097?compare_to=25081&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25097, Order: 207422, Start Time: 2014-04-28 15:45:34, End Time: 2014-04-28 20:31:49 To: 25081, Order: 207386, Start Time: 2014-04-28 01:03:23, End Time: 2014-04-28 05:49:42 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/mason/mason: 18.75% (0.0640 => 0.0760, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 13.33% (0.1200 => 0.1360, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.45% (0.2200 => 0.2320, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 4.32% (0.6480 => 0.6760, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3480 => 0.3600, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.88% (1.7001 => 1.7321, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.61% (1.7401 => 1.7681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.55% (1.8121 => 1.8401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.39% (1.7281 => 1.7521, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.30% (0.8481 => 0.8761, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 2.19% (0.7320 => 0.7480, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: 1.56% (2.0481 => 2.0801, std.dev.: 0.0122) SingleSource/Benchmarks/McGill/chomp: 1.44% (1.1081 => 1.1241, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.06% (4.1563 => 4.1123, std.dev.: 0.0095) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 13:28:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 15:28:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140428202810.794E12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25098?compare_to=25083&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25098, Order: 207422, Start Time: 2014-04-28 15:46:44, End Time: 2014-04-28 20:34:55 To: 25083, Order: 207388, Start Time: 2014-04-28 01:56:49, End Time: 2014-04-28 06:44:54 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (130 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (944 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/objinst: 44.44% (0.0360 => 0.0520, std.dev.: 0.0032) SingleSource/UnitTests/2003-08-11-VaListArg: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 5.26% (0.3040 => 0.3200, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (1.7561 => 1.7761, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 28.57% (0.0560 => 0.0720, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/hash: 1.52% (4.2243 => 4.2883, std.dev.: 0.0110) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0095) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0480 => 0.0680, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 34.04% (0.1880 => 0.2520, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.83% (0.1640 => 0.2080, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.46% (1.6961 => 2.0601, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.33% (1.6881 => 2.0481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.00% (1.6761 => 2.0281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.81% (1.6721 => 2.0201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.80% (1.6921 => 2.0441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.67% (1.8001 => 2.1721, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.18% (1.7241 => 2.0721, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.13% (1.8881 => 2.2681, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.77% (1.7201 => 2.0601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.73% (1.8041 => 2.1601, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.72% (1.9881 => 2.3801, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.49% (1.7441 => 2.0841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.47% (1.8281 => 2.1841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.42% (1.7921 => 2.1401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.87% (1.6961 => 2.0161, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.24% (1.8201 => 2.1521, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.18% (0.0880 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.08% (1.8361 => 2.1681, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.02% (1.9761 => 2.3321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.46% (0.6120 => 0.6760, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/ffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.8601 => 0.9321, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0058) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2280 => 0.2440, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3000 => 0.3200, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: 6.56% (0.2440 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.40% (3.5002 => 3.7242, std.dev.: 0.0261) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (11.7880 => 12.5240, std.dev.: 0.0689) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.15% (0.7800 => 0.8280, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: 5.88% (1.0200 => 1.0800, std.dev.: 0.0231) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.5000 => 0.5280, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.5240 => 1.6080, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.7280 => 1.8200, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/random: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (1.2400 => 1.3040, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (2.0680 => 2.1640, std.dev.: 0.0200) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (9.9842 => 10.4082, std.dev.: 0.0385) MultiSource/Applications/oggenc/oggenc: 4.22% (6.9124 => 7.2044, std.dev.: 0.0189) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.15% (1.3480 => 1.4040, std.dev.: 0.0211) MultiSource/Applications/treecc/treecc: 4.12% (2.6200 => 2.7280, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (6.8321 => 7.1121, std.dev.: 0.0291) MultiSource/Applications/d/make_dparser: 4.04% (3.9641 => 4.1241, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0284) MultiSource/Applications/SPASS/SPASS: 3.46% (18.4924 => 19.1326, std.dev.: 0.0394) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (10.3203 => 10.6244, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: 2.72% (19.7371 => 20.2731, std.dev.: 0.0353) MultiSource/Applications/JM/lencod/lencod: 2.49% (22.6287 => 23.1927, std.dev.: 0.0722) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (51.1089 => 52.3689, std.dev.: 0.1529) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.40% (1.0001 => 1.0241, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 2.37% (38.9366 => 39.8606, std.dev.: 0.0868) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (4.2203 => 4.3203, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 2.31% (20.2445 => 20.7125, std.dev.: 0.0471) MultiSource/Benchmarks/MallocBench/gs/gs: 2.24% (5.5480 => 5.6720, std.dev.: 0.0441) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (16.5963 => 16.9083, std.dev.: 0.0370) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0239) MultiSource/Applications/sqlite3/sqlite3: 1.57% (25.1895 => 25.5856, std.dev.: 0.0382) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 37.50% (0.0320 => 0.0440, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/09-vor/vor: 17.39% (0.0920 => 0.1080, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.93% (1.2681 => 1.4321, std.dev.: 0.0109) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0135) MultiSource/Applications/minisat/minisat: 3.64% (6.8204 => 7.0684, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (4.2443 => 4.3323, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0107) SingleSource/UnitTests/Vector/constpool: -81.45% (10.9087 => 2.0241, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0122) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.44% (1.5881 => 1.1841, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0043) MultiSource/Applications/obsequi/Obsequi: -22.36% (2.6481 => 2.0560, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.63% (7.4801 => 6.2360, std.dev.: 0.0328) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.58% (7.5041 => 6.2600, std.dev.: 0.0603) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: -3.11% (13.5243 => 13.1043, std.dev.: 0.0509) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6534 => 17.8851, std.dev.: 0.0364) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.51% (2.6082 => 2.3601, std.dev.: 0.0900) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0069) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -2.79% (5.1603 => 5.0163, std.dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: -1.44% (8.3085 => 8.1885, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.43% (4.7603 => 4.6923, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 13:41:09 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 13:41:09 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140428204138.82D9B5019F2C@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19338 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207439 Blamelist: dexonsmith BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 13:54:10 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 13:54:10 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140428205422.A5231501A1BD@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19339 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207440 Blamelist: dexonsmith Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 14:14:50 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 14:14:50 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140428211514.B3134501A507@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19340 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207444 Blamelist: dblaikie,echristo,samsonov BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Mon Apr 28 14:08:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 16:08:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428210857.D5C282A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25099?compare_to=25095&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25099, Order: 207423, Start Time: 2014-04-28 16:36:40, End Time: 2014-04-28 21:15:39 To: 25095, Order: 207422, Start Time: 2014-04-28 15:43:44, End Time: 2014-04-28 20:27:29 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (88 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (1003 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/mandel-text: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Regression/C/DuffsDevice: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.2800 => 0.2960, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.3600 => 0.3800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.05% (1.3681 => 1.3961, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.27% (1.2321 => 1.2601, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.17% (3.4122 => 3.4522, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -7.69% (0.2600 => 0.2400, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0032) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.87% (0.1840 => 0.2040, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.75% (1.2721 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (10.6960 => 11.4000, std.dev.: 0.0564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2320 => 0.2440, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0244) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0199) MultiSource/Applications/lua/lua: 3.63% (4.5200 => 4.6840, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0357) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.20% (48.1088 => 49.1689, std.dev.: 0.0797) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 2.09% (23.7574 => 24.2535, std.dev.: 0.0426) MultiSource/Benchmarks/Bullet/bullet: 2.03% (37.0925 => 37.8445, std.dev.: 0.0781) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 1.45% (18.8170 => 19.0890, std.dev.: 0.0405) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0328) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0216) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0385) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 2.42% (21.1533 => 21.6654, std.dev.: 0.0411) MultiSource/Applications/obsequi/Obsequi: 2.32% (2.0681 => 2.1161, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0028) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0031) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 14:54:25 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 14:54:25 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140428215438.21E9B501AB32@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19342 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207448 Blamelist: bogner,dblaikie Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Mon Apr 28 14:57:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 16:57:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428215724.667892A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25100?compare_to=25099&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25100, Order: 207424, Start Time: 2014-04-28 17:22:43, End Time: 2014-04-28 22:04:08 To: 25099, Order: 207423, Start Time: 2014-04-28 16:36:40, End Time: 2014-04-28 21:15:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (102 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 42.11% (0.0760 => 0.1080, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.71% (0.1120 => 0.1240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.70% (0.3240 => 0.3360, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 1.21% (1.3201 => 1.3361, std.dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0025) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.18% (0.6240 => 0.7000, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0381) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (10.6960 => 11.3600, std.dev.: 0.0870) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0194) MultiSource/Applications/spiff/spiff: 5.26% (0.9880 => 1.0400, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.06% (8.1441 => 8.5561, std.dev.: 0.0336) MultiSource/Applications/lua/lua: 4.96% (4.5200 => 4.7440, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.1201 => 2.2041, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0403) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (4.9000 => 5.0680, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0538) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.8000 => 5.9600, std.dev.: 0.0596) MultiSource/Benchmarks/Bullet/bullet: 2.72% (37.0925 => 38.1006, std.dev.: 0.0425) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0710) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.64% (48.1088 => 49.3809, std.dev.: 0.0906) MultiSource/Applications/sqlite3/sqlite3: 2.56% (23.7574 => 24.3655, std.dev.: 0.0299) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0347) MultiSource/Applications/kimwitu++/kc: 2.34% (18.8170 => 19.2571, std.dev.: 0.0536) MultiSource/Applications/SPASS/SPASS: 1.91% (17.5484 => 17.8844, std.dev.: 0.0295) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0161) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0151) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0278) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0224) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (25.8896 => 26.7897, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 2.55% (21.1533 => 21.6934, std.dev.: 0.0630) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.86% (6.6564 => 6.7804, std.dev.: 0.0439) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0058) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0524) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 15:28:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 17:28:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428222858.7C2F12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25101?compare_to=25100&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25101, Order: 207426, Start Time: 2014-04-28 17:56:10, End Time: 2014-04-28 22:35:41 To: 25100, Order: 207424, Start Time: 2014-04-28 17:22:43, End Time: 2014-04-28 22:04:08 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (96 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (995 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/FloatMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0520 => 0.0640, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.24% (0.7640 => 0.8040, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2360 => 0.2480, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3960 => 0.4120, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.51% (1.3241 => 1.3441, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.46% (1.0121 => 1.1281, std.dev.: 0.0351) MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (2.3241 => 2.3481, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: -12.90% (0.1240 => 0.1080, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.22% (0.0720 => 0.0880, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.0160 => 6.4440, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (10.6960 => 11.3920, std.dev.: 0.0764) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.24% (0.7640 => 0.8040, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.9200 => 0.9680, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0189) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (8.1441 => 8.5081, std.dev.: 0.0353) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0311) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0126) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0422) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0360) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0277) MultiSource/Applications/JM/lencod/lencod: 2.41% (17.6165 => 18.0405, std.dev.: 0.0642) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0342) MultiSource/Benchmarks/Bullet/bullet: 2.04% (37.0925 => 37.8486, std.dev.: 0.0908) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0326) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.95% (48.1088 => 49.0449, std.dev.: 0.1233) MultiSource/Applications/kimwitu++/kc: 1.70% (18.8170 => 19.1371, std.dev.: 0.0376) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0189) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (25.8896 => 26.7337, std.dev.: 0.0582) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.4680 => 0.4800, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 2.23% (21.1533 => 21.6254, std.dev.: 0.1684) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 15:46:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 17:46:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140428224638.29EBC2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25102?compare_to=25101&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25102, Order: 207427, Start Time: 2014-04-28 18:12:14, End Time: 2014-04-28 22:53:21 To: 25101, Order: 207426, Start Time: 2014-04-28 17:56:10, End Time: 2014-04-28 22:35:41 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (91 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (997 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 18.75% (0.0640 => 0.0760, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.48% (0.4600 => 0.4760, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.13% (0.5120 => 0.5280, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.70% (0.4440 => 0.4560, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: 2.05% (0.5840 => 0.5960, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.04% (0.0920 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (6.0160 => 6.4240, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (10.6960 => 11.3720, std.dev.: 0.0785) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0220) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (8.1441 => 8.4881, std.dev.: 0.0538) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.21% (0.8561 => 0.8921, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0315) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0511) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0413) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (10.4082 => 10.7362, std.dev.: 0.0537) MultiSource/Applications/JM/lencod/lencod: 2.52% (17.6165 => 18.0605, std.dev.: 0.0410) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.50% (1.4400 => 1.4760, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 2.36% (37.0925 => 37.9686, std.dev.: 0.0447) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (7.8562 => 8.0402, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0402) MultiSource/Applications/sqlite3/sqlite3: 2.14% (23.7574 => 24.2655, std.dev.: 0.0310) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.05% (48.1088 => 49.0930, std.dev.: 0.1110) MultiSource/Applications/kimwitu++/kc: 1.59% (18.8170 => 19.1171, std.dev.: 0.0414) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0174) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0284) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.70% (0.4440 => 0.4560, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0262) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/pi: -66.67% (0.0240 => 0.0080, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/mandel-text: -57.14% (0.0280 => 0.0120, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: -1.97% (0.6080 => 0.5960, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 17:06:33 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 17:06:33 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429000650.080AE501C109@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19349 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207465 Blamelist: chandlerc,dblaikie BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 17:24:00 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 17:24:00 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429002417.A5ABA501C3A6@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19350 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207468 Blamelist: chandlerc Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 17:58:57 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 17:58:57 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429005920.2FBD9501C9A1@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19351 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207475 Blamelist: chandlerc,echristo,rnk BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Mon Apr 28 18:10:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 20:10:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429011048.191002A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25103?compare_to=25094&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25103, Order: 207439, Start Time: 2014-04-28 20:35:21, End Time: 2014-04-29 01:17:33 To: 25094, Order: 207422, Start Time: 2014-04-28 15:41:27, End Time: 2014-04-28 20:24:11 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (145 on baseline) Performance Improvements: 2 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/callargs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0030) SingleSource/UnitTests/2002-12-13-MishaTest: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.50% (0.8000 => 0.8280, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -2.34% (5.6520 => 5.5200, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.72% (1.8561 => 1.8241, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.36% (11.3687 => 3.0282, std.dev.: 0.0139) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/dead_try_block: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0073) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0042) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0062) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Regression/C/sumarray: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Towers: 33.33% (0.0480 => 0.0640, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/life/life: 21.05% (0.0760 => 0.0920, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.18% (0.0880 => 0.1040, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.62% (1.0240 => 1.1840, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.63% (0.1640 => 0.1880, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.64% (0.1760 => 0.2000, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.6600 => 0.7360, std.dev.: 0.0182) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 10.27% (0.5840 => 0.6440, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0123) MultiSource/Applications/obsequi/Obsequi: 9.64% (1.8680 => 2.0480, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.61% (1.4561 => 1.5961, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.55% (1.4241 => 1.5601, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.28% (1.1640 => 1.2720, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.20% (1.6521 => 1.8041, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.03% (1.8161 => 1.9801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0100) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.62% (1.4841 => 1.6121, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.5281 => 1.6561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.27% (1.5481 => 1.6761, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.66% (1.7761 => 1.9121, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.42% (1.0240 => 1.1000, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.20% (1.6121 => 1.7281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.04% (1.4201 => 1.5201, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.95% (1.7841 => 1.9081, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.90% (0.3480 => 0.3720, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (1.7400 => 1.8480, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (11.6440 => 12.3640, std.dev.: 0.0608) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.13% (1.4361 => 1.5241, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (1.4640 => 1.5520, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.57% (1.5801 => 1.6681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.53% (1.5201 => 1.6041, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (6.4680 => 6.8240, std.dev.: 0.0634) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.45% (1.4681 => 1.5481, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (5.8121 => 6.1121, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.05% (1.5841 => 1.6641, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.83% (1.7401 => 1.8241, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.68% (9.4842 => 9.9282, std.dev.: 0.0481) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.62% (0.2600 => 0.2720, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.8440 => 1.9280, std.dev.: 0.0258) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.54% (0.9681 => 1.0121, std.dev.: 0.0093) MultiSource/Applications/Burg/burg: 4.51% (1.5080 => 1.5760, std.dev.: 0.0227) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.0443 => 10.4843, std.dev.: 0.0293) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.02% (0.7960 => 0.8280, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0118) MultiSource/Applications/hbd/hbd: 3.92% (1.7360 => 1.8040, std.dev.: 0.0168) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 3.75% (21.9606 => 22.7848, std.dev.: 0.0443) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.72% (2.0440 => 2.1200, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0133) MultiSource/Applications/oggenc/oggenc: 3.67% (6.9844 => 7.2405, std.dev.: 0.0126) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.49% (50.0290 => 51.7770, std.dev.: 0.0959) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: 3.30% (18.4404 => 19.0485, std.dev.: 0.0270) MultiSource/Applications/lua/lua: 3.26% (4.7880 => 4.9440, std.dev.: 0.0221) MultiSource/Benchmarks/sim/sim: 3.19% (0.3760 => 0.3880, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.16% (1.7721 => 1.8281, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.06% (6.5440 => 6.7440, std.dev.: 0.0454) MultiSource/Benchmarks/MallocBench/gs/gs: 2.99% (5.3600 => 5.5200, std.dev.: 0.0496) MultiSource/Benchmarks/Bullet/bullet: 2.96% (38.4046 => 39.5406, std.dev.: 0.0820) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.77% (6.5080 => 6.6880, std.dev.: 0.0349) MultiSource/Applications/ClamAV/clamscan: 2.71% (19.0444 => 19.5604, std.dev.: 0.0358) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4560 => 0.4680, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 2.44% (19.6891 => 20.1691, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (1.0201 => 1.0441, std.dev.: 0.0076) MultiSource/Applications/d/make_dparser: 2.02% (3.9681 => 4.0481, std.dev.: 0.0164) MultiSource/Applications/SIBsim4/SIBsim4: 2.01% (1.7921 => 1.8281, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (16.3483 => 16.6363, std.dev.: 0.0567) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.28% (2.1401 => 2.4242, std.dev.: 0.0529) MultiSource/Applications/siod/siod: 9.93% (2.8602 => 3.1442, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.28% (3.4122 => 3.5242, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 2.34% (6.6684 => 6.8244, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0317) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.25% (8.1845 => 8.3685, std.dev.: 0.0091) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.70% (11.5087 => 11.7047, std.dev.: 0.0167) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.53% (8.1245 => 8.2485, std.dev.: 0.0280) MultiSource/Applications/sqlite3/sqlite3: 1.41% (3.9842 => 4.0403, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3841 => 1.4001, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.99% (10.6247 => 2.0201, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.00% (0.0640 => 0.0480, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.20% (91.8497 => 49.4151, std.dev.: 10.4857) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.34% (26.0616 => 17.1131, std.dev.: 0.1677) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.24% (50.3031 => 33.0781, std.dev.: 0.1944) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.07% (42.1466 => 28.6298, std.dev.: 0.5654) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1099) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0048) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -10.59% (0.3400 => 0.3040, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.05% (1.2481 => 1.1601, std.dev.: 0.0113) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (4.1243 => 4.0443, std.dev.: 0.0123) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0033) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 18:11:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 20:11:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140429011106.172092A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25104?compare_to=25088&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25104, Order: 207439, Start Time: 2014-04-28 20:35:19, End Time: 2014-04-29 01:17:53 To: 25088, Order: 207409, Start Time: 2014-04-28 10:55:02, End Time: 2014-04-28 15:37:26 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 11 (167 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ConditionalExpr: 75.00% (0.0160 => 0.0280, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 5.10% (0.6280 => 0.6600, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3600 => 0.3720, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.24% (12.2280 => 12.3800, std.dev.: 0.0285) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.74% (0.3560 => 0.3800, std.dev.: 0.0086) MultiSource/Benchmarks/llubenchmark/llu: 3.12% (5.2483 => 5.4123, std.dev.: 0.0538) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2337.50% (0.0320 => 0.7800, std.dev.: 0.0121) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0061) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0074) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 329.35% (0.2320 => 0.9961, std.dev.: 0.0087) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 203.17% (0.2520 => 0.7640, std.dev.: 0.0098) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: 100.00% (0.0200 => 0.0400, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0160 => 0.0320, std.dev.: 0.0061) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0061) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0062) SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 60.00% (0.0800 => 0.1280, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.84% (0.7040 => 1.0760, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0055) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) MultiSource/Applications/obsequi/Obsequi: 43.97% (1.3920 => 2.0040, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (1.2481 => 1.5441, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.08% (1.2481 => 1.5361, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 22.22% (0.1080 => 0.1320, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.76% (1.1561 => 1.3961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.33% (1.2001 => 1.4441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.07% (1.1761 => 1.4121, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.73% (1.1761 => 1.4081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.01% (1.1361 => 1.3521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.66% (1.1361 => 1.3481, std.dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: 18.65% (8.5802 => 10.1803, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.57% (1.2281 => 1.4561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.57% (1.1841 => 1.3921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.25% (1.3681 => 1.6041, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.28% (0.1720 => 0.2000, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.18% (1.3841 => 1.6081, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 14.88% (19.5406 => 22.4487, std.dev.: 0.0422) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0161) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.05% (5.3360 => 6.0321, std.dev.: 0.0437) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.7400 => 1.9600, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.79% (0.5560 => 0.6160, std.dev.: 0.0090) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 9.28% (11.3843 => 12.4403, std.dev.: 0.0472) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.26% (0.4320 => 0.4720, std.dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 8.97% (6.2844 => 6.8484, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.82% (0.1360 => 0.1480, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.33% (5.6680 => 6.1400, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.18% (11.4440 => 12.3800, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.02% (0.6480 => 0.7000, std.dev.: 0.0201) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.89% (0.1520 => 0.1640, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0085) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.54% (5.7280 => 6.1600, std.dev.: 0.0409) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.26% (9.5802 => 10.1802, std.dev.: 0.0466) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.7360 => 0.7760, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.00% (0.4800 => 0.5040, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.82% (0.3320 => 0.3480, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 4.44% (4.7720 => 4.9840, std.dev.: 0.0250) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.23% (1.3240 => 1.3800, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: 3.94% (5.3840 => 5.5960, std.dev.: 0.0492) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (6.8280 => 7.0960, std.dev.: 0.0284) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.77% (49.1529 => 51.0049, std.dev.: 0.0925) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.7600 => 1.8160, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0202) MultiSource/Benchmarks/PAQ8p/paq8p: 2.79% (2.7282 => 2.8042, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 2.55% (24.7575 => 25.3895, std.dev.: 0.0442) MultiSource/Applications/ClamAV/clamscan: 2.50% (19.2243 => 19.7043, std.dev.: 0.0744) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.6961 => 1.7361, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 2.23% (19.7491 => 20.1891, std.dev.: 0.0473) MultiSource/Benchmarks/Bullet/bullet: 1.88% (39.0726 => 39.8086, std.dev.: 0.0674) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 1.43% (18.7966 => 19.0645, std.dev.: 0.0274) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (29.3298 => 29.6419, std.dev.: 0.0397) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 17.75% (0.9241 => 1.0881, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.16% (1.2401 => 1.4281, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0156) MultiSource/Benchmarks/llubenchmark/llu: 5.70% (5.1203 => 5.4123, std.dev.: 0.0538) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0084) MultiSource/Applications/siod/siod: 3.75% (2.9842 => 3.0962, std.dev.: 0.0203) MultiSource/Applications/minisat/minisat: 3.64% (6.8204 => 7.0684, std.dev.: 0.0313) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.91% (1.1001 => 1.1321, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.3085 => 7.4925, std.dev.: 0.0495) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 1.76% (1.3601 => 1.3841, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (25.4536 => 25.8856, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0161) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.0563 => 4.1123, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.36% (3.2362 => 3.2802, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.23% (4.2403 => 4.2923, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -18.94% (8.9566 => 7.2605, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.42% (21.6534 => 17.8811, std.dev.: 0.0632) SingleSource/Benchmarks/Linpack/linpack-pc: -16.54% (7.8605 => 6.5604, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.52% (5.2763 => 4.9323, std.dev.: 0.0961) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.83% (2.9242 => 2.8122, std.dev.: 0.0052) MultiSource/Applications/aha/aha: -2.22% (2.8802 => 2.8162, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (5.0963 => 5.0163, std.dev.: 0.0177) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 18:12:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 20:12:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429011214.CB4E02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25105?compare_to=25102&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25105, Order: 207439, Start Time: 2014-04-28 20:38:27, End Time: 2014-04-29 01:19:01 To: 25102, Order: 207427, Start Time: 2014-04-28 18:12:14, End Time: 2014-04-28 22:53:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (103 on baseline) Performance Improvements: 1 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/pi: 150.00% (0.0080 => 0.0200, std.dev.: 0.0041) SingleSource/Regression/C++/EH/simple_rethrow: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/div: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2280 => 0.2520, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2400 => 0.2520, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.24% (0.8921 => 0.9121, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.9441 => 0.9641, std.dev.: 0.0070) MultiSource/Applications/Burg/burg: 1.62% (1.4840 => 1.5080, std.dev.: 0.0091) SingleSource/UnitTests/Vector/constpool: 1.19% (2.0161 => 2.0401, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 1.35% (0.8921 => 0.9041, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.09% (9.1326 => 9.2326, std.dev.: 0.0264) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -11.54% (0.1040 => 0.0920, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0151) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.36% (0.6520 => 0.7000, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.93% (1.2121 => 1.2961, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.67% (1.2601 => 1.3441, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0462) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (10.6960 => 11.3920, std.dev.: 0.0545) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0215) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0380) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0182) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0193) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.8000 => 5.9560, std.dev.: 0.0444) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0109) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.55% (48.1088 => 49.3369, std.dev.: 0.0506) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0507) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0304) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0241) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0308) MultiSource/Benchmarks/Bullet/bullet: 2.18% (37.0925 => 37.9006, std.dev.: 0.0828) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 1.89% (18.8170 => 19.1731, std.dev.: 0.0405) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0441) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.37% (1.6601 => 1.7161, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0274) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0224) MultiSource/Applications/lua/lua: 1.47% (21.1533 => 21.4653, std.dev.: 0.0852) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0643 => 4.1163, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.28% (10.8967 => 2.0401, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/mandel-text: -71.43% (0.0280 => 0.0080, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: -22.73% (0.1760 => 0.1360, std.dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: -3.19% (1.6321 => 1.5801, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -3.89% (2.6762 => 2.5722, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.81% (1.2601 => 1.2121, std.dev.: 0.0176) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.03% (1.1681 => 1.1561, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Mon Apr 28 18:22:23 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Mon, 28 Apr 2014 18:22:23 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429012235.4893D501CD12@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19352 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207477 Blamelist: benlangmuir Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Mon Apr 28 18:18:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 20:18:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140429011822.78D3B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25106?compare_to=25096&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25106, Order: 207439, Start Time: 2014-04-28 20:39:49, End Time: 2014-04-29 01:25:08 To: 25096, Order: 207422, Start Time: 2014-04-28 15:43:37, End Time: 2014-04-28 20:28:48 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 9 (134 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (940 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 11.11% (0.1080 => 0.1200, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.30% (0.1720 => 0.1880, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 5.48% (0.2920 => 0.3080, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.60% (2.0001 => 1.9681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.57% (2.0401 => 2.0081, std.dev.: 0.0116) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.96% (17.6723 => 19.6084, std.dev.: 0.0620) MultiSource/Applications/sqlite3/sqlite3: 1417.65% (1.7001 => 25.8016, std.dev.: 0.0442) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.43% (50.1010 => 51.8170, std.dev.: 0.1015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (1.0520 => 1.0840, std.dev.: 0.0365) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (11.3920 => 12.3600, std.dev.: 0.0650) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0076) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0363, std.dev.: 0.0514) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0108) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0080) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/2003-10-13-SwitchTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0062) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0035) SingleSource/Regression/C/sumarray2d: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 30.56% (0.1440 => 0.1880, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0480 => 0.0600, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.93% (0.1720 => 0.2080, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/rem: 16.13% (0.1240 => 0.1440, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.66% (1.8281 => 2.0961, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.60% (1.8081 => 2.0721, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.52% (0.2480 => 0.2840, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.38% (1.8361 => 2.1001, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.07% (1.8201 => 2.0761, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.61% (2.0281 => 2.3041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.59% (1.9721 => 2.2401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.36% (1.9161 => 2.1721, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.33% (1.8601 => 2.1081, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.30% (2.1361 => 2.4202, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.11% (1.8921 => 2.1401, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.55% (1.9121 => 2.1521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.50% (1.9521 => 2.1961, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.19% (2.1441 => 2.3841, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.84% (1.8081 => 2.0041, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.71% (0.3360 => 0.3720, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.61% (1.7721 => 1.9601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.42% (1.9201 => 2.1201, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.32% (1.9761 => 2.1801, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.19% (1.8441 => 2.0321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.08% (2.1041 => 2.3161, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.00% (1.8801 => 2.0681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.00% (1.8801 => 2.0681, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.86% (2.0681 => 2.2721, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.37% (1.8361 => 2.0081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.25% (1.8601 => 2.0321, std.dev.: 0.0140) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0186) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.62% (1.9481 => 2.1161, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.2240 => 0.2400, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (6.4800 => 6.9040, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.49% (0.3080 => 0.3280, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4640 => 0.4920, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.6960 => 1.7840, std.dev.: 0.0228) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0180) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.7721 => 1.8601, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (5.8281 => 6.0881, std.dev.: 0.0402) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 4.31% (0.4640 => 0.4840, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0190) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (10.2283 => 10.6444, std.dev.: 0.0285) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.00% (1.3000 => 1.3520, std.dev.: 0.0164) MultiSource/Applications/hbd/hbd: 3.94% (1.7280 => 1.7960, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4080 => 0.4240, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 3.86% (2.5880 => 2.6880, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (9.6042 => 9.9482, std.dev.: 0.0393) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (6.5320 => 6.7480, std.dev.: 0.0386) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 3.09% (4.7920 => 4.9400, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0173) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.74% (1.3160 => 1.3520, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (1.0840 => 1.1120, std.dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 2.55% (7.0524 => 7.2325, std.dev.: 0.0254) MultiSource/Applications/SPASS/SPASS: 2.53% (18.5284 => 18.9965, std.dev.: 0.0410) MultiSource/Benchmarks/MallocBench/gs/gs: 2.52% (5.3960 => 5.5320, std.dev.: 0.0361) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (16.3003 => 16.6963, std.dev.: 0.0498) MultiSource/Benchmarks/Bullet/bullet: 2.42% (38.6366 => 39.5726, std.dev.: 0.0609) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (3.0562 => 3.1282, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (6.5360 => 6.6880, std.dev.: 0.0423) MultiSource/Applications/SIBsim4/SIBsim4: 2.24% (1.7841 => 1.8241, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 2.11% (22.2206 => 22.6887, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 1.63% (19.8291 => 20.1531, std.dev.: 0.0353) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.23% (2.1201 => 2.4642, std.dev.: 0.0524) MultiSource/Applications/siod/siod: 9.78% (2.8642 => 3.1442, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 3.46% (6.5964 => 6.8244, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.95% (11.4967 => 11.7207, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.82% (3.7442 => 3.8122, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 1.43% (8.1285 => 8.2445, std.dev.: 0.0310) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (8.3605 => 8.4565, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.0243 => 5.0763, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.42% (10.4007 => 2.0361, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.91% (94.8339 => 49.3991, std.dev.: 9.9238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.82% (49.9431 => 33.0541, std.dev.: 0.1313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.67% (25.7136 => 17.0571, std.dev.: 0.1014) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.49% (37.0863 => 28.7458, std.dev.: 0.3720) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0050) SingleSource/Benchmarks/Linpack/linpack-pc: -14.89% (7.8165 => 6.6524, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.71% (2.7482 => 2.5362, std.dev.: 0.0650) MultiSource/Applications/aha/aha: -5.96% (2.7522 => 2.5882, std.dev.: 0.0348) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0050) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.50% (4.8043 => 4.7323, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 18:22:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 20:22:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429012223.54F022A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25107?compare_to=25097&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25107, Order: 207439, Start Time: 2014-04-28 20:42:44, End Time: 2014-04-29 01:29:08 To: 25097, Order: 207422, Start Time: 2014-04-28 15:45:34, End Time: 2014-04-28 20:31:49 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1096 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/globalrefs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Regression/C++/global_ctor: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 66.67% (0.0240 => 0.0400, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/dt: 18.75% (0.0640 => 0.0760, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Oscar: 15.79% (0.0760 => 0.0880, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 11.76% (0.1360 => 0.1520, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 9.52% (0.1680 => 0.1840, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.26% (0.3040 => 0.3200, std.dev.: 0.0051) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.36% (1.3760 => 1.4360, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.93% (1.3240 => 1.3760, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.61% (0.3320 => 0.3440, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 3.40% (4.1123 => 4.2523, std.dev.: 0.0253) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.13% (1.7681 => 1.7481, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 18:26:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 20:26:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140429012646.C40562A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25108?compare_to=25098&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25108, Order: 207440, Start Time: 2014-04-28 20:45:42, End Time: 2014-04-29 01:33:32 To: 25098, Order: 207422, Start Time: 2014-04-28 15:46:44, End Time: 2014-04-28 20:34:55 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (127 on baseline) Performance Improvements: 4 (35 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (947 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.29% (0.0840 => 0.0960, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.41% (1.1240 => 1.1960, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.14% (4.6723 => 4.7723, std.dev.: 0.0372) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-08-11-VaListArg: -40.00% (0.0400 => 0.0240, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -13.46% (0.2080 => 0.1800, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.78% (2.0281 => 1.9921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.21% (2.3201 => 2.2921, std.dev.: 0.0095) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 135.71% (0.2240 => 0.5280, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0069) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.52% (1.6961 => 2.0441, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.73% (1.7641 => 2.1121, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.62% (1.6921 => 2.0241, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.53% (1.7201 => 2.0561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.43% (1.6881 => 2.0161, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.31% (1.7401 => 2.0761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.26% (1.7441 => 2.0801, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.05% (1.6801 => 2.0001, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.00% (1.7681 => 2.1041, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.97% (1.7921 => 2.1321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.85% (1.6761 => 1.9921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 18.80% (1.8081 => 2.1481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.79% (1.9801 => 2.3521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.64% (1.8881 => 2.2401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.53% (1.7481 => 2.0721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.40% (1.8041 => 2.1361, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.8281 => 2.1641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.65% (1.8361 => 2.1601, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.39% (0.0920 => 0.1080, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.14% (1.8201 => 2.1321, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.80% (1.9761 => 2.3081, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.77% (1.9081 => 2.2281, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.70% (1.9641 => 2.2921, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/misr: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.03% (0.6120 => 0.7040, std.dev.: 0.0229) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.56% (0.2360 => 0.2680, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 8.63% (1.0200 => 1.1080, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: 7.14% (0.3920 => 0.4200, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.63% (3.5002 => 3.7322, std.dev.: 0.0468) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (6.7200 => 7.1640, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (11.7880 => 12.4840, std.dev.: 0.0505) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9920 => 1.0480, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 5.48% (1.6801 => 1.7721, std.dev.: 0.0127) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.7280 => 1.8080, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (9.9842 => 10.4322, std.dev.: 0.0424) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (1.6481 => 1.7201, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 4.28% (6.9124 => 7.2085, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (2.0680 => 2.1560, std.dev.: 0.0219) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.8201 => 1.8961, std.dev.: 0.0178) MultiSource/Applications/lua/lua: 3.92% (4.7920 => 4.9800, std.dev.: 0.0421) MultiSource/Applications/d/make_dparser: 3.63% (3.9641 => 4.1081, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (6.8321 => 7.0801, std.dev.: 0.0229) MultiSource/Applications/SPASS/SPASS: 3.31% (18.4924 => 19.1045, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.7400 => 0.7640, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0212) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0205) MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.1440 => 1.1800, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (2.0440 => 2.1080, std.dev.: 0.0230) MultiSource/Applications/JM/ldecod/ldecod: 3.10% (10.3203 => 10.6403, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: 2.67% (22.6287 => 23.2328, std.dev.: 0.0290) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.58% (51.1089 => 52.4289, std.dev.: 0.1369) MultiSource/Applications/kimwitu++/kc: 2.35% (19.7371 => 20.2011, std.dev.: 0.0642) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (2.2721 => 2.3241, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 2.17% (38.9366 => 39.7806, std.dev.: 0.0737) MultiSource/Applications/ClamAV/clamscan: 2.00% (20.2445 => 20.6485, std.dev.: 0.0798) MultiSource/Applications/sqlite3/sqlite3: 1.78% (25.1895 => 25.6376, std.dev.: 0.0443) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (16.5963 => 16.8883, std.dev.: 0.0629) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (4.2203 => 4.2923, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0210) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0123) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0155) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (4.2443 => 4.3443, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.42% (2.5322 => 2.5682, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.36% (4.1323 => 4.1883, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.3721 => 1.3881, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0923 => 4.1363, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.32% (6.2884 => 0.8600, std.dev.: 0.0146) SingleSource/UnitTests/Vector/constpool: -81.34% (10.9087 => 2.0361, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0093) SingleSource/UnitTests/2003-08-11-VaListArg: -40.00% (0.0400 => 0.0240, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: -25.79% (0.7600 => 0.5640, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0074) MultiSource/Applications/obsequi/Obsequi: -20.85% (2.6481 => 2.0960, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout/matrix: -18.75% (0.1280 => 0.1040, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.95% (7.4801 => 6.2120, std.dev.: 0.0623) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.31% (7.5041 => 6.2800, std.dev.: 0.0590) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0056) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -3.02% (13.5243 => 13.1163, std.dev.: 0.0335) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.20% (21.6534 => 17.9291, std.dev.: 0.0226) SingleSource/Benchmarks/Linpack/linpack-pc: -15.28% (7.8005 => 6.6084, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.36% (2.6082 => 2.3641, std.dev.: 0.0916) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -2.79% (5.1603 => 5.0163, std.dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0178) MultiSource/Applications/JM/lencod/lencod: -1.40% (8.3085 => 8.1925, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.34% (4.7603 => 4.6963, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 18:58:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 20:58:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429015829.C230D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25109?compare_to=25105&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25109, Order: 207446, Start Time: 2014-04-28 21:26:54, End Time: 2014-04-29 02:05:14 To: 25105, Order: 207439, Start Time: 2014-04-28 20:38:27, End Time: 2014-04-29 01:19:01 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (101 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0800 => 0.0960, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 4.57% (0.7000 => 0.7320, std.dev.: 0.0099) MultiSource/Applications/spiff/spiff: 3.64% (0.9880 => 1.0240, std.dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 2.03% (1.5801 => 1.6121, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lemon/lemon: 5.42% (0.9601 => 1.0121, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/ary3: 1.02% (3.5122 => 3.5482, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0174) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/em3d/em3d: 10.00% (0.2000 => 0.2200, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0548) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (6.0160 => 6.3560, std.dev.: 0.0626) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0101) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0226) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0444) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0411) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0204) MultiSource/Applications/spiff/spiff: 3.64% (0.9880 => 1.0240, std.dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (10.4082 => 10.7562, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.55% (5.8000 => 5.9480, std.dev.: 0.0323) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.32% (17.6165 => 18.0245, std.dev.: 0.0581) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.7120 => 0.7280, std.dev.: 0.0061) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.22% (48.1088 => 49.1770, std.dev.: 0.1027) MultiSource/Applications/sqlite3/sqlite3: 2.21% (23.7574 => 24.2815, std.dev.: 0.0358) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 2.18% (37.0925 => 37.9006, std.dev.: 0.0667) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 1.47% (18.8170 => 19.0930, std.dev.: 0.0483) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0186) MultiSource/Applications/SPASS/SPASS: 1.19% (17.5484 => 17.7564, std.dev.: 0.0463) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.45% (0.9321 => 1.1041, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.5040 => 0.5360, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (25.8896 => 26.7577, std.dev.: 0.0234) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 1.86% (6.6564 => 6.7804, std.dev.: 0.0198) MultiSource/Applications/lua/lua: 1.65% (21.1533 => 21.5013, std.dev.: 0.0946) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0016) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 19:50:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 21:50:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429025015.71D602A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25110?compare_to=25109&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25110, Order: 207448, Start Time: 2014-04-28 22:15:21, End Time: 2014-04-29 02:56:59 To: 25109, Order: 207446, Start Time: 2014-04-28 21:26:54, End Time: 2014-04-29 02:05:14 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (101 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 66.67% (0.0240 => 0.0400, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.33% (0.0480 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.77% (0.0520 => 0.0680, std.dev.: 0.0058) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.10% (0.3920 => 0.4120, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 4.88% (0.3280 => 0.3440, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.76% (0.2520 => 0.2640, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.59% (0.4360 => 0.4560, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.31% (1.5720 => 1.6240, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.06% (1.3601 => 1.3881, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.62% (1.2361 => 1.2561, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.28% (0.9361 => 0.9481, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.60% (0.1720 => 0.2040, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 1.45% (1.1041 => 1.1201, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0117) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.53% (0.3040 => 0.3360, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/sieve: 10.26% (0.3120 => 0.3440, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.12% (1.2721 => 1.3881, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (10.6960 => 11.5000, std.dev.: 0.0633) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.84% (1.5200 => 1.6240, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0483) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0437) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.40% (1.0920 => 1.1400, std.dev.: 0.0172) MultiSource/Applications/Burg/burg: 4.38% (1.4600 => 1.5240, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0312) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.49% (0.9161 => 0.9481, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0457) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0347) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.03% (1.1880 => 1.2240, std.dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0282) MultiSource/Benchmarks/Bullet/bullet: 2.65% (37.0925 => 38.0765, std.dev.: 0.0566) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.55% (48.1088 => 49.3369, std.dev.: 0.1065) MultiSource/Applications/JM/lencod/lencod: 2.52% (17.6165 => 18.0605, std.dev.: 0.0559) MultiSource/Applications/sqlite3/sqlite3: 2.37% (23.7574 => 24.3215, std.dev.: 0.0509) MultiSource/Applications/oggenc/oggenc: 1.93% (5.7964 => 5.9084, std.dev.: 0.0152) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 1.83% (18.8170 => 19.1611, std.dev.: 0.0418) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 1.23% (17.5484 => 17.7644, std.dev.: 0.0574) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (25.8896 => 26.7137, std.dev.: 0.0384) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0078) SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (14.0009 => 14.1529, std.dev.: 0.0490) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.70% (2.0561 => 1.9801, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0074) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.31% (0.8641 => 0.8441, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 20:29:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 22:29:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429032904.6F95C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25111?compare_to=25110&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25111, Order: 207453, Start Time: 2014-04-28 22:56:26, End Time: 2014-04-29 03:35:49 To: 25110, Order: 207448, Start Time: 2014-04-28 22:15:21, End Time: 2014-04-29 02:56:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 5 (97 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 200.00% (0.0080 => 0.0240, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 23.81% (0.0840 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.00% (0.0800 => 0.0960, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4520 => 0.4640, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.42% (0.8441 => 0.8561, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.11% (0.9481 => 0.9281, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: -1.29% (8.0762 => 7.9722, std.dev.: 0.0363) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0054) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/UnitTests/Vector/build2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.16% (0.3040 => 0.3440, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.09% (1.2361 => 1.3361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.42% (1.2401 => 1.3321, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.34% (1.1441 => 1.2281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.30% (1.2601 => 1.3521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0523) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0518) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0156) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0361) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0237) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0345) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0462) MultiSource/Applications/lua/lua: 3.36% (4.5200 => 4.6720, std.dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4520 => 0.4640, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 2.43% (17.6165 => 18.0445, std.dev.: 0.0346) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0541) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.09% (37.0925 => 37.8685, std.dev.: 0.0573) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.01% (48.1088 => 49.0768, std.dev.: 0.1044) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0239) MultiSource/Applications/JM/ldecod/ldecod: 1.48% (7.8562 => 7.9722, std.dev.: 0.0363) MultiSource/Applications/kimwitu++/kc: 1.13% (18.8170 => 19.0290, std.dev.: 0.0419) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0418) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (25.8896 => 26.6977, std.dev.: 0.0475) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 1.49% (21.1533 => 21.4693, std.dev.: 0.1068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0112) MultiSource/Applications/lambda-0_1_3/lambda: 1.12% (5.0123 => 5.0683, std.dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0065) SingleSource/Regression/C++/EH/function_try_block: -62.50% (0.0320 => 0.0120, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/mason/mason: -21.05% (0.0760 => 0.0600, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: -2.70% (1.6321 => 1.5881, std.dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 20:47:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Apr 2014 22:47:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429034721.860F72A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25112?compare_to=25111&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25112, Order: 207458, Start Time: 2014-04-28 23:14:16, End Time: 2014-04-29 03:54:06 To: 25111, Order: 207453, Start Time: 2014-04-28 22:56:26, End Time: 2014-04-29 03:35:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 15 (100 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-01-float_varg: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C/test_indvars: 133.33% (0.0120 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C/PR10189: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.41% (0.0680 => 0.0880, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0560 => 0.0680, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.18% (0.0880 => 0.1040, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.17% (0.2360 => 0.2600, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.76% (0.1640 => 0.1800, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.68% (0.3520 => 0.3720, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.00% (0.4000 => 0.4160, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.18% (5.8640 => 5.9920, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.95% (1.2281 => 1.2521, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 1.28% (4.6720 => 4.7320, std.dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.89% (0.9681 => 0.9961, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/hash: 1.03% (4.2603 => 4.3043, std.dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0036) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0207) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.57% (0.2800 => 0.3040, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.27% (1.1561 => 1.2401, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.12% (1.2361 => 1.3241, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.90% (0.3480 => 0.3720, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0707) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.60% (1.2121 => 1.2921, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.25% (1.2801 => 1.3601, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0522) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.3640 => 0.3800, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.74% (0.8561 => 0.8881, std.dev.: 0.0098) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.70% (1.1880 => 1.2320, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.31% (5.8000 => 5.9920, std.dev.: 0.0413) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (10.4082 => 10.7322, std.dev.: 0.0329) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (4.9200 => 5.0640, std.dev.: 0.0473) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0233) MultiSource/Applications/JM/lencod/lencod: 2.52% (17.6165 => 18.0605, std.dev.: 0.0507) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0137) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.40% (48.1088 => 49.2649, std.dev.: 0.0679) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 2.15% (37.0925 => 37.8885, std.dev.: 0.0477) MultiSource/Applications/sqlite3/sqlite3: 1.90% (23.7574 => 24.2095, std.dev.: 0.0521) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (7.8562 => 7.9922, std.dev.: 0.0390) MultiSource/Applications/kimwitu++/kc: 1.70% (18.8170 => 19.1371, std.dev.: 0.0336) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0161) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 1.57% (21.1533 => 21.4853, std.dev.: 0.0978) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0331) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0108) MultiSource/Applications/SIBsim4/SIBsim4: -2.21% (1.6321 => 1.5961, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0041) MultiSource/Applications/aha/aha: -3.89% (2.6762 => 2.5722, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 23:09:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 01:09:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429060950.11A1C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25113?compare_to=25112&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25113, Order: 207480, Start Time: 2014-04-29 01:36:17, End Time: 2014-04-29 06:16:34 To: 25112, Order: 207458, Start Time: 2014-04-28 23:14:16, End Time: 2014-04-29 03:54:06 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 19 (111 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (978 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 30.00% (0.0800 => 0.1040, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.73% (0.0880 => 0.1080, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.82% (0.1560 => 0.1760, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.33% (0.2400 => 0.2600, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 7.58% (0.2640 => 0.2840, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 5.75% (0.6960 => 0.7360, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2320 => 0.2440, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 4.94% (0.3240 => 0.3400, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.13% (1.5480 => 1.6120, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.70% (0.4320 => 0.4480, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.6120 => 0.6280, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.56% (0.4680 => 0.4800, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.8881 => 0.9081, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.86% (1.2921 => 1.3161, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (2.1721 => 2.1961, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (7.9922 => 8.0762, std.dev.: 0.0257) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.38% (2.3161 => 2.3481, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-LongShifts: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0053) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 16.22% (0.1480 => 0.1720, std.dev.: 0.0080) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.2600 => 0.2840, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0093) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.94% (1.2081 => 1.3161, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.74% (10.6960 => 11.5240, std.dev.: 0.0564) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.14% (0.2800 => 0.3000, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.6840 => 0.7160, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3800 => 1.4360, std.dev.: 0.0203) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.98% (8.1441 => 8.4681, std.dev.: 0.0562) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0183) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0359) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0455) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (7.8562 => 8.0762, std.dev.: 0.0257) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.8000 => 5.9560, std.dev.: 0.0482) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.56% (0.4680 => 0.4800, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 2.39% (37.0925 => 37.9806, std.dev.: 0.0608) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0443) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.15% (48.1088 => 49.1449, std.dev.: 0.0979) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.8322 => 2.8922, std.dev.: 0.0134) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1491, std.dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0175) MultiSource/Applications/SPASS/SPASS: 1.30% (17.5484 => 17.7764, std.dev.: 0.0489) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0194) MultiSource/Applications/obsequi/Obsequi: 2.13% (2.0681 => 2.1121, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.44% (6.6564 => 6.7524, std.dev.: 0.0274) MultiSource/Applications/lua/lua: 1.44% (21.1533 => 21.4573, std.dev.: 0.0638) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0031) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0449) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0175) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -4.90% (0.4080 => 0.3880, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0263) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.13% (1.2601 => 1.2081, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 23:10:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 01:10:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429061046.5F2AB2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25114?compare_to=25103&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25114, Order: 207478, Start Time: 2014-04-29 01:34:50, End Time: 2014-04-29 06:17:32 To: 25103, Order: 207439, Start Time: 2014-04-28 20:35:21, End Time: 2014-04-29 01:17:33 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 21 (164 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (919 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/Threads/tls: 250.00% (0.0080 => 0.0280, std.dev.: 0.0026) SingleSource/UnitTests/TestLoop: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/Vector/build: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.13% (0.1240 => 0.1440, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.27% (0.4400 => 0.4720, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.7280 => 0.7720, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/neural/neural: 5.88% (0.2040 => 0.2160, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 5.08% (0.2360 => 0.2480, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.4440 => 0.4640, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 3.42% (0.4680 => 0.4840, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3560 => 0.3680, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 1.59% (5.5200 => 5.6080, std.dev.: 0.0340) SingleSource/Benchmarks/Misc-C++/bigfib: 1.57% (0.7640 => 0.7760, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.07% (1.4921 => 1.5081, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 21.43% (0.1120 => 0.1360, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.20% (1.0001 => 1.0921, std.dev.: 0.0329) MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.19% (11.3687 => 3.0482, std.dev.: 0.0099) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0082) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4600 => 1.8401, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/hello: 300.00% (0.0040 => 0.0160, std.dev.: 0.0018) SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0024) SingleSource/UnitTests/2005-11-29-LongSwitch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_shift: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 20.00% (0.1200 => 0.1440, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 19.35% (0.1240 => 0.1480, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.86% (0.1120 => 0.1320, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.02% (1.0240 => 1.1880, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 15.00% (0.0800 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2920 => 0.3320, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.90% (0.6200 => 0.7000, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/05-eks/eks: 12.73% (0.6600 => 0.7440, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.35% (0.3240 => 0.3640, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 11.90% (0.3360 => 0.3760, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.36% (0.1760 => 0.1960, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.31% (1.1640 => 1.2840, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.11% (1.4241 => 1.5681, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.7040 => 0.7720, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.44% (1.6521 => 1.8081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.34% (1.4561 => 1.5921, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.04% (1.4601 => 1.5921, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.97% (1.5601 => 1.7001, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.93% (1.6121 => 1.7561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.82% (1.4961 => 1.6281, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.61% (1.4401 => 1.5641, std.dev.: 0.0160) MultiSource/Applications/obsequi/Obsequi: 8.57% (1.8680 => 2.0280, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.27% (1.5481 => 1.6761, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.25% (1.5521 => 1.6801, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2960 => 0.3200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.09% (1.4841 => 1.6041, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.96% (1.6081 => 1.7361, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 7.84% (0.2040 => 0.2200, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 7.54% (1.0080 => 1.0840, std.dev.: 0.0216) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: 7.44% (0.4840 => 0.5200, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.43% (1.7761 => 1.9081, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.28% (1.4841 => 1.5921, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.14% (0.2240 => 0.2400, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.07% (1.5281 => 1.6361, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3440 => 0.3680, std.dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.73% (1.7841 => 1.9041, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (6.4680 => 6.8960, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.35% (1.4481 => 1.5401, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4440 => 0.4720, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.20% (1.4201 => 1.5081, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (11.6440 => 12.3640, std.dev.: 0.0687) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.14% (0.4560 => 0.4840, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.71% (5.8121 => 6.1441, std.dev.: 0.0277) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (9.4842 => 10.0242, std.dev.: 0.0487) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.57% (1.4361 => 1.5161, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.57% (1.5801 => 1.6681, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.30% (1.5841 => 1.6681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.26% (1.5201 => 1.6001, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.5480 => 1.6200, std.dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (5.3600 => 5.6080, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.60% (1.7401 => 1.8201, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.58% (0.5240 => 0.5480, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 4.21% (21.9606 => 22.8848, std.dev.: 0.0377) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (2.0440 => 2.1280, std.dev.: 0.0181) MultiSource/Applications/JM/ldecod/ldecod: 4.10% (10.0443 => 10.4563, std.dev.: 0.0254) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.93% (50.0290 => 51.9970, std.dev.: 0.0886) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0176) MultiSource/Applications/lua/lua: 3.84% (4.7880 => 4.9720, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.77% (2.1240 => 2.2040, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0042) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.66% (1.3120 => 1.3600, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.7721 => 1.8361, std.dev.: 0.0212) MultiSource/Benchmarks/Bullet/bullet: 3.60% (38.4046 => 39.7886, std.dev.: 0.0792) MultiSource/Applications/oggenc/oggenc: 3.44% (6.9844 => 7.2245, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4720 => 0.4880, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.20% (6.5080 => 6.7160, std.dev.: 0.0479) MultiSource/Applications/treecc/treecc: 2.94% (2.5840 => 2.6600, std.dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (4.1843 => 4.3043, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 2.71% (19.0444 => 19.5604, std.dev.: 0.0437) MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (1.7921 => 1.8401, std.dev.: 0.0130) MultiSource/Applications/SPASS/SPASS: 2.65% (18.4404 => 18.9286, std.dev.: 0.0724) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (16.3483 => 16.7483, std.dev.: 0.0478) MultiSource/Applications/kimwitu++/kc: 2.38% (19.6891 => 20.1571, std.dev.: 0.0522) MultiSource/Applications/siod/siod: 2.21% (2.7162 => 2.7762, std.dev.: 0.0192) MultiSource/Applications/d/make_dparser: 2.12% (3.9681 => 4.0521, std.dev.: 0.0248) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.31% (6.1044 => 6.1844, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0331) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.96% (2.1401 => 2.3961, std.dev.: 0.0490) MultiSource/Applications/siod/siod: 9.79% (2.8602 => 3.1402, std.dev.: 0.0306) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.03% (1.5921 => 1.6881, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 5.19% (17.5011 => 18.4092, std.dev.: 0.1870) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.31% (1.0881 => 1.1241, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/salsa20: 3.23% (7.4205 => 7.6605, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 2.40% (6.6684 => 6.8284, std.dev.: 0.0419) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (3.9922 => 4.0803, std.dev.: 0.0249) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.20% (8.1845 => 8.3645, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 1.74% (11.5087 => 11.7087, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 1.71% (3.9842 => 4.0523, std.dev.: 0.0223) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bisort/bisort: 1.62% (0.7400 => 0.7520, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.99% (10.6247 => 2.0201, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5641 => 1.0401, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.27% (91.8497 => 49.3551, std.dev.: 10.1409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.85% (50.3031 => 32.7700, std.dev.: 0.2445) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.49% (26.0616 => 17.0731, std.dev.: 0.1030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.47% (42.1466 => 28.8818, std.dev.: 0.4773) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.91% (3.1122 => 2.3681, std.dev.: 0.1066) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0147) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: -2.38% (2.3561 => 2.3001, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (4.1243 => 4.0443, std.dev.: 0.0127) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.1563 => 5.1003, std.dev.: 0.0152) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 23:10:59 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 01:10:59 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140429061059.5886E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25115?compare_to=25104&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25115, Order: 207478, Start Time: 2014-04-29 01:35:04, End Time: 2014-04-29 06:17:47 To: 25104, Order: 207439, Start Time: 2014-04-28 20:35:19, End Time: 2014-04-29 01:17:53 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 13 (161 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (930 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR10189: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.04% (0.0920 => 0.1040, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 12.50% (0.1280 => 0.1440, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.68% (0.2480 => 0.2720, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 6.76% (0.2960 => 0.3160, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hello: 5.66% (0.2120 => 0.2240, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.4360 => 1.4760, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.24% (1.6081 => 1.6281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.10% (1.4561 => 1.4721, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.84% (1.0881 => 1.1081, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.57% (2.8042 => 2.7602, std.dev.: 0.0151) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2387.50% (0.0320 => 0.7960, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/Puzzle: 1203.31% (0.1240 => 1.6161, std.dev.: 0.0060) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0100) SingleSource/UnitTests/SignlessTypes/cast-bug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0107) SingleSource/UnitTests/Vector/multiplies: 242.86% (0.0280 => 0.0960, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 196.83% (0.2520 => 0.7480, std.dev.: 0.0158) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0043) SingleSource/UnitTests/2002-08-19-CodegenBug: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0044) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-3: 71.43% (0.0280 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0070) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0065) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.70% (0.7040 => 1.0680, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: 43.97% (1.3920 => 2.0040, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 31.58% (0.0760 => 0.1000, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.77% (0.1040 => 0.1360, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.63% (1.2160 => 1.5641, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 23.70% (1.2321 => 1.5241, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.75% (1.2481 => 1.5321, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 22.34% (0.3760 => 0.4600, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.33% (1.2001 => 1.4561, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 21.05% (1.2161 => 1.4721, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.94% (1.1841 => 1.4321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.75% (1.1761 => 1.4201, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/puzzle: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.58% (1.1441 => 1.3681, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.43% (1.1321 => 1.3521, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.11% (1.1721 => 1.3961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 18.56% (8.5802 => 10.1723, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.52% (0.1080 => 0.1280, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.24% (1.1841 => 1.4001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.24% (1.2281 => 1.4521, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.18% (0.0880 => 0.1040, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.84% (1.1881 => 1.4001, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.67% (1.2001 => 1.4121, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1320 => 0.1520, std.dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 14.96% (19.5406 => 22.4647, std.dev.: 0.0480) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.84% (5.3360 => 6.1281, std.dev.: 0.0419) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 14.29% (0.4480 => 0.5120, std.dev.: 0.0102) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.3521 => 1.5401, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.10% (1.7400 => 1.9680, std.dev.: 0.0160) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.2840 => 0.3160, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.18% (0.6800 => 0.7560, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.71% (0.3360 => 0.3720, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 9.45% (11.3843 => 12.4603, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.26% (0.6480 => 0.7080, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.24% (5.6680 => 6.1920, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/methcall: 8.77% (0.2280 => 0.2480, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 8.53% (6.2844 => 6.8204, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.25% (11.4440 => 12.3880, std.dev.: 0.0458) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.2520 => 0.2720, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.47% (5.7280 => 6.1560, std.dev.: 0.0529) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.94% (0.9800 => 1.0480, std.dev.: 0.0154) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.85% (9.5802 => 10.2362, std.dev.: 0.0368) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.56% (0.2440 => 0.2600, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.7360 => 0.7840, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.8721 => 0.9201, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 4.78% (4.7720 => 5.0000, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/football/football: 4.49% (1.0680 => 1.1160, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.4760 => 1.5400, std.dev.: 0.0241) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.28% (6.8280 => 7.1200, std.dev.: 0.0313) MultiSource/Benchmarks/MallocBench/gs/gs: 4.09% (5.3840 => 5.6040, std.dev.: 0.0574) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.61% (49.1529 => 50.9249, std.dev.: 0.1032) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.4320 => 1.4760, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0118) MultiSource/Applications/ClamAV/clamscan: 2.46% (19.2243 => 19.6964, std.dev.: 0.0628) MultiSource/Applications/sqlite3/sqlite3: 2.34% (24.7575 => 25.3375, std.dev.: 0.0595) MultiSource/Benchmarks/Bullet/bullet: 2.16% (39.0726 => 39.9166, std.dev.: 0.0749) MultiSource/Applications/kimwitu++/kc: 1.90% (19.7491 => 20.1251, std.dev.: 0.0510) MultiSource/Applications/treecc/treecc: 1.66% (2.6480 => 2.6920, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.46% (6.0124 => 6.1004, std.dev.: 0.0145) MultiSource/Applications/SPASS/SPASS: 1.38% (18.7966 => 19.0566, std.dev.: 0.0330) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.08% (29.3298 => 29.6459, std.dev.: 0.0471) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.44% (3.9842 => 4.3203, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.1880 => 0.2000, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 3.89% (2.9842 => 3.1002, std.dev.: 0.0159) SingleSource/Benchmarks/McGill/queens: 3.67% (2.1801 => 2.2601, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 3.64% (6.8204 => 7.0684, std.dev.: 0.0490) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.1001 => 1.1401, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0332) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (25.4536 => 25.8776, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0200 => 0.0000, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -81.56% (11.0207 => 2.0321, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -18.94% (8.9566 => 7.2605, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.27% (21.6534 => 17.9131, std.dev.: 0.0324) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0904) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.24% (2.5482 => 2.4402, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.0963 => 5.0363, std.dev.: 0.0163) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0127) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 23:21:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 01:21:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140429062156.83D142A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25116?compare_to=25106&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25116, Order: 207480, Start Time: 2014-04-29 01:43:01, End Time: 2014-04-29 06:28:39 To: 25106, Order: 207439, Start Time: 2014-04-28 20:39:49, End Time: 2014-04-29 01:25:08 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 21 (135 on baseline) Performance Improvements: 1 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1090 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/byval-alignment: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ackermann: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.36% (0.0440 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 33.33% (0.0480 => 0.0640, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 18.75% (0.0640 => 0.0760, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: 9.68% (0.1240 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.14% (0.1680 => 0.1800, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: 6.00% (0.2000 => 0.2120, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.5600 => 1.6240, std.dev.: 0.0205) MultiSource/Applications/hexxagon/hexxagon: 3.10% (1.1600 => 1.1960, std.dev.: 0.0131) MultiSource/Applications/Burg/burg: 3.07% (1.5640 => 1.6120, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops: 2.46% (0.4880 => 0.5000, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.32% (2.1161 => 2.1441, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 27.27% (0.0440 => 0.0560, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.53% (0.3400 => 0.3520, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: -80.00% (0.0200 => 0.0040, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.77% (17.6723 => 19.5764, std.dev.: 0.0630) MultiSource/Applications/sqlite3/sqlite3: 1417.18% (1.7001 => 25.7936, std.dev.: 0.0388) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.42% (50.1010 => 51.8130, std.dev.: 0.1233) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (1.0520 => 1.1120, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.88% (11.3920 => 12.4040, std.dev.: 0.0638) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0146) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0283, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3641, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0085) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0112) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-6: 44.44% (0.0360 => 0.0520, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.44% (1.8561 => 2.1241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.38% (1.8081 => 2.0681, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.98% (1.8601 => 2.1201, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.94% (1.8361 => 2.0921, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.63% (1.8201 => 2.0681, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.60% (1.9121 => 2.1721, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.59% (1.9721 => 2.2401, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.57% (1.9161 => 2.1761, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.47% (1.9601 => 2.2241, std.dev.: 0.0127) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.4160 => 0.4720, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.30% (2.1361 => 2.4202, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.21% (2.0281 => 2.2961, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/power/power: 12.77% (0.1880 => 0.2120, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.58% (0.6360 => 0.7160, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.31% (2.1121 => 2.3721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.29% (1.9521 => 2.1921, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.94% (2.1441 => 2.4001, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.76% (1.0880 => 1.2160, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.13% (1.9761 => 2.1961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.06% (1.8081 => 2.0081, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.83% (1.7721 => 1.9641, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.55% (1.8201 => 2.0121, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.25% (2.0681 => 2.2801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.80% (1.7961 => 1.9721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.79% (1.8801 => 2.0641, std.dev.: 0.0149) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/rem: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.55% (2.0521 => 2.2481, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.57% (0.1400 => 0.1520, std.dev.: 0.0043) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.57% (0.7400 => 0.7960, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.67% (0.1800 => 0.1920, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (6.4800 => 6.9000, std.dev.: 0.0405) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0180) MultiSource/Applications/spiff/spiff: 6.30% (1.0160 => 1.0800, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.86% (0.8881 => 0.9401, std.dev.: 0.0085) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: 5.65% (1.1320 => 1.1960, std.dev.: 0.0131) MultiSource/Applications/Burg/burg: 5.50% (1.5280 => 1.6120, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0301) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.25% (2.9721 => 3.1282, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0080) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.81% (1.7480 => 1.8320, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/sieve: 4.76% (0.3360 => 0.3520, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.2283 => 10.6484, std.dev.: 0.0325) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0159) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.00% (9.6042 => 9.9882, std.dev.: 0.0532) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (5.8281 => 6.0521, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.84% (1.5640 => 1.6240, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (6.5320 => 6.7600, std.dev.: 0.0284) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (5.3960 => 5.5760, std.dev.: 0.0416) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (2.3401 => 2.4162, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 2.75% (4.7920 => 4.9240, std.dev.: 0.0419) MultiSource/Applications/oggenc/oggenc: 2.67% (7.0524 => 7.2405, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (16.3003 => 16.7323, std.dev.: 0.0504) MultiSource/Benchmarks/Bullet/bullet: 2.57% (38.6366 => 39.6286, std.dev.: 0.0728) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (3.0562 => 3.1322, std.dev.: 0.0160) MultiSource/Applications/SPASS/SPASS: 2.42% (18.5284 => 18.9764, std.dev.: 0.0607) MultiSource/Applications/JM/lencod/lencod: 2.30% (22.2206 => 22.7327, std.dev.: 0.0556) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (6.5360 => 6.6840, std.dev.: 0.0542) MultiSource/Applications/SIBsim4/SIBsim4: 2.02% (1.7841 => 1.8201, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0121) MultiSource/Applications/kimwitu++/kc: 1.73% (19.8291 => 20.1731, std.dev.: 0.0317) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.29% (2.1201 => 2.4442, std.dev.: 0.0682) MultiSource/Applications/siod/siod: 9.78% (2.8642 => 3.1442, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 3.80% (7.3725 => 7.6525, std.dev.: 0.0344) MultiSource/Applications/minisat/minisat: 3.58% (6.5964 => 6.8324, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.98% (11.4967 => 11.7247, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 1.40% (1.4241 => 1.4441, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.33% (8.1285 => 8.2365, std.dev.: 0.0183) SingleSource/Benchmarks/McGill/queens: 1.27% (2.1961 => 2.2241, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.3801 => 1.3961, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (8.3605 => 8.4565, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.0243 => 5.0763, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.50% (10.4007 => 2.0281, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -34.25% (1.5881 => 1.0441, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.22% (94.8339 => 49.1031, std.dev.: 10.6349) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.86% (49.9431 => 33.0301, std.dev.: 0.1188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.71% (25.7136 => 17.0451, std.dev.: 0.0917) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.36% (37.0863 => 28.4218, std.dev.: 0.3727) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.20% (1.2681 => 1.1641, std.dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0089) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0055) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.71% (5.6124 => 5.5163, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.67% (4.8043 => 4.7243, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.1563 => 5.0963, std.dev.: 0.0145) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 23:26:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 01:26:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429062601.A416E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25117?compare_to=25107&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25117, Order: 207480, Start Time: 2014-04-29 01:46:18, End Time: 2014-04-29 06:32:48 To: 25107, Order: 207439, Start Time: 2014-04-28 20:42:44, End Time: 2014-04-29 01:29:08 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1098 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-04-20-LoopBug2: 200.00% (0.0080 => 0.0240, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2480 => 0.2640, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.62% (0.3560 => 0.3760, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/objinst: 4.84% (0.2480 => 0.2600, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.39% (1.1720 => 1.2000, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.42% (1.6921 => 1.7161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (1.8601 => 1.8841, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.32% (28.5618 => 29.2258, std.dev.: 0.2432) SingleSource/Benchmarks/Shootout/hash: 1.51% (4.2403 => 4.3043, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.39% (0.8641 => 0.8761, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -3.76% (4.2523 => 4.0923, std.dev.: 0.0177) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -25.27% (0.7280 => 0.5440, std.dev.: 0.0125) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 23:31:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 01:31:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140429063157.53C9A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25118?compare_to=25108&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25118, Order: 207482, Start Time: 2014-04-29 01:50:41, End Time: 2014-04-29 06:38:43 To: 25108, Order: 207440, Start Time: 2014-04-28 20:45:42, End Time: 2014-04-29 01:33:32 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (138 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 37.50% (0.0320 => 0.0440, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0760 => 0.0960, std.dev.: 0.0078) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.43% (0.8080 => 0.8680, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.94% (0.8080 => 0.8560, std.dev.: 0.0142) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.41% (0.6640 => 0.6800, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.56% (1.0241 => 1.0401, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.31% (2.1321 => 2.1601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.31% (2.1321 => 2.1601, std.dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0049) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/strcat: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/heapsort: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.61% (1.7081 => 2.0601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.53% (1.7921 => 2.1601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.13% (1.7681 => 2.1241, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.81% (1.6761 => 2.0081, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.57% (1.6961 => 2.0281, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.31% (1.7401 => 2.0761, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.30% (1.7201 => 2.0521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.26% (1.7441 => 2.0801, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 18.99% (1.7481 => 2.0801, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.68% (1.8201 => 2.1601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.68% (1.6921 => 2.0081, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.11% (1.9881 => 2.3481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.94% (1.8281 => 2.1561, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.82% (1.9081 => 2.2481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.31% (1.9641 => 2.3041, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.00% (1.9761 => 2.3121, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.73% (1.9601 => 2.2881, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.36% (1.9801 => 2.3041, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.81% (0.1080 => 0.1240, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.73% (0.6120 => 0.6960, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) SingleSource/Regression/C/sumarraymalloc: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2280 => 0.2520, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 9.18% (0.7840 => 0.8560, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 7.84% (1.0200 => 1.1000, std.dev.: 0.0173) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.90% (0.8120 => 0.8680, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.7200 => 7.1800, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (11.7880 => 12.5680, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5560 => 0.5920, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (2.0680 => 2.1960, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.7280 => 1.8320, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.64% (0.7800 => 0.8240, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash2: 5.60% (0.5000 => 0.5280, std.dev.: 0.0088) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.59% (0.6440 => 0.6800, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3000 => 0.3160, std.dev.: 0.0055) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.04% (1.3480 => 1.4160, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0129) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.55% (0.4400 => 0.4600, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (9.9842 => 10.4322, std.dev.: 0.0471) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0150) MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0175) MultiSource/Applications/d/make_dparser: 3.94% (3.9641 => 4.1201, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.1440 => 1.1880, std.dev.: 0.0155) MultiSource/Applications/lua/lua: 3.84% (4.7920 => 4.9760, std.dev.: 0.0324) MultiSource/Applications/oggenc/oggenc: 3.76% (6.9124 => 7.1724, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (2.0440 => 2.1160, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (6.8321 => 7.0721, std.dev.: 0.0360) MultiSource/Applications/JM/ldecod/ldecod: 3.41% (10.3203 => 10.6723, std.dev.: 0.0220) MultiSource/Applications/Burg/burg: 3.33% (1.5600 => 1.6120, std.dev.: 0.0175) MultiSource/Applications/minisat/minisat: 3.27% (0.8560 => 0.8840, std.dev.: 0.0069) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.21% (1.3720 => 1.4160, std.dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: 3.16% (18.4924 => 19.0765, std.dev.: 0.0624) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.93% (51.1089 => 52.6049, std.dev.: 0.0546) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: 2.75% (2.6200 => 2.6920, std.dev.: 0.0231) MultiSource/Applications/kimwitu++/kc: 2.61% (19.7371 => 20.2531, std.dev.: 0.0445) MultiSource/Applications/JM/lencod/lencod: 2.42% (22.6287 => 23.1768, std.dev.: 0.0801) MultiSource/Benchmarks/Bullet/bullet: 2.35% (38.9366 => 39.8526, std.dev.: 0.1235) MultiSource/Applications/ClamAV/clamscan: 2.33% (20.2445 => 20.7165, std.dev.: 0.0682) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.93% (1.0361 => 1.0561, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.0244 => 6.1364, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.71% (16.5963 => 16.8803, std.dev.: 0.0437) MultiSource/Applications/sqlite3/sqlite3: 1.65% (25.1895 => 25.6056, std.dev.: 0.0307) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0092) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (4.2203 => 4.2843, std.dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.62% (1.2681 => 1.4281, std.dev.: 0.0171) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0267) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.56% (3.4842 => 3.6082, std.dev.: 0.0364) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (4.2443 => 4.3243, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.73% (5.0963 => 5.1843, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.39% (4.0203 => 4.0763, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/matrix: 1.38% (3.4682 => 3.5162, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.36% (4.1323 => 4.1883, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.64% (6.2884 => 0.8400, std.dev.: 0.0146) SingleSource/UnitTests/Vector/constpool: -81.30% (10.9087 => 2.0401, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0051) MultiSource/Applications/obsequi/Obsequi: -21.76% (2.6481 => 2.0720, std.dev.: 0.0283) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.53% (7.4801 => 6.2440, std.dev.: 0.0652) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.73% (7.5041 => 6.3240, std.dev.: 0.0360) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: -3.14% (13.5243 => 13.1003, std.dev.: 0.0406) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0055) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.33% (21.6534 => 17.9011, std.dev.: 0.0556) SingleSource/Benchmarks/Linpack/linpack-pc: -15.28% (7.8005 => 6.6084, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.82% (2.6082 => 2.3521, std.dev.: 0.0907) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0068) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.16% (5.8884 => 5.5843, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9202 => 2.8162, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -3.49% (5.1603 => 4.9803, std.dev.: 0.0248) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.11% (3.8002 => 3.7202, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: -1.78% (8.3085 => 8.1605, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.41% (1.7041 => 1.6801, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: -1.04% (4.9883 => 4.9363, std.dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Apr 28 23:53:22 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 01:53:22 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429065322.CE9312A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25119?compare_to=25113&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25119, Order: 207485, Start Time: 2014-04-29 02:21:48, End Time: 2014-04-29 07:00:06 To: 25113, Order: 207480, Start Time: 2014-04-29 01:36:17, End Time: 2014-04-29 06:16:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (104 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/divides: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/Vector/sumarray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 13.04% (0.1840 => 0.2080, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.60% (1.2481 => 1.2681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.29% (1.2361 => 1.2521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.19% (1.3401 => 1.3561, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.28% (0.1720 => 0.2000, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.65% (1.2081 => 1.2401, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.49% (6.2724 => 6.4284, std.dev.: 0.0494) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.73% (1.3841 => 1.4081, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/ary3: 1.14% (3.5082 => 3.5482, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: 1.05% (3.4362 => 3.4722, std.dev.: 0.0135) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0041) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: 10.13% (0.3160 => 0.3480, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.20% (1.2201 => 1.3201, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (10.6960 => 11.5120, std.dev.: 0.0586) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.49% (1.2281 => 1.3201, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.05% (1.2481 => 1.3361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2320 => 0.2440, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2480 => 0.2600, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0160) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (8.1441 => 8.5161, std.dev.: 0.0545) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0239) MultiSource/Applications/spiff/spiff: 3.64% (0.9880 => 1.0240, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0389) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (4.9200 => 5.0840, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.05% (1.9640 => 2.0240, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0297) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0469) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (5.8000 => 5.9440, std.dev.: 0.0426) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.43% (48.1088 => 49.2770, std.dev.: 0.0924) MultiSource/Benchmarks/Bullet/bullet: 2.37% (37.0925 => 37.9725, std.dev.: 0.0614) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0359) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0232) MultiSource/Applications/siod/siod: 1.71% (2.5721 => 2.6161, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 1.55% (18.8170 => 19.1091, std.dev.: 0.0302) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (5.8400 => 5.9280, std.dev.: 0.0318) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0183) MultiSource/Applications/SPASS/SPASS: 1.05% (17.5484 => 17.7324, std.dev.: 0.0412) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0215) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.76% (1.0921 => 1.1441, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0229) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0643 => 4.1163, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -44.44% (0.0360 => 0.0200, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -16.67% (0.1200 => 0.1000, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0461) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 00:50:23 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 02:50:23 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429075023.9DF272A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25120?compare_to=25119&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25120, Order: 207489, Start Time: 2014-04-29 03:16:44, End Time: 2014-04-29 07:57:08 To: 25119, Order: 207485, Start Time: 2014-04-29 02:21:48, End Time: 2014-04-29 07:00:06 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (102 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-05-13-SDivTwo: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 66.67% (0.0240 => 0.0400, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.77% (0.2280 => 0.2480, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: 3.49% (2.4080 => 2.4920, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.51% (1.3241 => 1.3441, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 20.00% (0.0600 => 0.0720, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0092) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0400) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0486) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0200) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0300) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0189) MultiSource/Applications/hexxagon/hexxagon: 3.20% (1.1240 => 1.1600, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0308) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0498) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0325) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (5.8000 => 5.9440, std.dev.: 0.0423) MultiSource/Applications/sqlite3/sqlite3: 2.22% (23.7574 => 24.2855, std.dev.: 0.0389) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.07% (48.1088 => 49.1049, std.dev.: 0.0975) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0240) MultiSource/Benchmarks/Bullet/bullet: 2.03% (37.0925 => 37.8446, std.dev.: 0.0774) MultiSource/Applications/treecc/treecc: 1.80% (2.4480 => 2.4920, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 1.36% (18.8170 => 19.0730, std.dev.: 0.0500) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 66.67% (0.0240 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 1.65% (21.1533 => 21.5013, std.dev.: 0.0915) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0369) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0066) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0352) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0147) MultiSource/Applications/SIBsim4/SIBsim4: -1.72% (1.6321 => 1.6041, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -13.06% (7.7485 => 6.7364, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0053) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/power/power: -1.49% (1.3401 => 1.3201, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 01:53:11 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 01:53:11 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429085327.F2B7A5020936@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19362 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207511 Blamelist: chapuni,ctopper,haoliu,majnemer,mzolotukhin BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 03:27:53 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 03:27:53 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429102809.E51395021713@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19366 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207516 Blamelist: d0k,zinovy.nis BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 03:48:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 03:48:46 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140429104903.2E5415021A21@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19367 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207518 Blamelist: tnorthover BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: Files: lib/Target/ARM/ARMAsmPrinter.cpp test/CodeGen/ARM/indirect-hidden.ll On: http://10.1.1.2/svn/llvm-project For: llvm At: Tue 29 Apr 2014 03:15:33 Changed By: tnorthover Comments: ARM: emit hidden stubs into a proper non_lazy_symbol_pointer section. rdar://problem/16660411Properties: Files: lib/Target/X86/X86AsmPrinter.cpp test/CodeGen/X86/indirect-hidden.ll On: http://10.1.1.2/svn/llvm-project For: llvm At: Tue 29 Apr 2014 03:15:34 Changed By: tnorthover Comments: X86: emit hidden stubs into a proper non_lazy_symbol_pointer section. rdar://problem/16660411Properties: LOGS: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 03:47:29 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 03:47:29 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140429104903.92FD95021A22@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14930 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207518 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17859 of 17860) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17860 of 17860) 1 warning(s) in tests. Testing Time: 509.34s ******************** Failing Tests (1): LLVM :: CodeGen/ARM/available_externally.ll Expected Passes : 17710 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::available_externally.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/ARM/available_externally.ll:14:15: error: expected string not found in input ; CHECK-NEXT: .long _A ^ :37:2: note: scanning from here .indirect_symbol _A ^ :38:2: note: possible intended match here .long 0 ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 03:47:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 03:47:30 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140429104903.ABE7D5021A23@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/14930 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207518 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17859 of 17860) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17860 of 17860) 1 warning(s) in tests. Testing Time: 509.34s ******************** Failing Tests (1): LLVM :: CodeGen/ARM/available_externally.ll Expected Passes : 17710 Expected Failures : 106 Unsupported Tests : 43 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::available_externally.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/ARM/available_externally.ll:14:15: error: expected string not found in input ; CHECK-NEXT: .long _A ^ :37:2: note: scanning from here .indirect_symbol _A ^ :38:2: note: possible intended match here .long 0 ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 03:48:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 03:48:46 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140429104903.AC96E5021A24@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19367 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207518 Blamelist: tnorthover BUILD FAILED: failed sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 04:03:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 06:03:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140429110306.B566E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25121?compare_to=25115&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25121, Order: 207489, Start Time: 2014-04-29 06:27:37, End Time: 2014-04-29 11:09:47 To: 25115, Order: 207478, Start Time: 2014-04-29 01:35:04, End Time: 2014-04-29 06:17:47 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 9 (160 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (930 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-ManyArguments: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: 14.29% (0.0840 => 0.0960, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 9.68% (0.1240 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.30% (0.3720 => 0.3880, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.79% (1.7880 => 1.8200, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.31% (1.5321 => 1.5521, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/BuiltinTypeInfo: -66.67% (0.0240 => 0.0080, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2412.81% (0.0320 => 0.8041, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0094) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0127) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 196.83% (0.2520 => 0.7480, std.dev.: 0.0108) SingleSource/Regression/C++/EH/simple_throw: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0070) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0036) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0044) SingleSource/Regression/C/bigstack: 84.62% (0.0520 => 0.0960, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-3: 71.43% (0.0280 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 65.00% (0.0800 => 0.1320, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0198) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0106) MultiSource/Benchmarks/NPB-serial/is/is: 27.78% (0.0720 => 0.0920, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.16% (1.2401 => 1.5521, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.40% (1.2481 => 1.5401, std.dev.: 0.0146) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (1.1761 => 1.4401, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.75% (1.1401 => 1.3881, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.43% (1.1761 => 1.4281, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.05% (0.1520 => 0.1840, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.74% (1.2161 => 1.4561, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.45% (1.1721 => 1.4001, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.26% (1.1841 => 1.4121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.22% (1.2281 => 1.4641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.19% (1.1881 => 1.4161, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: 19.15% (0.3760 => 0.4480, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.83% (1.2321 => 1.4641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.77% (1.1721 => 1.3921, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.21% (1.2521 => 1.4801, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.13% (1.3681 => 1.6161, std.dev.: 0.0157) MultiSource/Applications/JM/ldecod/ldecod: 18.04% (8.5802 => 10.1283, std.dev.: 0.0510) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 17.96% (1.1361 => 1.3401, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.13% (1.2841 => 1.5041, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.76% (1.3841 => 1.6161, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/distray/distray: 16.67% (0.1200 => 0.1400, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 14.96% (19.5406 => 22.4647, std.dev.: 0.0499) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.02% (5.3360 => 6.0841, std.dev.: 0.0415) MultiSource/Benchmarks/nbench/nbench: 13.61% (1.3521 => 1.5361, std.dev.: 0.0166) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.76% (0.1360 => 0.1520, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.7400 => 1.9440, std.dev.: 0.0246) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0074) MultiSource/Applications/viterbi/viterbi: 9.43% (0.2120 => 0.2320, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 8.92% (11.3843 => 12.4003, std.dev.: 0.0293) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 8.72% (6.2844 => 6.8324, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (5.6680 => 6.1440, std.dev.: 0.0452) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.28% (11.4440 => 12.3920, std.dev.: 0.0494) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.7280 => 6.1960, std.dev.: 0.0470) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (0.4440 => 0.4760, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.6120 => 0.6560, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.98% (0.7360 => 0.7800, std.dev.: 0.0161) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.80% (9.5802 => 10.1362, std.dev.: 0.0617) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.4760 => 1.5560, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.90% (0.9800 => 1.0280, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0074) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.53% (1.3240 => 1.3840, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.43% (1.6240 => 1.6960, std.dev.: 0.0253) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3760 => 0.3920, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 3.94% (4.7720 => 4.9600, std.dev.: 0.0235) MultiSource/Benchmarks/MallocBench/gs/gs: 3.79% (5.3840 => 5.5880, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0207) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.40% (6.8280 => 7.0600, std.dev.: 0.0442) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0100) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.34% (49.1529 => 50.7969, std.dev.: 0.0717) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.6961 => 1.7441, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 2.77% (19.2243 => 19.7564, std.dev.: 0.0444) MultiSource/Applications/sqlite3/sqlite3: 2.70% (24.7575 => 25.4255, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 1.94% (19.7491 => 20.1331, std.dev.: 0.0297) MultiSource/Benchmarks/PAQ8p/paq8p: 1.76% (2.7282 => 2.7762, std.dev.: 0.0159) MultiSource/Benchmarks/Bullet/bullet: 1.60% (39.0726 => 39.6966, std.dev.: 0.0740) MultiSource/Applications/siod/siod: 1.02% (2.7562 => 2.7842, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.58% (1.2401 => 1.3961, std.dev.: 0.0210) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.8281 => 0.8601, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 3.75% (2.9842 => 3.0962, std.dev.: 0.0147) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0303) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.27% (1.1001 => 1.1361, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.68% (4.0563 => 4.1243, std.dev.: 0.0174) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (25.4536 => 25.8736, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 1.41% (7.3965 => 7.5005, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.71% (11.0207 => 2.0161, std.dev.: 0.0119) SingleSource/UnitTests/2009-12-07-StructReturn: -60.00% (0.0200 => 0.0080, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.20% (21.6534 => 17.9291, std.dev.: 0.0337) SingleSource/Benchmarks/Linpack/linpack-pc: -16.54% (7.8605 => 6.5604, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0037) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0715) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.05% (2.0601 => 1.9561, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -2.22% (2.8802 => 2.8162, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.88% (5.0963 => 5.0003, std.dev.: 0.0191) MultiSource/Benchmarks/sim/sim: -1.12% (4.9963 => 4.9403, std.dev.: 0.0175) MultiSource/Applications/hexxagon/hexxagon: -1.00% (11.5567 => 11.4407, std.dev.: 0.0175) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 04:15:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 06:15:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140429111557.DA9892A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25122?compare_to=25116&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25122, Order: 207489, Start Time: 2014-04-29 06:38:29, End Time: 2014-04-29 11:22:44 To: 25116, Order: 207480, Start Time: 2014-04-29 01:43:01, End Time: 2014-04-29 06:28:39 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (133 on baseline) Performance Improvements: 0 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1098 (941 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/lowercase: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: 19.05% (0.0840 => 0.1000, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 8.33% (0.2400 => 0.2600, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.59% (0.4640 => 0.4760, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.92% (1.0441 => 1.0641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.55% (2.0641 => 2.0961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.55% (2.0681 => 2.1001, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/obsequi/Obsequi: 1.98% (2.0241 => 2.0641, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 10.68% (17.6723 => 19.5603, std.dev.: 0.0681) MultiSource/Applications/sqlite3/sqlite3: 1420.48% (1.7001 => 25.8496, std.dev.: 0.0349) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.46% (50.1010 => 51.8330, std.dev.: 0.1021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.98% (1.0520 => 1.1360, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.57% (11.3920 => 12.3680, std.dev.: 0.0584) SingleSource/Benchmarks/Misc/oourafft: -73.37% (11.3407 => 3.0202, std.dev.: 0.0131) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0323, std.dev.: 0.0171) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7124, std.dev.: 0.0129) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 316.69% (0.4320 => 1.8001, std.dev.: 0.0091) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0063) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/UnitTests/ms_struct-bitfield-init-1: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 17.14% (0.1400 => 0.1640, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.38% (1.8201 => 2.1001, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.84% (1.8601 => 2.1361, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.82% (1.8081 => 2.0761, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.42% (2.1361 => 2.4442, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.29% (0.2240 => 0.2560, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.20% (2.0281 => 2.3161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.95% (1.8921 => 2.1561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.94% (1.8361 => 2.0921, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.32% (1.9521 => 2.2121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.98% (1.9721 => 2.2281, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.55% (1.9121 => 2.1521, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.39% (1.8081 => 2.0321, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.49% (1.8801 => 2.0961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.16% (1.9001 => 2.1121, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/health/health: 10.87% (0.1840 => 0.2040, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.83% (1.7721 => 1.9641, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.83% (1.9201 => 2.1281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.47% (1.9481 => 2.1521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.25% (2.0681 => 2.2801, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/objinst: 10.17% (0.2360 => 0.2600, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.14% (2.0521 => 2.2601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.89% (1.8601 => 2.0441, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.19% (0.7400 => 0.8080, std.dev.: 0.0139) MultiSource/Applications/obsequi/Obsequi: 9.17% (1.8760 => 2.0480, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: 6.94% (0.2880 => 0.3080, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.99% (6.4800 => 6.8680, std.dev.: 0.0358) MultiSource/Applications/hexxagon/hexxagon: 5.65% (1.1320 => 1.1960, std.dev.: 0.0197) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0121) MultiSource/Applications/spiff/spiff: 5.51% (1.0160 => 1.0720, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.2920 => 0.3080, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.8440 => 1.9360, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (5.8281 => 6.1001, std.dev.: 0.0231) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0647) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.7480 => 1.8200, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.96% (1.2120 => 1.2600, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 3.64% (10.2283 => 10.6004, std.dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: 3.40% (2.5880 => 2.6760, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3960 => 5.5680, std.dev.: 0.0309) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.00% (6.5320 => 6.7280, std.dev.: 0.0422) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (1.0840 => 1.1160, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 2.92% (4.7920 => 4.9320, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.9801 => 1.0081, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 2.67% (7.0524 => 7.2405, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0172) MultiSource/Applications/SPASS/SPASS: 2.57% (18.5284 => 19.0045, std.dev.: 0.0567) MultiSource/Applications/JM/lencod/lencod: 2.39% (22.2206 => 22.7527, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (6.5360 => 6.6880, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (16.3003 => 16.6763, std.dev.: 0.0418) MultiSource/Applications/SIBsim4/SIBsim4: 2.24% (1.7841 => 1.8241, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 2.18% (38.6366 => 39.4806, std.dev.: 0.1026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.2243 => 4.2963, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 1.63% (19.8291 => 20.1531, std.dev.: 0.0374) MultiSource/Applications/siod/siod: 1.16% (2.7522 => 2.7842, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.42% (2.1201 => 2.4682, std.dev.: 0.0491) MultiSource/Applications/siod/siod: 9.78% (2.8642 => 3.1442, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.64% (11.4967 => 11.6847, std.dev.: 0.0288) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (4.0003 => 4.0643, std.dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 1.48% (8.1285 => 8.2485, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.0243 => 5.0803, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.50% (10.4007 => 2.0281, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.69% (2.9562 => 0.8960, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -47.92% (94.8339 => 49.3911, std.dev.: 0.7192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.77% (49.9431 => 33.0781, std.dev.: 0.2714) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.60% (25.7136 => 17.0731, std.dev.: 0.0999) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.54% (37.0863 => 28.7258, std.dev.: 0.2899) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -14.89% (7.8165 => 6.6524, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -10.33% (2.7482 => 2.4642, std.dev.: 0.0987) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.89% (1.2681 => 1.1681, std.dev.: 0.0123) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0206) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.64% (5.6124 => 5.5203, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.58% (4.8043 => 4.7283, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (5.1563 => 5.0763, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 04:16:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 06:16:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429111631.426B92A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25123?compare_to=25120&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25123, Order: 207496, Start Time: 2014-04-29 06:42:40, End Time: 2014-04-29 11:23:12 To: 25120, Order: 207489, Start Time: 2014-04-29 03:16:44, End Time: 2014-04-29 07:57:08 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (111 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 27.27% (0.0880 => 0.1120, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 25.00% (0.0640 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.81% (0.1080 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.7000 => 0.7240, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash2: 3.31% (0.4840 => 0.5000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.90% (1.2641 => 1.2881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.65% (1.4561 => 1.4801, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.30% (0.9201 => 0.9321, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.06% (5.4403 => 5.5523, std.dev.: 0.0426) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/factor: 42.86% (0.0280 => 0.0400, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0127) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 15.00% (0.0800 => 0.0920, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.19% (1.3681 => 1.4801, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (10.6960 => 11.5200, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0302) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.24% (0.7640 => 0.8040, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0485) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3760 => 1.4360, std.dev.: 0.0207) MultiSource/Applications/lua/lua: 4.25% (4.5200 => 4.7120, std.dev.: 0.0291) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (10.4082 => 10.8082, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.18% (4.9000 => 5.0560, std.dev.: 0.0306) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.5480 => 1.5920, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.70% (17.6165 => 18.0925, std.dev.: 0.0566) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (5.8000 => 5.9520, std.dev.: 0.0456) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.44% (48.1088 => 49.2849, std.dev.: 0.0608) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0164) MultiSource/Applications/sqlite3/sqlite3: 2.32% (23.7574 => 24.3095, std.dev.: 0.0275) MultiSource/Benchmarks/Bullet/bullet: 2.32% (37.0925 => 37.9526, std.dev.: 0.0897) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1451, std.dev.: 0.0417) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0121) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0383) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0222) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.33% (0.1800 => 0.2040, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.71% (0.2240 => 0.2480, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 5.33% (3.3802 => 3.5602, std.dev.: 0.0644) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0344) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.56% (6.6564 => 6.7604, std.dev.: 0.0357) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0092) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0173) SingleSource/Benchmarks/SmallPT/smallpt: 1.23% (14.0009 => 14.1729, std.dev.: 0.0441) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.88% (0.4080 => 0.3840, std.dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: -1.72% (1.6321 => 1.6041, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0039) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 04:21:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 06:21:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429112131.CE5D72A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25124?compare_to=25117&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25124, Order: 207496, Start Time: 2014-04-29 06:42:46, End Time: 2014-04-29 11:28:17 To: 25117, Order: 207480, Start Time: 2014-04-29 01:46:18, End Time: 2014-04-29 06:32:48 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1102 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0026) SingleSource/UnitTests/2003-08-05-CastFPToUint: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.67% (0.2400 => 0.2560, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3000 => 0.3200, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 3.15% (1.7760 => 1.8320, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (2.1400 => 2.1960, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.51% (1.8561 => 1.8841, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0134) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 04:29:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 06:29:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140429112924.4B4DB2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25125?compare_to=25118&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25125, Order: 207496, Start Time: 2014-04-29 06:48:34, End Time: 2014-04-29 11:36:12 To: 25118, Order: 207482, Start Time: 2014-04-29 01:50:41, End Time: 2014-04-29 06:38:43 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (134 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/Regression/C/testtrace: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/lowercase: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.52% (0.1080 => 0.1280, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.64% (0.1880 => 0.2080, std.dev.: 0.0070) MultiSource/Applications/aha/aha: 9.09% (0.1320 => 0.1440, std.dev.: 0.0040) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 8.16% (0.1960 => 0.2120, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.14% (0.2240 => 0.2400, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.2480 => 0.2640, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3480 => 0.3600, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 2.73% (5.5680 => 5.7200, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.20% (2.0081 => 2.0321, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (1.7281 => 1.7481, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.52% (0.3680 => 0.3920, std.dev.: 0.0092) MultiSource/Applications/spiff/spiff: 4.42% (2.1721 => 2.2681, std.dev.: 0.0223) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 132.14% (0.2240 => 0.5200, std.dev.: 0.0040) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0103) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 200.00% (0.0080 => 0.0240, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.83% (0.1640 => 0.2080, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.65% (1.7241 => 2.0801, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.52% (1.6961 => 2.0441, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.38% (1.6881 => 2.0321, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.05% (1.6761 => 2.0121, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.72% (1.7441 => 2.0881, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.62% (1.6921 => 2.0241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.57% (1.6961 => 2.0281, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.47% (1.8081 => 2.1601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.31% (1.7401 => 2.0761, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.28% (1.8881 => 2.2521, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.23% (1.7681 => 2.1081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.20% (1.7921 => 2.1361, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.11% (1.8001 => 2.1441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.05% (1.7641 => 2.1001, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.99% (1.9801 => 2.3561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.74% (1.8361 => 2.1801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.31% (1.9881 => 2.3521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.24% (1.8201 => 2.1521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.18% (1.8041 => 2.1321, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.16% (1.8281 => 2.1601, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.21% (1.9761 => 2.3161, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.97% (1.9801 => 2.3161, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.90% (1.9641 => 2.2961, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.38% (0.1040 => 0.1200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.11% (0.6120 => 0.6800, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.64% (0.1880 => 0.2080, std.dev.: 0.0070) MultiSource/Applications/aha/aha: 9.09% (0.1320 => 0.1440, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 8.77% (0.2280 => 0.2480, std.dev.: 0.0065) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 7.89% (0.1520 => 0.1640, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.14% (0.7840 => 0.8400, std.dev.: 0.0140) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.98% (0.8601 => 0.9201, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0062) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (11.7880 => 12.5280, std.dev.: 0.0707) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.7200 => 7.1400, std.dev.: 0.0406) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.07% (1.6481 => 1.7481, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.24% (0.9920 => 1.0440, std.dev.: 0.0166) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.04% (1.3480 => 1.4160, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.71% (0.3400 => 0.3560, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (9.9842 => 10.4482, std.dev.: 0.0445) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.8201 => 1.9041, std.dev.: 0.0160) MultiSource/Applications/lua/lua: 4.59% (4.7920 => 5.0120, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (6.8321 => 7.1041, std.dev.: 0.0354) MultiSource/Applications/d/make_dparser: 3.94% (3.9641 => 4.1201, std.dev.: 0.0187) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.1440 => 1.1880, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0139) MultiSource/Applications/oggenc/oggenc: 3.59% (6.9124 => 7.1604, std.dev.: 0.0175) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.6801 => 1.7401, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3480 => 0.3600, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 3.44% (18.4924 => 19.1285, std.dev.: 0.0422) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (2.0440 => 2.1120, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 3.26% (10.3203 => 10.6563, std.dev.: 0.0460) MultiSource/Benchmarks/MallocBench/gs/gs: 3.10% (5.5480 => 5.7200, std.dev.: 0.0398) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.92% (51.1089 => 52.6009, std.dev.: 0.0585) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (3.0122 => 3.0922, std.dev.: 0.0117) MultiSource/Applications/treecc/treecc: 2.60% (2.6200 => 2.6880, std.dev.: 0.0261) MultiSource/Applications/kimwitu++/kc: 2.49% (19.7371 => 20.2291, std.dev.: 0.0456) MultiSource/Applications/JM/lencod/lencod: 2.44% (22.6287 => 23.1808, std.dev.: 0.0975) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2203 => 4.3163, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 2.27% (20.2445 => 20.7045, std.dev.: 0.0557) MultiSource/Benchmarks/Bullet/bullet: 1.97% (38.9366 => 39.7046, std.dev.: 0.1150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (16.5963 => 16.9083, std.dev.: 0.0414) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 1.87% (25.1895 => 25.6616, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.39% (6.0244 => 6.1084, std.dev.: 0.0243) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.44% (6.6644 => 17.1571, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.67% (1.2681 => 1.4161, std.dev.: 0.0147) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.40% (1.0921 => 1.1401, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.04% (1.0881 => 1.1321, std.dev.: 0.0099) MultiSource/Applications/spiff/spiff: 3.85% (2.1841 => 2.2681, std.dev.: 0.0223) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 2.99% (6.8204 => 7.0244, std.dev.: 0.0467) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.88% (5.0963 => 5.1923, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 1.64% (7.5485 => 7.6725, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0146) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0118) MultiSource/Applications/sgefa/sgefa: -26.84% (0.7600 => 0.5560, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.45% (1.5881 => 1.1681, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0062) MultiSource/Applications/obsequi/Obsequi: -21.00% (2.6481 => 2.0920, std.dev.: 0.0239) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -16.21% (7.5041 => 6.2880, std.dev.: 0.0512) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.72% (7.4801 => 6.3040, std.dev.: 0.0351) SingleSource/UnitTests/Vector/multiplies: -14.63% (0.1640 => 0.1400, std.dev.: 0.0073) SingleSource/Regression/C/sumarray2d: -9.50% (0.7160 => 0.6480, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: -2.90% (13.5243 => 13.1323, std.dev.: 0.0360) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -20.86% (62.4439 => 49.4151, std.dev.: 2.0700) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.68% (21.6534 => 17.8251, std.dev.: 0.0528) SingleSource/Benchmarks/Linpack/linpack-pc: -15.28% (7.8005 => 6.6084, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.90% (2.6082 => 2.3761, std.dev.: 0.0821) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0084) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9202 => 2.8162, std.dev.: 0.0062) MultiSource/Applications/aha/aha: -3.30% (2.9122 => 2.8162, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (5.1603 => 5.0243, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.8002 => 3.7162, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.98% (2.6202 => 2.5682, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -1.85% (11.6527 => 11.4367, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: -1.83% (8.3085 => 8.1565, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.43% (4.7603 => 4.6923, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.7041 => 1.6841, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 04:56:52 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 04:56:52 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429115706.8726350221E8@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19369 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207520 Blamelist: volkalex Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 05:03:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 07:03:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429120310.5D7492A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25126?compare_to=25123&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25126, Order: 207497, Start Time: 2014-04-29 07:31:40, End Time: 2014-04-29 12:09:56 To: 25123, Order: 207496, Start Time: 2014-04-29 06:42:40, End Time: 2014-04-29 11:23:12 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 5 (99 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.6120 => 0.6320, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.63% (1.2241 => 1.2441, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 30.77% (0.0520 => 0.0680, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 4.72% (0.5080 => 0.5320, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -28.57% (0.0560 => 0.0400, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.82% (0.1560 => 0.1760, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.61% (1.1241 => 1.2321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0453) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3600 => 0.3840, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (1.5200 => 1.6160, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0153) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0421) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0177) MultiSource/Applications/lua/lua: 3.72% (4.5200 => 4.6880, std.dev.: 0.0345) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.9200 => 5.1000, std.dev.: 0.0379) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (1.7080 => 1.7600, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0279) MultiSource/Applications/treecc/treecc: 2.61% (2.4480 => 2.5120, std.dev.: 0.0165) MultiSource/Applications/JM/lencod/lencod: 2.45% (17.6165 => 18.0485, std.dev.: 0.0475) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.43% (48.1088 => 49.2770, std.dev.: 0.0603) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 2.20% (37.0925 => 37.9086, std.dev.: 0.0826) MultiSource/Applications/sqlite3/sqlite3: 2.17% (23.7574 => 24.2735, std.dev.: 0.0330) MultiSource/Applications/kimwitu++/kc: 2.06% (18.8170 => 19.2051, std.dev.: 0.0588) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0295) MultiSource/Benchmarks/nbench/nbench: 1.92% (1.2480 => 1.2720, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (0.9161 => 0.9321, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0482) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0037) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.74% (6.6564 => 6.7724, std.dev.: 0.0401) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -28.57% (0.0560 => 0.0400, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -16.67% (0.1200 => 0.1000, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0284) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 05:35:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 07:35:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429123526.EC4492A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25127?compare_to=25126&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25127, Order: 207498, Start Time: 2014-04-29 08:04:22, End Time: 2014-04-29 12:42:13 To: 25126, Order: 207497, Start Time: 2014-04-29 07:31:40, End Time: 2014-04-29 12:09:56 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 6 (96 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1106 (993 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/badidx: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 55.56% (0.0360 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.00% (0.1000 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.82% (0.1360 => 0.1480, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (2.3241 => 2.3481, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0093) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.28% (1.2081 => 1.3081, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (10.6960 => 11.3920, std.dev.: 0.0793) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.6840 => 0.7200, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0501) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0207) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0393) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0546) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (10.4082 => 10.7482, std.dev.: 0.0248) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0125) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.21% (48.1088 => 49.1729, std.dev.: 0.0922) MultiSource/Benchmarks/Bullet/bullet: 2.21% (37.0925 => 37.9126, std.dev.: 0.0759) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0337) MultiSource/Applications/JM/lencod/lencod: 2.13% (17.6165 => 17.9925, std.dev.: 0.0610) MultiSource/Applications/JM/ldecod/ldecod: 1.78% (7.8562 => 7.9962, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 1.55% (18.8170 => 19.1091, std.dev.: 0.0714) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 20.00% (0.0600 => 0.0720, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0248) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (25.8896 => 26.7377, std.dev.: 0.0312) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.47% (21.1533 => 21.4653, std.dev.: 0.0904) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0306) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: -2.94% (1.6321 => 1.5841, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.81% (0.1080 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 05:39:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 07:39:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429123948.9C5172A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25128?compare_to=25127&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25128, Order: 207499, Start Time: 2014-04-29 08:08:31, End Time: 2014-04-29 12:46:35 To: 25127, Order: 207498, Start Time: 2014-04-29 08:04:22, End Time: 2014-04-29 12:42:13 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (99 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-SignedArgs: 100.00% (0.0160 => 0.0320, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.32% (0.1640 => 0.1760, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.05% (0.3960 => 0.4160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.83% (1.3081 => 1.3321, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.17% (1.7081 => 1.7281, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.89% (1.2161 => 1.3121, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.14% (0.2800 => 0.3000, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.92% (1.2721 => 1.3601, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0589) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (6.0160 => 6.4000, std.dev.: 0.0351) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.4400 => 0.4680, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.04% (1.1921 => 1.2641, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (8.1441 => 8.5641, std.dev.: 0.0277) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.8561 => 0.9001, std.dev.: 0.0090) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (4.9200 => 5.0960, std.dev.: 0.0372) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (10.4082 => 10.7802, std.dev.: 0.0428) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0369) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 2.38% (17.6165 => 18.0365, std.dev.: 0.0608) MultiSource/Applications/sqlite3/sqlite3: 2.17% (23.7574 => 24.2735, std.dev.: 0.0425) MultiSource/Benchmarks/Bullet/bullet: 2.07% (37.0925 => 37.8605, std.dev.: 0.0600) MultiSource/Applications/JM/ldecod/ldecod: 1.99% (7.8562 => 8.0122, std.dev.: 0.0177) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.89% (48.1088 => 49.0169, std.dev.: 0.0921) MultiSource/Applications/kimwitu++/kc: 1.49% (18.8170 => 19.0970, std.dev.: 0.0494) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0384) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0032) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (25.8896 => 26.7817, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0294) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0151) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0591) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: -3.19% (1.6321 => 1.5801, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ClamAV/clamscan: -23.33% (0.1200 => 0.0920, std.dev.: 0.0091) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -6.86% (0.4080 => 0.3800, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.6165 => 8.4725, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 05:51:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 07:51:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429125104.6E3B62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25129?compare_to=25128&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25129, Order: 207500, Start Time: 2014-04-29 08:16:38, End Time: 2014-04-29 12:57:51 To: 25128, Order: 207499, Start Time: 2014-04-29 08:08:31, End Time: 2014-04-29 12:46:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (104 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/2002-05-02-CastTest2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/mason/mason: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 16.67% (0.1200 => 0.1400, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.29% (0.1400 => 0.1600, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.81% (0.2960 => 0.3280, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.94% (0.2880 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.71% (0.7000 => 0.7400, std.dev.: 0.0103) MultiSource/Applications/spiff/spiff: 5.31% (0.9800 => 1.0320, std.dev.: 0.0155) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.95% (1.2200 => 1.2560, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.26% (2.8642 => 2.9002, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 33.33% (0.0360 => 0.0480, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 9.38% (0.2560 => 0.2800, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 5.93% (3.8482 => 4.0763, std.dev.: 0.0651) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.49% (0.3440 => 0.3560, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.15% (0.1320 => 0.1520, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0156) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.33% (0.3000 => 0.3280, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0646) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.45% (1.3641 => 1.4521, std.dev.: 0.0125) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.72% (1.1880 => 1.2560, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.2920 => 0.3080, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.7040 => 0.7400, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.6840 => 0.7160, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0096) MultiSource/Applications/lua/lua: 4.60% (4.5200 => 4.7280, std.dev.: 0.0251) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0155) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0655) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3920 => 0.4080, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (10.4082 => 10.7202, std.dev.: 0.0555) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.9200 => 5.0520, std.dev.: 0.0412) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0254) MultiSource/Applications/sqlite3/sqlite3: 2.29% (23.7574 => 24.3015, std.dev.: 0.0375) MultiSource/Applications/JM/lencod/lencod: 2.25% (17.6165 => 18.0125, std.dev.: 0.0629) MultiSource/Benchmarks/Bullet/bullet: 2.18% (37.0925 => 37.9005, std.dev.: 0.0674) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.90% (48.1088 => 49.0250, std.dev.: 0.1294) MultiSource/Applications/kimwitu++/kc: 1.76% (18.8170 => 19.1491, std.dev.: 0.0454) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (4.0122 => 4.0603, std.dev.: 0.0134) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0399) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0245) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0080) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0643 => 4.1163, std.dev.: 0.0175) MultiSource/Applications/lua/lua: 1.21% (21.1533 => 21.4093, std.dev.: 0.0648) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -20.00% (0.1200 => 0.0960, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0028) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 06:14:47 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 06:14:47 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429131459.6AA145022B6D@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19371 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207522 Blamelist: rafael Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 07:24:19 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 07:24:19 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429142433.4C0FF5023573@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19373 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207526 Blamelist: dsanders,joerg,sbenza BUILD FAILED: exception interrupted sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 07:41:13 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 07:41:13 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429144125.B380E5023813@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19374 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207527 Blamelist: djasper Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 08:26:50 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 08:26:50 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429152711.D65AB5023E7B@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19376 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207530 Blamelist: tilmann BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 09:09:28 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 09:09:28 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429160942.304A8502455E@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building clang-tools-extra. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19378 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207532 Blamelist: alexfh Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 09:03:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 11:03:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429160336.6F3A219BE001@llvm.org> http://llvm.org/perf/db_default/v4/nts/25131?compare_to=25114&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25131, Order: 207520, Start Time: 2014-04-29 11:27:23, End Time: 2014-04-29 16:10:24 To: 25114, Order: 207478, Start Time: 2014-04-29 01:34:50, End Time: 2014-04-29 06:17:32 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (160 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (923 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/short_circuit_dtor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 36.36% (0.0440 => 0.0600, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/random: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0053) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 4.29% (0.2800 => 0.2920, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.11% (1.0280 => 1.0600, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/05-eks/eks: 2.15% (0.7440 => 0.7600, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (6.7000 => 6.8040, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.32% (1.5161 => 1.5361, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.19% (1.6761 => 1.6961, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 6.38% (0.3760 => 0.4000, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.51% (2.3961 => 2.4802, std.dev.: 0.0261) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -8.82% (0.2720 => 0.2480, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.52% (0.3680 => 0.3440, std.dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.29% (11.3687 => 3.0362, std.dev.: 0.0129) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0119) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 295.67% (0.4600 => 1.8201, std.dev.: 0.0125) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0059) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0043) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/mandel-text: 75.00% (0.0160 => 0.0280, std.dev.: 0.0025) SingleSource/Regression/C/sumarray2d: 66.67% (0.0240 => 0.0400, std.dev.: 0.0042) SingleSource/UnitTests/2006-01-23-UnionInit: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/random: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0052) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/15-trie/trie: 35.71% (0.0560 => 0.0760, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0062) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 20.24% (0.3360 => 0.4040, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.86% (0.1120 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0154) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 15.15% (0.6600 => 0.7600, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 13.51% (0.1480 => 0.1680, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0043) MultiSource/Applications/aha/aha: 12.90% (0.1240 => 0.1400, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.70% (0.2520 => 0.2840, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: 12.50% (0.2240 => 0.2520, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.76% (0.1360 => 0.1520, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.1800 => 0.2000, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.3640 => 0.4040, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.95% (1.4241 => 1.5801, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0111) MultiSource/Applications/spiff/spiff: 9.92% (1.0080 => 1.1080, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.43% (1.6121 => 1.7641, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.25% (1.8161 => 1.9841, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.17% (1.4401 => 1.5721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: 8.57% (1.8680 => 2.0280, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.4961 => 1.6241, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.25% (1.5521 => 1.6801, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.19% (1.6121 => 1.7441, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.9800 => 1.0600, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.14% (1.5241 => 1.6481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.5281 => 1.6521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 7.94% (1.4601 => 1.5761, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2160 => 0.2320, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.22% (1.1640 => 1.2480, std.dev.: 0.0291) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (6.4680 => 6.9320, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.6921 => 1.8121, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.03% (1.0240 => 1.0960, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.96% (0.4600 => 0.4920, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.95% (0.7480 => 0.8000, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0098) MultiSource/Applications/Burg/burg: 6.90% (1.5080 => 1.6120, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.7680 => 0.8200, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.47% (1.4841 => 1.5801, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.33% (1.5801 => 1.6801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (1.4640 => 1.5560, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (1.7400 => 1.8480, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.20% (0.9681 => 1.0281, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.15% (11.6440 => 12.3600, std.dev.: 0.0832) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.85% (5.8121 => 6.1521, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 5.41% (0.2960 => 0.3120, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3720 => 0.3920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.22% (1.4561 => 1.5321, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.19% (9.4842 => 9.9762, std.dev.: 0.0596) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.47% (1.5201 => 1.5881, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0163) MultiSource/Applications/JM/ldecod/ldecod: 4.34% (10.0443 => 10.4803, std.dev.: 0.0358) MultiSource/Applications/lua/lua: 4.26% (4.7880 => 4.9920, std.dev.: 0.0377) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.1280 => 1.1760, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.5480 => 1.6120, std.dev.: 0.0214) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.13% (50.0290 => 52.0970, std.dev.: 0.1122) MultiSource/Applications/JM/lencod/lencod: 4.10% (21.9606 => 22.8608, std.dev.: 0.0610) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (6.5440 => 6.8040, std.dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.3281 => 2.4202, std.dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 3.78% (6.9844 => 7.2485, std.dev.: 0.0220) MultiSource/Benchmarks/Bullet/bullet: 3.68% (38.4046 => 39.8166, std.dev.: 0.0644) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (6.5080 => 6.7360, std.dev.: 0.0352) MultiSource/Applications/SPASS/SPASS: 3.49% (18.4404 => 19.0846, std.dev.: 0.0586) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (5.3600 => 5.5440, std.dev.: 0.0482) MultiSource/Benchmarks/Prolangs-C/football/football: 3.27% (1.1000 => 1.1360, std.dev.: 0.0098) MultiSource/Applications/d/make_dparser: 3.23% (3.9681 => 4.0961, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (4.1843 => 4.3123, std.dev.: 0.0082) MultiSource/Applications/kimwitu++/kc: 3.05% (19.6891 => 20.2891, std.dev.: 0.0526) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (16.3483 => 16.8083, std.dev.: 0.0326) MultiSource/Applications/ClamAV/clamscan: 2.54% (19.0444 => 19.5284, std.dev.: 0.0787) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.90% (6.1044 => 6.2204, std.dev.: 0.0224) MultiSource/Applications/sqlite3/sqlite3: 1.43% (25.6856 => 26.0536, std.dev.: 0.0409) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.24% (29.3338 => 29.6979, std.dev.: 0.0736) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.97% (0.9241 => 1.1641, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.89% (2.1401 => 2.4802, std.dev.: 0.0261) MultiSource/Applications/siod/siod: 9.93% (2.8602 => 3.1442, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0215) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.0881 => 1.1161, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0229) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (8.1845 => 8.3725, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 2.10% (6.6684 => 6.8084, std.dev.: 0.0398) MultiSource/Applications/hexxagon/hexxagon: 1.91% (11.5087 => 11.7287, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.51% (3.9842 => 4.0443, std.dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: 1.48% (8.1245 => 8.2445, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.91% (10.6247 => 2.0281, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.57% (2.9442 => 0.8960, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.36% (91.8497 => 49.2711, std.dev.: 10.4674) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.58% (26.0616 => 17.0491, std.dev.: 0.0848) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.50% (50.3031 => 32.9461, std.dev.: 0.2611) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.65% (42.1466 => 28.8058, std.dev.: 0.4429) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1048) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0052) SingleSource/Benchmarks/Linpack/linpack-pc: -14.44% (7.7845 => 6.6604, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0148) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (4.1243 => 4.0443, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.79% (2.4602 => 2.4162, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.68% (5.7084 => 5.6124, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0163) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 09:03:10 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 11:03:10 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140429160310.346F12A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25130?compare_to=25121&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25130, Order: 207520, Start Time: 2014-04-29 11:27:48, End Time: 2014-04-29 16:09:54 To: 25121, Order: 207489, Start Time: 2014-04-29 06:27:37, End Time: 2014-04-29 11:09:47 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 21 (165 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (922 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/BuiltinTypeInfo: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 33.33% (0.0480 => 0.0640, std.dev.: 0.0020) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 13.89% (0.1440 => 0.1640, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 13.04% (0.0920 => 0.1040, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 9.09% (0.1320 => 0.1440, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.86% (0.3160 => 0.3440, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 5.08% (0.2360 => 0.2480, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2400 => 0.2520, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.9001 => 0.9241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.79% (1.3401 => 1.3641, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.64% (7.0600 => 7.1760, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (6.0841 => 6.1601, std.dev.: 0.0204) SingleSource/UnitTests/Vector/constpool: 1.19% (2.0161 => 2.0401, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.04% (1.5401 => 1.5561, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.64% (0.2360 => 0.2800, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.44% (1.3961 => 1.4441, std.dev.: 0.0135) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2412.81% (0.0320 => 0.8041, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/Puzzle: 1206.53% (0.1240 => 1.6201, std.dev.: 0.0051) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 973.82% (0.0760 => 0.8161, std.dev.: 0.0096) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 324.18% (0.2320 => 0.9841, std.dev.: 0.0107) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0125) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0059) SingleSource/Regression/C/sumarraymalloc: 122.22% (0.0360 => 0.0800, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0044) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0052) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 68.57% (0.1400 => 0.2360, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-3: 57.14% (0.0280 => 0.0440, std.dev.: 0.0050) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.98% (0.7040 => 1.0840, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 47.37% (0.0760 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 44.44% (0.0720 => 0.1040, std.dev.: 0.0025) MultiSource/Applications/obsequi/Obsequi: 44.25% (1.3920 => 2.0080, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/whetstone: 38.46% (0.1040 => 0.1440, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.50% (0.1600 => 0.2120, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 31.82% (0.0880 => 0.1160, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: 31.58% (0.1520 => 0.2000, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.96% (1.2160 => 1.5681, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.68% (1.2481 => 1.5561, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.55% (1.1321 => 1.3761, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.36% (1.2921 => 1.5681, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.63% (1.1441 => 1.3801, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.31% (1.3001 => 1.5641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/hash: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.93% (1.1841 => 1.4201, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.79% (1.1721 => 1.4041, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.44% (1.1521 => 1.3761, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.23% (1.1441 => 1.3641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.2521 => 1.4881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: 18.70% (8.5802 => 10.1843, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.62% (1.1601 => 1.3761, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.33% (1.2001 => 1.4081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 15.80% (19.5406 => 22.6287, std.dev.: 0.0382) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.44% (5.3360 => 6.1601, std.dev.: 0.0204) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.92% (0.3160 => 0.3600, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1760 => 0.2000, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.7400 => 1.9480, std.dev.: 0.0218) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0060) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.36% (0.1760 => 0.1960, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 10.53% (0.2280 => 0.2520, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 9.77% (11.3843 => 12.4963, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0179) MultiSource/Applications/oggenc/oggenc: 9.17% (6.2844 => 6.8604, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.73% (5.7280 => 6.2280, std.dev.: 0.0372) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.56% (11.4440 => 12.4240, std.dev.: 0.0563) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.33% (5.6680 => 6.1400, std.dev.: 0.0631) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.83% (1.1240 => 1.2120, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3480 => 0.3720, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.78% (1.4760 => 1.5760, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.68% (9.5802 => 10.2202, std.dev.: 0.0519) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.7640 => 0.8120, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.9800 => 1.0400, std.dev.: 0.0160) MultiSource/Applications/ALAC/encode/alacconvert-encode: 6.04% (1.3240 => 1.4040, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 5.26% (0.8360 => 0.8800, std.dev.: 0.0076) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.10% (6.8280 => 7.1760, std.dev.: 0.0251) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2440 => 0.2560, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 4.68% (5.3840 => 5.6360, std.dev.: 0.0493) MultiSource/Applications/lua/lua: 4.53% (4.7720 => 4.9880, std.dev.: 0.0332) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.48% (1.3400 => 1.4000, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 4.25% (1.6961 => 1.7681, std.dev.: 0.0101) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.15% (49.1529 => 51.1929, std.dev.: 0.0806) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7600 => 1.8240, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.4520 => 0.4680, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.48% (1.1480 => 1.1880, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.40% (1.5280 => 1.5800, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 3.20% (24.7575 => 25.5496, std.dev.: 0.0409) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.2081 => 2.2761, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (2.0920 => 2.1520, std.dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 2.51% (19.7491 => 20.2451, std.dev.: 0.0555) MultiSource/Applications/ClamAV/clamscan: 2.48% (19.2243 => 19.7004, std.dev.: 0.0840) MultiSource/Benchmarks/Bullet/bullet: 2.15% (39.0726 => 39.9126, std.dev.: 0.0481) MultiSource/Benchmarks/PAQ8p/paq8p: 2.05% (2.7282 => 2.7842, std.dev.: 0.0152) MultiSource/Applications/siod/siod: 1.60% (2.7562 => 2.8002, std.dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 1.53% (18.7966 => 19.0845, std.dev.: 0.0722) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.34% (29.3298 => 29.7219, std.dev.: 0.0831) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (3.0402 => 3.0762, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.44% (3.9842 => 4.3203, std.dev.: 0.0120) MultiSource/Benchmarks/llubenchmark/llu: 5.86% (5.1203 => 5.4203, std.dev.: 0.1052) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 3.75% (2.9842 => 3.0962, std.dev.: 0.0122) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0344) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0332) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (25.4536 => 25.8936, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.3601 => 1.3801, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.0563 => 4.1083, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.13% (4.2403 => 4.2883, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0120 => 0.0000, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -81.49% (11.0207 => 2.0401, std.dev.: 0.0072) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: -80.00% (0.0200 => 0.0040, std.dev.: 0.0061) SingleSource/UnitTests/2003-07-09-SignedArgs: -33.33% (0.0360 => 0.0240, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -18.98% (8.9566 => 7.2565, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.50% (21.6534 => 17.8651, std.dev.: 0.0686) SingleSource/Benchmarks/Linpack/linpack-pc: -16.54% (7.8605 => 6.5604, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0867) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.60% (4.7643 => 4.6883, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (5.0963 => 5.0163, std.dev.: 0.0214) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 09:15:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 11:15:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429161504.DD19B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25132?compare_to=25129&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25132, Order: 207520, Start Time: 2014-04-29 11:41:19, End Time: 2014-04-29 16:21:51 To: 25129, Order: 207500, Start Time: 2014-04-29 08:16:38, End Time: 2014-04-29 12:57:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (113 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/IntMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2320 => 0.2480, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.45% (0.2200 => 0.2320, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 3.77% (0.9560 => 0.9920, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.41% (0.3520 => 0.3640, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.68% (0.8961 => 0.9201, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.60% (0.6160 => 0.6320, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: 2.34% (2.5642 => 2.6242, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 11.63% (1.2041 => 1.3441, std.dev.: 0.0309) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.37% (0.1960 => 0.2320, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0083) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2280 => 0.2480, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0714) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.23% (1.2721 => 1.3641, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0240) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (8.1441 => 8.5641, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.9640 => 2.0560, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/football/football: 4.64% (0.9480 => 0.9920, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 4.38% (1.4600 => 1.5240, std.dev.: 0.0137) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (1.7080 => 1.7760, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0427) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0256) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.8000 => 6.0000, std.dev.: 0.0461) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.7360 => 1.7920, std.dev.: 0.0215) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0626) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0127) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0216) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.69% (48.1088 => 49.4049, std.dev.: 0.0933) MultiSource/Applications/sqlite3/sqlite3: 2.66% (23.7574 => 24.3895, std.dev.: 0.0484) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0135) MultiSource/Benchmarks/Bullet/bullet: 2.39% (37.0925 => 37.9806, std.dev.: 0.0886) MultiSource/Applications/kimwitu++/kc: 1.91% (18.8170 => 19.1771, std.dev.: 0.0358) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 1.76% (17.5484 => 17.8564, std.dev.: 0.0318) MultiSource/Applications/oggenc/oggenc: 1.59% (5.7964 => 5.8884, std.dev.: 0.0171) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 1.19% (17.4082 => 17.6162, std.dev.: 0.0506) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.08% (28.1538 => 28.4578, std.dev.: 0.0419) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0244) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 7.01% (1.2561 => 1.3441, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0177) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0147) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0084) MultiSource/Applications/minisat/minisat: 1.80% (6.6564 => 6.7764, std.dev.: 0.0361) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.77% (4.7443 => 4.8283, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 1.61% (21.1533 => 21.4933, std.dev.: 0.0756) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-2: -40.00% (0.0400 => 0.0240, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.25% (1.2601 => 1.1561, std.dev.: 0.0339) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0443) MultiSource/Benchmarks/Olden/power/power: -1.19% (1.3401 => 1.3241, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 09:18:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 11:18:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140429161828.7DA112A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25133?compare_to=25122&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25133, Order: 207520, Start Time: 2014-04-29 11:40:38, End Time: 2014-04-29 16:25:14 To: 25122, Order: 207489, Start Time: 2014-04-29 06:38:29, End Time: 2014-04-29 11:22:44 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 14 (153 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (923 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-02-03-AggregateCopy: 400.00% (0.0040 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/global_ctor: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.20% (0.1640 => 0.1840, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 11.67% (0.7200 => 0.8040, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.33% (0.3840 => 0.4160, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.02% (0.6640 => 0.7040, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (0.4720 => 0.5000, std.dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 1.10% (1.8241 => 1.8441, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.07% (6.7280 => 6.8000, std.dev.: 0.0248) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 6.02% (3.8562 => 4.0883, std.dev.: 0.0819) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.91% (2.0961 => 2.0561, std.dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.61% (17.6723 => 19.7244, std.dev.: 0.0510) MultiSource/Applications/sqlite3/sqlite3: 1426.36% (1.7001 => 25.9496, std.dev.: 0.0549) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.67% (50.1010 => 51.9410, std.dev.: 0.1296) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (1.0520 => 1.1080, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.41% (11.3920 => 12.4640, std.dev.: 0.0395) SingleSource/Benchmarks/Misc/oourafft: -73.16% (11.3407 => 3.0442, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1160, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0443, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0118) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0097) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0027) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0058) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/shr: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0037) SingleSource/Regression/C/sumarray: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: 26.67% (0.0600 => 0.0760, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 15.85% (0.3280 => 0.3800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.65% (1.8561 => 2.1281, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.4160 => 0.4760, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.20% (1.9721 => 2.2521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.94% (1.8081 => 2.0601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.86% (2.1361 => 2.4322, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.76% (1.8601 => 2.1161, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.52% (1.9521 => 2.2161, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.41% (2.0281 => 2.3001, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.79% (1.8761 => 2.1161, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.68% (1.8921 => 2.1321, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.13% (1.9121 => 2.1441, std.dev.: 0.0155) MultiSource/Benchmarks/NPB-serial/is/is: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.83% (0.3720 => 0.4160, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.74% (2.1121 => 2.3601, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.51% (1.7721 => 1.9761, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.73% (1.9761 => 2.1881, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.69% (0.6360 => 0.7040, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.42% (1.9201 => 2.1201, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.14% (2.0521 => 2.2601, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.80% (1.7961 => 1.9721, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 9.68% (0.1240 => 0.1360, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.8760 => 2.0560, std.dev.: 0.0179) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.52% (0.1680 => 0.1840, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.41% (0.3400 => 0.3720, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.36% (1.8801 => 2.0561, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.89% (0.1800 => 0.1960, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.82% (1.0880 => 1.1840, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.70% (0.1840 => 0.2000, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 8.27% (1.0160 => 1.1000, std.dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.41% (0.4320 => 0.4640, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.67% (0.2400 => 0.2560, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.42% (6.4800 => 6.8960, std.dev.: 0.0390) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.61% (1.2120 => 1.2800, std.dev.: 0.0231) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (2.9721 => 3.1362, std.dev.: 0.0205) MultiSource/Applications/Burg/burg: 5.50% (1.5280 => 1.6120, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3640 => 0.3840, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (5.8281 => 6.1241, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.46% (0.4480 => 0.4680, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (9.6042 => 10.0242, std.dev.: 0.0691) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (6.5320 => 6.8000, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (10.2283 => 10.6364, std.dev.: 0.0418) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.58% (1.5640 => 1.6200, std.dev.: 0.0189) MultiSource/Applications/lua/lua: 3.51% (4.7920 => 4.9600, std.dev.: 0.0269) MultiSource/Applications/SIBsim4/SIBsim4: 3.36% (1.7841 => 1.8441, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (5.3960 => 5.5680, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (2.3401 => 2.4122, std.dev.: 0.0118) MultiSource/Applications/SPASS/SPASS: 2.98% (18.5284 => 19.0806, std.dev.: 0.0468) MultiSource/Benchmarks/Bullet/bullet: 2.97% (38.6366 => 39.7846, std.dev.: 0.0444) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.85% (16.3003 => 16.7643, std.dev.: 0.0424) MultiSource/Applications/oggenc/oggenc: 2.72% (7.0524 => 7.2445, std.dev.: 0.0217) MultiSource/Applications/d/make_dparser: 2.62% (3.9761 => 4.0801, std.dev.: 0.0258) MultiSource/Applications/JM/lencod/lencod: 2.54% (22.2206 => 22.7847, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (6.5360 => 6.6960, std.dev.: 0.0260) MultiSource/Applications/kimwitu++/kc: 2.00% (19.8291 => 20.2251, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0090) MultiSource/Applications/siod/siod: 1.74% (2.7522 => 2.8002, std.dev.: 0.0121) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0363 => 13.1763, std.dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.93% (2.1201 => 2.5002, std.dev.: 0.0287) MultiSource/Applications/siod/siod: 9.92% (2.8642 => 3.1482, std.dev.: 0.0139) MultiSource/Benchmarks/llubenchmark/llu: 5.45% (5.0603 => 5.3363, std.dev.: 0.0981) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0115) MultiSource/Applications/minisat/minisat: 3.21% (6.5964 => 6.8084, std.dev.: 0.0494) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.10% (4.0003 => 4.0843, std.dev.: 0.0118) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.4967 => 11.7087, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.82% (3.7442 => 3.8122, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1961 => 2.2321, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.53% (8.1285 => 8.2525, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (8.3605 => 8.4565, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.0243 => 5.0763, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0148) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.88% (2.9562 => 0.9200, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.02% (94.8339 => 49.2911, std.dev.: 1.1965) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.06% (49.9431 => 32.9341, std.dev.: 0.1668) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.62% (25.7136 => 17.0691, std.dev.: 0.0587) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.78% (37.0863 => 29.0098, std.dev.: 0.2772) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -14.89% (7.8165 => 6.6524, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.88% (2.7482 => 2.5042, std.dev.: 0.0778) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.64% (5.6124 => 5.5203, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.58% (4.8043 => 4.7283, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0137) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 09:25:59 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 09:25:59 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429162659.9EE5750248EC@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19379 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207533 Blamelist: djasper BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 09:25:53 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 11:25:53 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429162553.E087B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25134?compare_to=25124&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25134, Order: 207520, Start Time: 2014-04-29 11:46:08, End Time: 2014-04-29 16:32:39 To: 25124, Order: 207496, Start Time: 2014-04-29 06:42:46, End Time: 2014-04-29 11:28:17 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 19 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1093 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/Vector/sumarray: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 33.33% (0.0480 => 0.0640, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/almabench: 29.41% (0.0680 => 0.0880, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/objinst: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) SingleSource/Regression/C/test_indvars: 16.67% (0.0960 => 0.1120, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: 13.64% (0.0880 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 7.89% (0.1520 => 0.1640, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.90% (0.2320 => 0.2480, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 4.00% (0.3000 => 0.3120, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 1.87% (2.7882 => 2.8402, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.37% (1.7481 => 1.7721, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 11.67% (0.2400 => 0.2680, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.8601 => 0.8761, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 09:35:06 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 11:35:06 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140429163506.6E47B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25135?compare_to=25125&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25135, Order: 207520, Start Time: 2014-04-29 11:54:11, End Time: 2014-04-29 16:41:51 To: 25125, Order: 207496, Start Time: 2014-04-29 06:48:34, End Time: 2014-04-29 11:36:12 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (144 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (927 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.00% (0.1000 => 0.1160, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.68% (0.3520 => 0.3720, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 3.90% (0.3080 => 0.3200, std.dev.: 0.0045) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.29% (1.3960 => 1.4280, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.39% (0.1640 => 0.2040, std.dev.: 0.0088) MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.73% (0.2200 => 0.2480, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.11% (0.2960 => 0.3200, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 400.00% (0.0040 => 0.0200, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Puzzle: 298.27% (0.4560 => 1.8161, std.dev.: 0.0104) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0066) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/Regression/C++/pointer_method2: 75.00% (0.0160 => 0.0280, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/family/family: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-3: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.09% (0.0920 => 0.1160, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.23% (1.6961 => 2.0561, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.32% (1.7321 => 2.0841, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.28% (1.6961 => 2.0401, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.90% (1.6681 => 2.0001, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.72% (1.7441 => 2.0881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.67% (1.7081 => 2.0441, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.19% (1.9801 => 2.3601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.17% (1.8361 => 2.1881, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.07% (1.7201 => 2.0481, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.07% (1.8041 => 2.1481, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.02% (1.7241 => 2.0521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.85% (1.7401 => 2.0681, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.64% (1.8881 => 2.2401, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 18.58% (1.8081 => 2.1441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.55% (1.7681 => 2.0961, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.45% (1.9081 => 2.2601, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.31% (1.9881 => 2.3521, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.22% (1.9761 => 2.3361, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.20% (1.6921 => 2.0001, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.72% (1.8281 => 2.1521, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.58% (1.8201 => 2.1401, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.31% (1.9641 => 2.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.09% (0.3480 => 0.4040, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.90% (0.3480 => 0.3720, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.9920 => 1.0600, std.dev.: 0.0227) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (3.5002 => 3.7362, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3000 => 0.3200, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (11.7880 => 12.5520, std.dev.: 0.0728) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.7200 => 7.1520, std.dev.: 0.0397) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.00% (2.0680 => 2.1920, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.79% (1.7280 => 1.8280, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0061) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.34% (1.3480 => 1.4200, std.dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2280 => 0.2400, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 5.26% (4.7920 => 5.0440, std.dev.: 0.0243) MultiSource/Applications/hexxagon/hexxagon: 5.24% (1.1440 => 1.2040, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 5.00% (1.6801 => 1.7641, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.4160 => 1.4840, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.5240 => 1.5960, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (9.9842 => 10.4362, std.dev.: 0.0411) MultiSource/Applications/oggenc/oggenc: 4.46% (6.9124 => 7.2205, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0241) MultiSource/Applications/treecc/treecc: 4.12% (2.6200 => 2.7280, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (6.8321 => 7.1121, std.dev.: 0.0359) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.08% (1.3720 => 1.4280, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 3.68% (18.4924 => 19.1726, std.dev.: 0.0558) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 3.53% (10.3203 => 10.6844, std.dev.: 0.0417) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.25% (51.1089 => 52.7689, std.dev.: 0.1189) MultiSource/Applications/JM/lencod/lencod: 3.11% (22.6287 => 23.3327, std.dev.: 0.0246) MultiSource/Benchmarks/MallocBench/gs/gs: 2.96% (5.5480 => 5.7120, std.dev.: 0.0383) MultiSource/Applications/kimwitu++/kc: 2.86% (19.7371 => 20.3011, std.dev.: 0.0508) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 2.71% (38.9366 => 39.9926, std.dev.: 0.0991) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (3.0122 => 3.0882, std.dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 2.49% (20.2445 => 20.7485, std.dev.: 0.0683) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.46% (16.5963 => 17.0043, std.dev.: 0.0483) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.19% (6.0244 => 6.1564, std.dev.: 0.0228) MultiSource/Applications/sqlite3/sqlite3: 2.11% (25.1895 => 25.7216, std.dev.: 0.0570) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (4.2203 => 4.3083, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0108) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (29.4578 => 29.8619, std.dev.: 0.0548) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.56% (6.6644 => 17.1651, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 20.00% (0.0800 => 0.0960, std.dev.: 0.0052) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: 15.38% (0.1040 => 0.1200, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.93% (1.2681 => 1.4321, std.dev.: 0.0150) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0156) MultiSource/Applications/minisat/minisat: 3.81% (6.8204 => 7.0804, std.dev.: 0.0291) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.67% (3.4842 => 3.6122, std.dev.: 0.0445) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.88% (5.0963 => 5.1923, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 1.75% (7.5485 => 7.6805, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/whetstone: 1.67% (1.4361 => 1.4601, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (4.2443 => 4.3123, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 1.38% (3.4682 => 3.5162, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 1.20% (2.3241 => 2.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (4.7563 => 4.8043, std.dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.77% (6.2884 => 0.8320, std.dev.: 0.0169) SingleSource/UnitTests/Vector/constpool: -81.37% (10.9087 => 2.0321, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ConditionalExpr: -57.14% (0.0280 => 0.0120, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.80% (3.1762 => 1.3721, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: -20.55% (2.6481 => 2.1040, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.10% (7.4801 => 6.2760, std.dev.: 0.0584) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.35% (7.5041 => 6.3520, std.dev.: 0.0482) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0058) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -2.78% (13.5243 => 13.1483, std.dev.: 0.0317) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -20.99% (62.4439 => 49.3351, std.dev.: 0.3462) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.31% (21.6534 => 17.9051, std.dev.: 0.0351) SingleSource/Benchmarks/Linpack/linpack-pc: -15.28% (7.8005 => 6.6084, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.90% (2.6082 => 2.3761, std.dev.: 0.0879) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0054) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.29% (2.9202 => 2.8242, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: -3.10% (5.1603 => 5.0003, std.dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.8002 => 3.7162, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -1.96% (11.6527 => 11.4247, std.dev.: 0.0227) MultiSource/Applications/JM/lencod/lencod: -1.88% (8.3085 => 8.1525, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.43% (4.7603 => 4.6923, std.dev.: 0.0177) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 09:47:59 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 09:47:59 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429164840.7006A5024D44@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19380 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207539 Blamelist: alexfh,chapuni,dblaikie,djasper Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 09:58:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 11:58:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429165845.A3AC52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25136?compare_to=25132&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25136, Order: 207521, Start Time: 2014-04-29 12:26:47, End Time: 2014-04-29 17:05:30 To: 25132, Order: 207520, Start Time: 2014-04-29 11:41:19, End Time: 2014-04-29 16:21:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (102 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (987 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-08-19-CodegenBug: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/UnitTests/2006-01-23-UnionInit: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 18.75% (0.0640 => 0.0760, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.90% (0.1240 => 0.1400, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.77% (0.2280 => 0.2480, std.dev.: 0.0077) MultiSource/Applications/minisat/minisat: 2.51% (0.7960 => 0.8160, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.05% (1.3641 => 1.3921, std.dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 7.69% (0.2600 => 0.2800, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.61% (1.1561 => 1.2441, std.dev.: 0.0115) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (3.9362 => 3.9962, std.dev.: 0.0156) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0067) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 29.63% (0.1080 => 0.1400, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0091) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.65% (1.1601 => 1.2721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.10% (1.1361 => 1.2281, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (10.6960 => 11.4880, std.dev.: 0.0662) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.38% (1.1921 => 1.2801, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (6.0160 => 6.4320, std.dev.: 0.0440) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.7400 => 0.7800, std.dev.: 0.0118) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.39% (1.1880 => 1.2520, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0356) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0206) MultiSource/Applications/Burg/burg: 4.11% (1.4600 => 1.5200, std.dev.: 0.0177) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0321) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0330) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0486) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 2.83% (23.7574 => 24.4295, std.dev.: 0.0462) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 2.79% (17.6165 => 18.1085, std.dev.: 0.0487) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.57% (48.1088 => 49.3449, std.dev.: 0.0882) MultiSource/Benchmarks/Bullet/bullet: 2.53% (37.0925 => 38.0326, std.dev.: 0.0829) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0462) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0473) MultiSource/Applications/kimwitu++/kc: 2.11% (18.8170 => 19.2131, std.dev.: 0.0557) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 1.89% (17.5484 => 17.8804, std.dev.: 0.0287) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0103) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0554) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (28.1538 => 28.4498, std.dev.: 0.0415) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/treeadd/treeadd: 12.50% (0.2240 => 0.2520, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.79% (3.3802 => 3.5082, std.dev.: 0.0439) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -15.49% (0.2840 => 0.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0044) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.73% (3.9202 => 3.8522, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.70% (0.9401 => 0.9241, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 10:21:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 10:21:30 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429172202.422C55025414@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19382 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207549 Blamelist: benlangmuir,dsanders BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 10:38:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 12:38:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429173856.ACFA22A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25137?compare_to=25136&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25137, Order: 207522, Start Time: 2014-04-29 13:07:31, End Time: 2014-04-29 17:45:42 To: 25136, Order: 207521, Start Time: 2014-04-29 12:26:47, End Time: 2014-04-29 17:05:30 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (96 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (994 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0024) SingleSource/UnitTests/AtomicOps: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.13% (0.1240 => 0.1440, std.dev.: 0.0057) SingleSource/Benchmarks/Stanford/Puzzle: 11.11% (0.1080 => 0.1200, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.67% (0.2400 => 0.2560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.56% (1.2801 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.52% (1.3121 => 1.3321, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 17.46% (0.2520 => 0.2960, std.dev.: 0.0140) MultiSource/Benchmarks/BitBench/five11/five11: 1.91% (2.3041 => 2.3481, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.31% (0.4520 => 0.4280, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.4602 => 2.4322, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0038) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.50% (1.1761 => 1.2761, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (10.6960 => 11.5200, std.dev.: 0.0721) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.49% (1.2281 => 1.3201, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.05% (0.6240 => 0.6680, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0382) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.5200 => 1.5920, std.dev.: 0.0240) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0255) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3800 => 1.4400, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.22% (1.7080 => 1.7800, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0225) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0454) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0546) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0092) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.67% (48.1088 => 49.3929, std.dev.: 0.0831) MultiSource/Applications/sqlite3/sqlite3: 2.44% (23.7574 => 24.3375, std.dev.: 0.0441) MultiSource/Applications/JM/lencod/lencod: 2.36% (17.6165 => 18.0325, std.dev.: 0.0712) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0287) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 2.00% (37.0925 => 37.8325, std.dev.: 0.0911) MultiSource/Applications/kimwitu++/kc: 1.91% (18.8170 => 19.1771, std.dev.: 0.0635) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0441) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.30% (5.8400 => 5.9160, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (25.8896 => 26.7337, std.dev.: 0.0400) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0108) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 1.56% (6.6564 => 6.7604, std.dev.: 0.0351) MultiSource/Benchmarks/sim/sim: 1.28% (4.6843 => 4.7443, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.4081 => 1.4241, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/d/make_dparser: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.11% (3.7962 => 3.7162, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.02% (2.9722 => 2.9122, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: -1.17% (1.0241 => 1.0121, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 10:53:09 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 10:53:09 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429175322.65316502584E@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19383 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207552 Blamelist: dexonsmith,dsanders Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 11:15:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 13:15:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429181537.9B6362A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25138?compare_to=25137&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25138, Order: 207523, Start Time: 2014-04-29 13:44:12, End Time: 2014-04-29 18:22:22 To: 25137, Order: 207522, Start Time: 2014-04-29 13:07:31, End Time: 2014-04-29 17:45:42 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (100 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/globalrefs: 133.33% (0.0120 => 0.0280, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-7: 120.00% (0.0200 => 0.0440, std.dev.: 0.0024) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.00% (0.1000 => 0.1200, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.19% (1.2761 => 1.3041, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/d/make_dparser: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-7: 83.33% (0.0240 => 0.0440, std.dev.: 0.0024) SingleSource/Regression/C/globalrefs: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.04% (0.2280 => 0.2600, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.28% (1.2081 => 1.3081, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.69% (1.1441 => 1.2321, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2160 => 0.2320, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0670) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0066) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0164) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0555) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0197) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0283) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (10.4082 => 10.8362, std.dev.: 0.0207) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (4.9000 => 5.0880, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0375) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 2.63% (17.6165 => 18.0805, std.dev.: 0.0535) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.59% (48.1088 => 49.3569, std.dev.: 0.0893) MultiSource/Applications/sqlite3/sqlite3: 2.56% (23.7574 => 24.3655, std.dev.: 0.0255) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0260) MultiSource/Benchmarks/Bullet/bullet: 2.19% (37.0925 => 37.9046, std.dev.: 0.0642) MultiSource/Applications/kimwitu++/kc: 1.98% (18.8170 => 19.1891, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0153) MultiSource/Applications/SPASS/SPASS: 1.12% (17.5484 => 17.7444, std.dev.: 0.0572) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0412) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0117) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.26% (1.0641 => 1.0881, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.04% (3.5322 => 3.6042, std.dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 1.55% (21.1533 => 21.4813, std.dev.: 0.0655) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0024) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0028) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 11:25:36 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 11:25:36 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429182606.BCB685025D48@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19385 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207563 Blamelist: dexonsmith,dsanders,jrose,samsonov BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 11:28:54 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 13:28:54 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429182854.EA8AC2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25139?compare_to=25138&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25139, Order: 207524, Start Time: 2014-04-29 13:54:00, End Time: 2014-04-29 18:35:39 To: 25138, Order: 207523, Start Time: 2014-04-29 13:44:12, End Time: 2014-04-29 18:22:22 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (96 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (991 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct-bitfield-init-1: 200.00% (0.0080 => 0.0240, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/treeadd/treeadd: 44.44% (0.0360 => 0.0520, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 6.06% (0.2640 => 0.2800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.83% (1.3081 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.2480 => 1.2640, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.56% (2.3081 => 2.3441, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/flops-2: -40.00% (0.0400 => 0.0240, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0048) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.00% (0.1000 => 0.1120, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.82% (10.6960 => 11.5320, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.36% (1.1961 => 1.2841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.62% (1.2801 => 1.3521, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0193) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (8.1441 => 8.4641, std.dev.: 0.0570) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0244) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (10.4082 => 10.7762, std.dev.: 0.0283) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0438) MultiSource/Applications/lua/lua: 3.01% (4.5200 => 4.6560, std.dev.: 0.0375) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (2.1201 => 2.1801, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash: 2.65% (0.4520 => 0.4640, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.36% (17.6165 => 18.0325, std.dev.: 0.0533) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1889, std.dev.: 0.1153) MultiSource/Applications/sqlite3/sqlite3: 2.17% (23.7574 => 24.2735, std.dev.: 0.0485) MultiSource/Applications/minisat/minisat: 2.00% (0.8000 => 0.8160, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (7.8562 => 8.0082, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.8322 => 2.8802, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 1.67% (37.0925 => 37.7126, std.dev.: 0.0905) MultiSource/Applications/oggenc/oggenc: 1.45% (5.7964 => 5.8804, std.dev.: 0.0160) MultiSource/Applications/kimwitu++/kc: 1.38% (18.8170 => 19.0770, std.dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.2480 => 1.2640, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 1.09% (17.5484 => 17.7404, std.dev.: 0.0380) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 12.64% (2.8802 => 3.2442, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0493) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.0921 => 1.1201, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.88% (1.0641 => 1.0841, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0118) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.44% (21.1533 => 21.4573, std.dev.: 0.0793) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.35% (10.8967 => 2.0321, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-2: -40.00% (0.0400 => 0.0240, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.07% (4.5603 => 4.4203, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.70% (0.9401 => 0.9241, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 11:40:28 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 11:40:28 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429184040.8DDC95026027@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19386 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207565 Blamelist: emaste,rkotler Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 12:30:46 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 12:30:46 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429193115.3AEAA5026713@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19389 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207570 Blamelist: akirtzidis BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 13:11:33 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 13:11:33 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429201147.5ABF45026C89@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19390 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207573 Blamelist: hans,yjiang Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 13:57:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 15:57:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140429205702.1E6AD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25140?compare_to=25130&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25140, Order: 207538, Start Time: 2014-04-29 16:21:57, End Time: 2014-04-29 21:03:48 To: 25130, Order: 207520, Start Time: 2014-04-29 11:27:48, End Time: 2014-04-29 16:09:54 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 1 (160 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1110 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -10.47% (0.3440 => 0.3080, std.dev.: 0.0139) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2350.00% (0.0320 => 0.7840, std.dev.: 0.0105) SingleSource/Benchmarks/Stanford/Puzzle: 1187.18% (0.1240 => 1.5961, std.dev.: 0.0103) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 989.61% (0.0760 => 0.8281, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: 320.73% (0.2320 => 0.9761, std.dev.: 0.0129) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: 257.14% (0.0280 => 0.1000, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0111) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0053) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0069) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 107.69% (0.1040 => 0.2160, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 80.00% (0.0800 => 0.1440, std.dev.: 0.0047) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0036) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 65.71% (0.1400 => 0.2320, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-2: 55.56% (0.0360 => 0.0560, std.dev.: 0.0057) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/flops-5: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0042) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 46.15% (0.1040 => 0.1520, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: 44.44% (0.0720 => 0.1040, std.dev.: 0.0044) MultiSource/Applications/obsequi/Obsequi: 43.97% (1.3920 => 2.0040, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.50% (0.0960 => 0.1320, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.92% (0.1040 => 0.1320, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.00% (0.0960 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.51% (1.2401 => 1.5441, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: 22.92% (0.1920 => 0.2360, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/n-body: 22.73% (0.0880 => 0.1080, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.33% (1.2001 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.11% (1.1561 => 1.4001, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 21.05% (0.0760 => 0.0920, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.98% (1.1441 => 1.3841, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.85% (1.1321 => 1.3681, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.61% (1.1841 => 1.4281, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.07% (1.1761 => 1.4121, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.72% (1.1361 => 1.3601, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.54% (1.2281 => 1.4681, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.36% (1.1361 => 1.3561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.17% (1.2521 => 1.4921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.10% (1.1521 => 1.3721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 18.92% (1.1841 => 1.4081, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0142) MultiSource/Applications/JM/ldecod/ldecod: 18.56% (8.5802 => 10.1723, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.52% (1.1881 => 1.4081, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.01% (1.2881 => 1.5201, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.18% (1.3841 => 1.6081, std.dev.: 0.0141) MultiSource/Applications/JM/lencod/lencod: 15.33% (19.5406 => 22.5367, std.dev.: 0.0395) SingleSource/Benchmarks/SmallPT/smallpt: 14.71% (0.1360 => 0.1560, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.09% (5.3360 => 6.0881, std.dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.79% (1.7400 => 1.9800, std.dev.: 0.0149) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.10% (0.3360 => 0.3800, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0070) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.00% (0.6800 => 0.7480, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/05-eks/eks: 9.80% (0.6120 => 0.6720, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.15% (5.7280 => 6.2520, std.dev.: 0.0456) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.09% (0.1760 => 0.1920, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 8.99% (11.3843 => 12.4083, std.dev.: 0.0438) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 8.47% (6.2844 => 6.8164, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.42% (11.4440 => 12.4080, std.dev.: 0.0878) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.33% (0.4320 => 0.4680, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.26% (5.6680 => 6.1360, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.35% (9.5802 => 10.1882, std.dev.: 0.0454) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.6240 => 1.7200, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3480 => 0.3680, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.21% (0.7680 => 0.8080, std.dev.: 0.0106) SingleSource/Benchmarks/Linpack/linpack-pc: 5.13% (0.3120 => 0.3280, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 4.96% (1.0480 => 1.1000, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/wc: 4.69% (0.2560 => 0.2680, std.dev.: 0.0045) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.48% (1.3400 => 1.4000, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 4.36% (4.7720 => 4.9800, std.dev.: 0.0335) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (5.3840 => 5.6160, std.dev.: 0.0382) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.22% (6.8280 => 7.1160, std.dev.: 0.0441) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.82% (2.0920 => 2.1720, std.dev.: 0.0199) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.71% (49.1529 => 50.9769, std.dev.: 0.1148) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.6961 => 1.7561, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (1.7600 => 1.8200, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0174) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 3.08% (19.2243 => 19.8164, std.dev.: 0.0598) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.4320 => 1.4760, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (2.2081 => 2.2721, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 2.76% (24.7575 => 25.4415, std.dev.: 0.0470) MultiSource/Applications/kimwitu++/kc: 2.01% (19.7491 => 20.1451, std.dev.: 0.0521) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (2.7282 => 2.7802, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 1.39% (39.0726 => 39.6166, std.dev.: 0.0680) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (6.0124 => 6.0764, std.dev.: 0.0241) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 19.48% (0.9241 => 1.1041, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.45% (1.2401 => 1.4441, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.00% (0.3000 => 0.3240, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.78% (0.2360 => 0.2520, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.35% (0.8281 => 0.8641, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 3.93% (6.8204 => 7.0884, std.dev.: 0.0280) MultiSource/Applications/siod/siod: 3.62% (2.9842 => 3.0922, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 2.06% (1.3601 => 1.3881, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.87% (4.0563 => 4.1323, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (25.4536 => 25.8656, std.dev.: 0.0381) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0141) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.8961 => 1.9161, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.56% (11.0207 => 2.0321, std.dev.: 0.0101) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -19.07% (8.9566 => 7.2485, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.26% (21.6534 => 17.9171, std.dev.: 0.0578) SingleSource/Benchmarks/Linpack/linpack-pc: -16.54% (7.8605 => 6.5604, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0985) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.61% (1.7121 => 1.6161, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9242 => 2.8242, std.dev.: 0.0320) MultiSource/Applications/aha/aha: -2.08% (2.8802 => 2.8202, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.73% (5.0963 => 5.0083, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7643 => 4.6923, std.dev.: 0.0118) MultiSource/Applications/hexxagon/hexxagon: -1.07% (11.5567 => 11.4327, std.dev.: 0.0163) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 13:58:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 15:58:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429205812.870272A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25141?compare_to=25131&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25141, Order: 207538, Start Time: 2014-04-29 16:22:23, End Time: 2014-04-29 21:05:01 To: 25131, Order: 207520, Start Time: 2014-04-29 11:27:23, End Time: 2014-04-29 16:10:24 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 16 (140 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (943 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 10.00% (0.2000 => 0.2200, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 7.58% (0.2640 => 0.2840, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.00% (0.2000 => 0.2120, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.7440 => 0.7840, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 4.20% (0.4760 => 0.4960, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.33% (0.3600 => 0.3720, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.65% (0.4520 => 0.4640, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.01% (1.5881 => 1.6201, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.78% (1.5761 => 1.6041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.21% (1.6481 => 1.6681, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 18.75% (0.0640 => 0.0760, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.69% (0.3640 => 0.3920, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.51% (0.9761 => 1.0201, std.dev.: 0.0147) MultiSource/Applications/obsequi/Obsequi: 2.39% (2.0121 => 2.0601, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (4.3123 => 4.2643, std.dev.: 0.0179) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.09% (29.6979 => 29.3738, std.dev.: 0.0447) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.40% (11.3687 => 3.0242, std.dev.: 0.0149) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0108) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0050) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/mandel-text: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/vla: 50.00% (0.0320 => 0.0480, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-3: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 29.17% (0.0960 => 0.1240, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 28.57% (0.0560 => 0.0720, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 25.00% (0.1760 => 0.2200, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.18% (0.1760 => 0.2080, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.77% (0.1880 => 0.2120, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/08-main/main: 11.90% (0.3360 => 0.3760, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.36% (0.7040 => 0.7840, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.65% (1.1640 => 1.2880, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.17% (0.2360 => 0.2600, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.16% (1.4561 => 1.6041, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: 10.06% (1.8680 => 2.0560, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.4601 => 1.6041, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.55% (1.4241 => 1.5601, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.89% (1.4841 => 1.6161, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 8.77% (0.4560 => 0.4960, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.39% (0.6200 => 0.6720, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.20% (1.0240 => 1.1080, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.7361 => 1.8761, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.01% (1.5481 => 1.6721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (1.7841 => 1.9241, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0103) MultiSource/Applications/spiff/spiff: 7.14% (1.0080 => 1.0800, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.50% (1.4161 => 1.5081, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.49% (6.4680 => 6.8880, std.dev.: 0.0471) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.41% (1.4361 => 1.5281, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.27% (1.4681 => 1.5601, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4600 => 0.4880, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.08% (1.4481 => 1.5361, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.05% (11.6440 => 12.3480, std.dev.: 0.0851) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.97% (0.2680 => 0.2840, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.85% (5.8121 => 6.1521, std.dev.: 0.0284) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.82% (9.4842 => 10.0362, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.77% (1.4561 => 1.5401, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.52% (1.7400 => 1.8360, std.dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.45% (0.2200 => 0.2320, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.38% (1.5600 => 1.6440, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.35% (1.4201 => 1.4961, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.8440 => 1.9400, std.dev.: 0.0251) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.7000 => 0.7360, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (2.0440 => 2.1400, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.30% (2.3281 => 2.4282, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (5.3600 => 5.5880, std.dev.: 0.0421) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.0443 => 10.4683, std.dev.: 0.0305) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0160) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.05% (50.0290 => 52.0570, std.dev.: 0.0722) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.96% (1.3120 => 1.3640, std.dev.: 0.0137) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.7721 => 1.8401, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 3.68% (21.9606 => 22.7688, std.dev.: 0.0563) MultiSource/Applications/lua/lua: 3.68% (4.7880 => 4.9640, std.dev.: 0.0301) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.61% (1.6601 => 1.7201, std.dev.: 0.0105) MultiSource/Applications/oggenc/oggenc: 3.61% (6.9844 => 7.2365, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (6.5440 => 6.7680, std.dev.: 0.0551) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (3.0282 => 3.1242, std.dev.: 0.0136) MultiSource/Applications/ClamAV/clamscan: 3.00% (19.0444 => 19.6164, std.dev.: 0.0554) MultiSource/Applications/SPASS/SPASS: 2.95% (18.4404 => 18.9845, std.dev.: 0.0637) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.83% (6.5080 => 6.6920, std.dev.: 0.0526) MultiSource/Benchmarks/Bullet/bullet: 2.82% (38.4046 => 39.4886, std.dev.: 0.0769) MultiSource/Applications/siod/siod: 2.80% (2.7162 => 2.7922, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (1.7921 => 1.8401, std.dev.: 0.0136) MultiSource/Applications/d/make_dparser: 2.52% (3.9681 => 4.0681, std.dev.: 0.0220) MultiSource/Applications/kimwitu++/kc: 2.48% (19.6891 => 20.1771, std.dev.: 0.0570) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (16.3483 => 16.6923, std.dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.91% (4.1843 => 4.2643, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.58% (2.1401 => 2.4522, std.dev.: 0.0510) MultiSource/Applications/siod/siod: 10.21% (2.8602 => 3.1522, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.89% (0.3600 => 0.3920, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.28% (3.4122 => 3.5242, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0224) MultiSource/Applications/minisat/minisat: 2.46% (6.6684 => 6.8324, std.dev.: 0.0491) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (8.1845 => 8.3605, std.dev.: 0.0415) MultiSource/Applications/sqlite3/sqlite3: 1.71% (3.9842 => 4.0523, std.dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: 1.67% (11.5087 => 11.7007, std.dev.: 0.0170) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.48% (8.1245 => 8.2445, std.dev.: 0.0348) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.91% (10.6247 => 2.0281, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.84% (2.9442 => 0.8880, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.22% (91.8497 => 49.3991, std.dev.: 10.5618) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.86% (50.3031 => 32.7660, std.dev.: 0.2231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.54% (26.0616 => 17.0611, std.dev.: 0.1426) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.19% (42.1466 => 28.5778, std.dev.: 0.3190) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1061) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.41% (0.3400 => 0.3080, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (4.1243 => 4.0403, std.dev.: 0.0138) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (2.3561 => 2.3121, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.1563 => 5.0683, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 14:07:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 16:07:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429210726.114EE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25142?compare_to=25139&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25142, Order: 207539, Start Time: 2014-04-29 16:33:54, End Time: 2014-04-29 21:14:11 To: 25139, Order: 207524, Start Time: 2014-04-29 13:54:00, End Time: 2014-04-29 18:35:39 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (103 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2008-07-13-InlineSetjmp: 300.00% (0.0040 => 0.0160, std.dev.: 0.0026) SingleSource/UnitTests/Vector/sumarray: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3200 => 0.3320, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4920 => 0.5080, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.23% (0.6200 => 0.6400, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 2.50% (1.6001 => 1.6401, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.07% (1.3521 => 1.3801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.24% (1.2921 => 1.3081, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.2401 => 1.2561, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -1.71% (2.3441 => 2.3041, std.dev.: 0.0150) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.43% (0.6640 => 0.7200, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.18% (1.2721 => 1.3761, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.61% (1.1561 => 1.2441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (10.6960 => 11.4720, std.dev.: 0.0722) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (6.0160 => 6.4120, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.95% (0.7400 => 0.7840, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0204) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.33% (0.3000 => 0.3160, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (8.1441 => 8.5281, std.dev.: 0.0336) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0149) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0271) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0219) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4920 => 0.5080, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0451) MultiSource/Applications/sqlite3/sqlite3: 2.46% (23.7574 => 24.3415, std.dev.: 0.0292) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (7.8562 => 8.0482, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.9000 => 5.0160, std.dev.: 0.0415) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.34% (5.8000 => 5.9360, std.dev.: 0.0333) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.25% (48.1088 => 49.1889, std.dev.: 0.0865) MultiSource/Benchmarks/Bullet/bullet: 1.98% (37.0925 => 37.8285, std.dev.: 0.0646) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1211, std.dev.: 0.0451) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0109) MultiSource/Applications/siod/siod: 1.40% (2.5721 => 2.6081, std.dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 1.39% (17.5484 => 17.7924, std.dev.: 0.0385) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 18.02% (0.9321 => 1.1001, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 1.57% (21.1533 => 21.4853, std.dev.: 0.0891) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0093) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0126) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0173) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/mason/mason: -21.05% (0.0760 => 0.0600, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.70% (2.0561 => 1.9801, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0020) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 14:19:36 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 14:19:36 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429212004.7FA41502761D@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19392 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207575 Blamelist: adibiagio BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 14:16:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 16:16:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140429211630.2CB0D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25143?compare_to=25133&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25143, Order: 207542, Start Time: 2014-04-29 16:37:45, End Time: 2014-04-29 21:23:14 To: 25133, Order: 207520, Start Time: 2014-04-29 11:40:38, End Time: 2014-04-29 16:25:14 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 7 (141 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (935 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/ackermann: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.08% (0.2360 => 0.2480, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 4.52% (0.6200 => 0.6480, std.dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 1.89% (0.8480 => 0.8640, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.25% (0.9841 => 1.0161, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/power/power: -13.46% (0.2080 => 0.1800, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.36% (17.6723 => 19.6803, std.dev.: 0.0552) MultiSource/Applications/sqlite3/sqlite3: 1425.18% (1.7001 => 25.9296, std.dev.: 0.0415) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.28% (50.1010 => 52.2450, std.dev.: 0.0685) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.08% (1.0520 => 1.1160, std.dev.: 0.0346) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.53% (11.3920 => 12.3640, std.dev.: 0.0610) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0128) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1120, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0403, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7164, std.dev.: 0.0173) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 320.39% (0.4320 => 1.8161, std.dev.: 0.0052) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Regression/C/2004-03-15-IndirectGoto: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 125.00% (0.0160 => 0.0360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0018) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/callargs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/17-bintr/bintr: 38.89% (0.0720 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.24% (0.1160 => 0.1360, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.67% (0.1440 => 0.1680, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 14.63% (0.3280 => 0.3760, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 14.60% (1.8361 => 2.1041, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.50% (1.8201 => 2.0841, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.44% (1.8281 => 2.0921, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.1120 => 0.1280, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.00% (2.0281 => 2.3121, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.79% (1.8561 => 2.1121, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.73% (1.9521 => 2.2201, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.67% (1.9601 => 2.2281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.59% (1.9721 => 2.2401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.57% (1.9161 => 2.1761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.49% (1.8081 => 2.0521, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.32% (1.8921 => 2.1441, std.dev.: 0.0119) SingleSource/UnitTests/SignlessTypes/rem: 12.90% (0.1240 => 0.1400, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.68% (1.9241 => 2.1681, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.93% (2.1121 => 2.3641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.92% (1.9121 => 2.1401, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.38% (2.1441 => 2.3881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.34% (1.9761 => 2.2001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.14% (1.7961 => 1.9961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.74% (1.9001 => 2.1041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.64% (1.8801 => 2.0801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.63% (1.8441 => 2.0401, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.25% (2.0681 => 2.2801, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.68% (1.8601 => 2.0401, std.dev.: 0.0169) MultiSource/Applications/obsequi/Obsequi: 9.59% (1.8760 => 2.0560, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.45% (1.9481 => 2.1321, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.79% (0.7280 => 0.7920, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/random: 8.62% (0.2320 => 0.2520, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.11% (0.1480 => 0.1600, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.8881 => 0.9561, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (6.4800 => 6.8920, std.dev.: 0.0428) MultiSource/Applications/hexxagon/hexxagon: 6.01% (1.1320 => 1.2000, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hello: 5.77% (0.2080 => 0.2200, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0256) MultiSource/Applications/Burg/burg: 5.24% (1.5280 => 1.6080, std.dev.: 0.0129) MultiSource/Applications/sgefa/sgefa: 5.19% (0.6160 => 0.6480, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.03% (1.7480 => 1.8360, std.dev.: 0.0243) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (2.9721 => 3.1202, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (1.6960 => 1.7800, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3600 => 0.3760, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (9.6042 => 10.0282, std.dev.: 0.0465) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.8280 => 0.8640, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (5.8281 => 6.0801, std.dev.: 0.0366) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (5.3960 => 5.6240, std.dev.: 0.0412) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.11% (2.3401 => 2.4362, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.09% (1.6641 => 1.7321, std.dev.: 0.0072) MultiSource/Applications/treecc/treecc: 4.02% (2.5880 => 2.6920, std.dev.: 0.0146) MultiSource/Applications/lua/lua: 4.01% (4.7920 => 4.9840, std.dev.: 0.0322) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (10.2283 => 10.6284, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (2.1240 => 2.1960, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (1.0840 => 1.1200, std.dev.: 0.0115) MultiSource/Applications/minisat/minisat: 3.30% (0.8480 => 0.8760, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 3.22% (18.5284 => 19.1245, std.dev.: 0.0407) MultiSource/Applications/oggenc/oggenc: 3.18% (7.0524 => 7.2765, std.dev.: 0.0156) MultiSource/Benchmarks/Bullet/bullet: 3.14% (38.6366 => 39.8486, std.dev.: 0.0706) MultiSource/Applications/d/make_dparser: 3.02% (3.9761 => 4.0961, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (16.3003 => 16.7803, std.dev.: 0.0546) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (6.5360 => 6.7280, std.dev.: 0.0380) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.78% (2.1600 => 2.2200, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.63% (6.5320 => 6.7040, std.dev.: 0.0489) MultiSource/Applications/JM/lencod/lencod: 2.56% (22.2206 => 22.7887, std.dev.: 0.0716) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (4.2243 => 4.3203, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 2.24% (1.7841 => 1.8241, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 2.18% (19.8291 => 20.2611, std.dev.: 0.0605) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.30% (6.1484 => 6.2284, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 21.21% (0.9241 => 1.1201, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.99% (2.1201 => 2.4802, std.dev.: 0.0362) MultiSource/Applications/siod/siod: 9.78% (2.8642 => 3.1442, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.56% (0.7200 => 0.7600, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0131) MultiSource/Applications/minisat/minisat: 3.58% (6.5964 => 6.8324, std.dev.: 0.0354) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0109) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (4.0003 => 4.0763, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.64% (11.4967 => 11.6847, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9684 => 6.0604, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 1.53% (8.1285 => 8.2525, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.19% (5.0243 => 5.0843, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5881 => 1.0561, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.12% (94.8339 => 49.1951, std.dev.: 9.4134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.03% (49.9431 => 32.9461, std.dev.: 0.1826) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.88% (25.7136 => 17.0011, std.dev.: 0.1264) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.31% (3.0722 => 2.3561, std.dev.: 0.1025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.39% (37.0863 => 28.7818, std.dev.: 0.5690) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.15% (1.2681 => 1.1521, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -5.96% (2.7522 => 2.5882, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -2.02% (5.1563 => 5.0523, std.dev.: 0.0269) MultiSource/Benchmarks/BitBench/five11/five11: -1.70% (2.3521 => 2.3121, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.58% (4.8043 => 4.7283, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 14:24:47 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 16:24:47 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140429212447.43EDE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25144?compare_to=25134&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25144, Order: 207547, Start Time: 2014-04-29 16:45:21, End Time: 2014-04-29 21:31:32 To: 25134, Order: 207520, Start Time: 2014-04-29 11:46:08, End Time: 2014-04-29 16:32:39 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1095 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ConditionalExpr: 200.00% (0.0080 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C++/fixups: 133.33% (0.0120 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/methcall: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/FloatMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/mst/mst: 31.03% (0.1160 => 0.1520, std.dev.: 0.0108) SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.70% (0.1840 => 0.2000, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.3480 => 0.3760, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.90% (0.2320 => 0.2480, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2000 => 0.2120, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 2.12% (0.7560 => 0.7720, std.dev.: 0.0047) SingleSource/Benchmarks/Stanford/Puzzle: 1.54% (1.8201 => 1.8481, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.06% (0.7120 => 0.7480, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.73% (0.7280 => 0.5480, std.dev.: 0.0115) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 14:37:14 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 14:37:14 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429213726.5EAFF50278BB@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19393 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207576 Blamelist: adibiagio Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 14:44:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 16:44:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140429214405.6C58B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25145?compare_to=25135&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25145, Order: 207549, Start Time: 2014-04-29 17:02:20, End Time: 2014-04-29 21:50:51 To: 25135, Order: 207520, Start Time: 2014-04-29 11:54:11, End Time: 2014-04-29 16:41:51 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (139 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (933 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/NP/np: 400.00% (0.0040 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/2005-07-17-INT-To-FP: 150.00% (0.0080 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Oscar: 17.65% (0.0680 => 0.0800, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 13.46% (0.2080 => 0.2360, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.42% (0.1920 => 0.2120, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.40% (2.0001 => 2.0281, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.20% (0.9441 => 1.0121, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0761 => 1.0881, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0133) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0050) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 23.81% (0.0840 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.75% (1.6961 => 2.0481, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.34% (0.2360 => 0.2840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.05% (1.6761 => 2.0121, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.95% (1.7641 => 2.1161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.86% (1.7321 => 2.0761, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.86% (1.6921 => 2.0281, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.77% (1.7201 => 2.0601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.72% (1.7441 => 2.0881, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.66% (1.6681 => 1.9961, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.57% (1.6961 => 2.0281, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.52% (1.6801 => 2.0081, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.49% (1.7241 => 2.0601, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.25% (1.8081 => 2.1561, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.07% (1.8881 => 2.2481, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.79% (1.7241 => 2.0481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.78% (1.7681 => 2.1001, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.71% (1.9881 => 2.3601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.30% (1.7921 => 2.1201, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.24% (1.9081 => 2.2561, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.16% (1.8281 => 2.1601, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.02% (1.8201 => 2.1481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0132) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.21% (1.9761 => 2.3161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.17% (1.9801 => 2.3201, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 15.09% (0.2120 => 0.2440, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.07% (0.6120 => 0.6920, std.dev.: 0.0226) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1880 => 0.2120, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) SingleSource/Benchmarks/SmallPT/smallpt: 8.33% (0.1440 => 0.1560, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.33% (0.1920 => 0.2080, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2080 => 0.2240, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0189) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (3.5002 => 3.7522, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.50% (1.4160 => 1.5080, std.dev.: 0.0113) SingleSource/Benchmarks/Linpack/linpack-pc: 6.33% (0.3160 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.7200 => 7.1400, std.dev.: 0.0556) MultiSource/Applications/SIBsim4/SIBsim4: 6.19% (1.6801 => 1.7841, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.8601 => 0.9121, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.00% (2.0680 => 2.1920, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.77% (11.7880 => 12.4680, std.dev.: 0.0898) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 5.68% (4.7920 => 5.0640, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.56% (0.7200 => 0.7600, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.4360 => 0.4600, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.6120 => 0.6440, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: 4.88% (0.4920 => 0.5160, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/bigfib: 4.86% (0.7400 => 0.7760, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (9.9842 => 10.4482, std.dev.: 0.0496) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.8201 => 1.9001, std.dev.: 0.0139) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.35% (0.6440 => 0.6720, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 4.34% (6.9124 => 7.2124, std.dev.: 0.0184) MultiSource/Applications/d/make_dparser: 4.34% (3.9641 => 4.1361, std.dev.: 0.0168) MultiSource/Benchmarks/sim/sim: 4.04% (0.3960 => 0.4120, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 3.97% (2.6200 => 2.7240, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (1.0001 => 1.0361, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.1440 => 1.1840, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.46% (1.7320 => 1.7920, std.dev.: 0.0224) MultiSource/Applications/JM/ldecod/ldecod: 3.45% (10.3203 => 10.6764, std.dev.: 0.0385) MultiSource/Applications/SPASS/SPASS: 3.35% (18.4924 => 19.1126, std.dev.: 0.0353) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (5.5480 => 5.7320, std.dev.: 0.0408) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (6.8321 => 7.0561, std.dev.: 0.0488) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.25% (0.4920 => 0.5080, std.dev.: 0.0043) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.18% (51.1089 => 52.7329, std.dev.: 0.0864) MultiSource/Applications/JM/lencod/lencod: 3.01% (22.6287 => 23.3088, std.dev.: 0.0332) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.92% (1.3720 => 1.4120, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 2.80% (19.7371 => 20.2891, std.dev.: 0.0514) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (3.0122 => 3.0962, std.dev.: 0.0110) MultiSource/Applications/ClamAV/clamscan: 2.71% (20.2445 => 20.7925, std.dev.: 0.0457) MultiSource/Benchmarks/Bullet/bullet: 2.22% (38.9366 => 39.8006, std.dev.: 0.0846) MultiSource/Applications/sqlite3/sqlite3: 2.02% (25.1895 => 25.6976, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.2203 => 4.3003, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (16.5963 => 16.8763, std.dev.: 0.0660) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.66% (6.0244 => 6.1244, std.dev.: 0.0152) MultiSource/Applications/lemon/lemon: 1.61% (1.4921 => 1.5161, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (2.7722 => 2.8162, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.41% (2.2721 => 2.3041, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 18.96% (0.9281 => 1.1041, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.67% (1.2681 => 1.4161, std.dev.: 0.0215) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 3.64% (6.8204 => 7.0684, std.dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (4.2443 => 4.3483, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.49% (1.0721 => 1.0881, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9604 => 6.0444, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.36% (4.1323 => 4.1883, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (1.2921 => 1.3081, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (4.2403 => 4.2843, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0135) SingleSource/UnitTests/Vector/constpool: -81.45% (10.9087 => 2.0241, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.69% (1.5881 => 1.1801, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: -24.74% (0.7600 => 0.5720, std.dev.: 0.0084) MultiSource/Applications/obsequi/Obsequi: -21.00% (2.6481 => 2.0920, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.53% (7.4801 => 6.2440, std.dev.: 0.0328) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.57% (7.5041 => 6.3360, std.dev.: 0.0410) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -2.75% (13.5243 => 13.1523, std.dev.: 0.0310) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.86% (21.6534 => 17.7851, std.dev.: 0.0716) SingleSource/Benchmarks/Linpack/linpack-pc: -15.23% (7.8005 => 6.6124, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.90% (2.6082 => 2.3761, std.dev.: 0.0891) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0086) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.70% (2.9202 => 2.8122, std.dev.: 0.0213) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.66% (0.3280 => 0.3160, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -3.57% (2.9122 => 2.8082, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (5.1603 => 5.0043, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.8002 => 3.7082, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.98% (2.6202 => 2.5682, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: -1.88% (8.3085 => 8.1525, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.43% (4.7603 => 4.6923, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0095) MultiSource/Benchmarks/sim/sim: -1.04% (4.9883 => 4.9363, std.dev.: 0.0131) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 14:56:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 16:56:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429215639.485632A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25146?compare_to=25142&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25146, Order: 207555, Start Time: 2014-04-29 17:25:55, End Time: 2014-04-29 22:03:20 To: 25142, Order: 207539, Start Time: 2014-04-29 16:33:54, End Time: 2014-04-29 21:14:11 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 17 (102 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Quicksort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) SingleSource/UnitTests/initp1: 27.27% (0.0440 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.00% (0.1000 => 0.1200, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.75% (0.0640 => 0.0760, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.22% (0.1480 => 0.1720, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.68% (1.0600 => 1.1520, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.3200 => 0.3400, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.9481 => 0.9681, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (1.2441 => 1.2681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.90% (1.2641 => 1.2881, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: 2.76% (0.5800 => 0.5960, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: 2.16% (1.2961 => 1.3241, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/five11/five11: 1.91% (2.3041 => 2.3481, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/chomp: 1.45% (1.1001 => 1.1161, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -7.87% (0.5080 => 0.4680, std.dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0073) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0076) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0208) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 10.20% (0.1960 => 0.2160, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.96% (1.1241 => 1.2361, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.12% (1.1841 => 1.2921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.77% (1.1841 => 1.2761, std.dev.: 0.0154) MultiSource/Applications/sgefa/sgefa: 7.07% (0.3960 => 0.4240, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0791) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.3200 => 0.3400, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 5.83% (0.4120 => 0.4360, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.49% (1.0920 => 1.1520, std.dev.: 0.0200) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0105) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0340) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0224) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (8.1441 => 8.4801, std.dev.: 0.0627) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 3.80% (0.9480 => 0.9840, std.dev.: 0.0098) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.1201 => 2.1961, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0338) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0303) MultiSource/Applications/JM/lencod/lencod: 2.88% (17.6165 => 18.1245, std.dev.: 0.0348) MultiSource/Applications/sqlite3/sqlite3: 2.85% (23.7574 => 24.4335, std.dev.: 0.0335) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.69% (48.1088 => 49.4049, std.dev.: 0.0502) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (5.8000 => 5.9520, std.dev.: 0.0521) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0229) MultiSource/Applications/kimwitu++/kc: 2.08% (18.8170 => 19.2091, std.dev.: 0.0230) MultiSource/Benchmarks/Bullet/bullet: 1.96% (37.0925 => 37.8205, std.dev.: 0.1194) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.92% (5.8400 => 5.9520, std.dev.: 0.0335) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0163) MultiSource/Applications/SPASS/SPASS: 1.48% (17.5484 => 17.8084, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (0.9561 => 0.9681, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0292) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.80% (6.6564 => 6.7764, std.dev.: 0.0344) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.0643 => 4.1243, std.dev.: 0.0130) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -81.31% (10.8967 => 2.0361, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 15:09:25 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 15:09:25 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429220938.7E06E5027D97@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19395 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207579 Blamelist: samsonov Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 15:38:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 17:38:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429223828.77B1A2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25147?compare_to=25146&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25147, Order: 207563, Start Time: 2014-04-29 18:05:45, End Time: 2014-04-29 22:45:13 To: 25146, Order: 207555, Start Time: 2014-04-29 17:25:55, End Time: 2014-04-29 22:03:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 16 (113 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-22-LocalTypeTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C/DuffsDevice: 100.00% (0.0160 => 0.0320, std.dev.: 0.0027) SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/hash: 30.77% (0.0520 => 0.0680, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 30.00% (0.0400 => 0.0520, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.81% (0.0840 => 0.1040, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/distray/distray: 14.29% (0.1120 => 0.1280, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 5.98% (0.4680 => 0.4960, std.dev.: 0.0062) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.32% (1.2040 => 1.2560, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.19% (1.2761 => 1.3041, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7880 => 0.8040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.80% (1.3361 => 1.3601, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.79% (1.3401 => 1.3641, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 7.21% (0.4440 => 0.4760, std.dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0054) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3680 => 0.4120, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.53% (0.2280 => 0.2520, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (6.0160 => 6.4560, std.dev.: 0.0371) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (10.6960 => 11.4440, std.dev.: 0.0717) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.67% (0.3000 => 0.3200, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.85% (1.3681 => 1.4481, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.2880 => 0.3040, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.3760 => 1.4480, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.86% (0.7400 => 0.7760, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (4.9200 => 5.1560, std.dev.: 0.0347) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.9200 => 0.9640, std.dev.: 0.0121) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (8.1441 => 8.5001, std.dev.: 0.0488) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 3.11% (17.6165 => 18.1645, std.dev.: 0.0372) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0382) MultiSource/Applications/sqlite3/sqlite3: 3.00% (23.7574 => 24.4695, std.dev.: 0.0501) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.86% (48.1088 => 49.4849, std.dev.: 0.1028) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (4.9000 => 5.0200, std.dev.: 0.0366) MultiSource/Benchmarks/Bullet/bullet: 2.35% (37.0925 => 37.9646, std.dev.: 0.0695) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (7.8562 => 8.0202, std.dev.: 0.0568) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7880 => 0.8040, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 2.00% (18.8170 => 19.1931, std.dev.: 0.0491) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0147) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0176) MultiSource/Applications/SPASS/SPASS: 1.39% (17.5484 => 17.7924, std.dev.: 0.0420) MultiSource/Applications/ClamAV/clamscan: 1.24% (17.4082 => 17.6242, std.dev.: 0.0422) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0196) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (25.8896 => 26.7377, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0024) MultiSource/Applications/obsequi/Obsequi: 1.74% (2.0681 => 2.1041, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 1.46% (21.1533 => 21.4613, std.dev.: 0.1145) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0303) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 15:45:13 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 15:45:13 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429224527.8063850282DB@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19397 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207581 Blamelist: dblaikie BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 16:00:49 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 16:00:49 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429230101.B6BF7502859F@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19398 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207582 Blamelist: rafael Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 16:16:16 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 16:16:16 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140429231645.E846650287A0@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19399 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207585 Blamelist: grosbach BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 16:10:05 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 18:10:05 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429231005.751CF2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25148?compare_to=25147&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25148, Order: 207565, Start Time: 2014-04-29 18:37:38, End Time: 2014-04-29 23:16:49 To: 25147, Order: 207563, Start Time: 2014-04-29 18:05:45, End Time: 2014-04-29 22:45:13 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (105 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (984 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 200.00% (0.0080 => 0.0240, std.dev.: 0.0028) SingleSource/Regression/C++/EH/recursive-throw: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 9.09% (0.2200 => 0.2400, std.dev.: 0.0069) SingleSource/Benchmarks/SmallPT/smallpt: 8.57% (0.1400 => 0.1520, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.04% (0.3960 => 0.4120, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.96% (1.2241 => 1.2481, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.91% (1.2361 => 1.2721, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0062) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0153) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 12.00% (0.1000 => 0.1120, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0092) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (6.0160 => 6.4640, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.30% (1.2601 => 1.3521, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (10.6960 => 11.4600, std.dev.: 0.0583) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.41% (0.6240 => 0.6640, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (1.7360 => 1.8280, std.dev.: 0.0188) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0172) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (8.1441 => 8.5121, std.dev.: 0.0571) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0360) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.9200 => 0.9600, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0171) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0568) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.93% (1.2200 => 1.2680, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (10.4082 => 10.7882, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.8322 => 2.9162, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 2.82% (17.6165 => 18.1125, std.dev.: 0.0436) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.68% (48.1088 => 49.3969, std.dev.: 0.0990) MultiSource/Applications/sqlite3/sqlite3: 2.58% (23.7574 => 24.3695, std.dev.: 0.0432) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (7.8562 => 8.0562, std.dev.: 0.0291) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.41% (5.8000 => 5.9400, std.dev.: 0.0428) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0397) MultiSource/Benchmarks/Bullet/bullet: 2.10% (37.0925 => 37.8726, std.dev.: 0.0716) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (4.0122 => 4.0883, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 1.85% (18.8170 => 19.1651, std.dev.: 0.0676) MultiSource/Applications/SPASS/SPASS: 1.66% (17.5484 => 17.8404, std.dev.: 0.0257) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0219) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 1.10% (17.4082 => 17.6002, std.dev.: 0.0576) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 18.02% (0.9321 => 1.1001, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0674) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (25.8896 => 26.7737, std.dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (2.5602 => 2.5962, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 1.40% (21.1533 => 21.4493, std.dev.: 0.0625) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0201) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0163) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/mason/mason: -21.05% (0.0760 => 0.0600, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.6080 => 0.5800, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 16:25:24 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 18:25:24 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140429232524.DF7D82A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25149?compare_to=25148&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25149, Order: 207567, Start Time: 2014-04-29 18:50:47, End Time: 2014-04-29 23:32:09 To: 25148, Order: 207565, Start Time: 2014-04-29 18:37:38, End Time: 2014-04-29 23:16:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 4 (102 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1108 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.69% (0.3640 => 0.3920, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.5120 => 0.5320, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 9.94% (1.2881 => 1.4161, std.dev.: 0.0303) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.49% (3.9002 => 4.0363, std.dev.: 0.0432) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.43% (0.2800 => 0.3120, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.69% (1.1601 => 1.2841, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.24% (0.6640 => 0.7320, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.61% (1.2481 => 1.3681, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.22% (1.1281 => 1.2321, std.dev.: 0.0149) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.39% (1.2401 => 1.3441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (10.6960 => 11.5200, std.dev.: 0.0380) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.65% (6.0160 => 6.4760, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 5.04% (4.9200 => 5.1680, std.dev.: 0.0240) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (1.3760 => 1.4440, std.dev.: 0.0239) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (8.1441 => 8.4921, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/football/football: 4.22% (0.9480 => 0.9880, std.dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0258) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.9000 => 5.0600, std.dev.: 0.0407) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.03% (5.8000 => 5.9760, std.dev.: 0.0511) MultiSource/Applications/Burg/burg: 3.01% (1.4600 => 1.5040, std.dev.: 0.0157) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0469) MultiSource/Applications/sqlite3/sqlite3: 2.91% (23.7574 => 24.4495, std.dev.: 0.0202) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (7.8562 => 8.0802, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.75% (0.4360 => 0.4480, std.dev.: 0.0039) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.72% (48.1088 => 49.4170, std.dev.: 0.0730) MultiSource/Applications/hbd/hbd: 2.62% (1.6800 => 1.7240, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 2.36% (37.0925 => 37.9686, std.dev.: 0.0484) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 2.17% (18.8170 => 19.2251, std.dev.: 0.0367) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0112) MultiSource/Applications/SPASS/SPASS: 1.44% (17.5484 => 17.8004, std.dev.: 0.0513) MultiSource/Benchmarks/PAQ8p/paq8p: 1.24% (2.5882 => 2.6202, std.dev.: 0.0119) MultiSource/Applications/ClamAV/clamscan: 1.06% (17.4082 => 17.5922, std.dev.: 0.0536) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.5040 => 0.5360, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0291) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (2.5602 => 2.6082, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.78% (4.5043 => 4.5843, std.dev.: 0.0279) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.28% (4.6843 => 4.7443, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (5.0123 => 5.0723, std.dev.: 0.0182) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -10.00% (0.1200 => 0.1080, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 16:45:28 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 16:45:28 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140429234545.08C7B5028D98@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19400 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207592 Blamelist: tstellar Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 16:59:29 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 16:59:29 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430000007.9BD035028FF6@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19401 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207593 Blamelist: d0k BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 18:28:36 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 18:28:36 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430012848.CFECB5029C5C@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building lldb. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19404 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207600 Blamelist: jmolenda Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 18:41:50 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 18:41:50 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430014256.4048D5029E30@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19405 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207601 Blamelist: chandlerc BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 19:02:26 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 21:02:26 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140430020226.E8E012A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25150?compare_to=25141&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25150, Order: 207577, Start Time: 2014-04-29 21:26:32, End Time: 2014-04-30 02:09:13 To: 25141, Order: 207538, Start Time: 2014-04-29 16:22:23, End Time: 2014-04-29 21:05:01 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 15 (153 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (927 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-05-CastFPToUint: 133.33% (0.0120 => 0.0280, std.dev.: 0.0030) SingleSource/UnitTests/Threads/tls: 133.33% (0.0120 => 0.0280, std.dev.: 0.0027) SingleSource/UnitTests/2002-05-02-CastTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 38.10% (0.0840 => 0.1160, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/distray/distray: 9.38% (0.1280 => 0.1400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.94% (1.0161 => 1.0561, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 3.23% (0.3720 => 0.3840, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.79% (1.5601 => 1.5881, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.67% (1.6721 => 1.7001, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 1.60% (1.4961 => 1.5201, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.31% (1.5241 => 1.5441, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (4.2643 => 4.3083, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.39% (3.5082 => 3.5922, std.dev.: 0.0289) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.86% (1.2921 => 1.3161, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -4.62% (1.3841 => 1.3201, std.dev.: 0.0122) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.33% (11.3687 => 3.0322, std.dev.: 0.0115) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0106) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-29-ScalarReplBug: 400.00% (0.0040 => 0.0200, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4600 => 1.8401, std.dev.: 0.0082) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/2002-10-12-StructureArgs: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0016) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0200 => 0.0400, std.dev.: 0.0054) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0031) SingleSource/Regression/C/2003-05-21-UnionBitfields: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0030) SingleSource/Regression/C/sumarray2d: 66.67% (0.0240 => 0.0400, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/dt: 26.67% (0.0600 => 0.0760, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 26.32% (0.0760 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 25.00% (0.0960 => 0.1200, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.18% (0.2920 => 0.3480, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 18.18% (0.0880 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (1.0240 => 1.2080, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 15.91% (0.1760 => 0.2040, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.19% (0.3640 => 0.4120, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.52% (1.4241 => 1.5881, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.11% (0.1800 => 0.2000, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.11% (0.2520 => 0.2800, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.84% (0.3320 => 0.3680, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.77% (1.5601 => 1.7281, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.71% (0.1120 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 10.71% (0.3360 => 0.3720, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: 10.30% (0.6600 => 0.7280, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.00% (1.4401 => 1.5841, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.97% (1.1640 => 1.2800, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.82% (1.5481 => 1.7001, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.80% (0.2040 => 0.2240, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (1.5521 => 1.7041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.61% (1.4561 => 1.5961, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/distray/distray: 9.38% (0.1280 => 0.1400, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.09% (1.4961 => 1.6321, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.73% (1.4201 => 1.5441, std.dev.: 0.0072) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: 8.57% (1.8680 => 2.0280, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.30% (1.7841 => 1.9321, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.11% (1.7761 => 1.9201, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.95% (0.7040 => 0.7600, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.94% (1.6121 => 1.7401, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4801 => 1.5961, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.53% (1.1160 => 1.2000, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.46% (1.4481 => 1.5561, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.44% (1.6121 => 1.7321, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.14% (1.4561 => 1.5601, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (6.4680 => 6.9280, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 6.85% (0.5840 => 0.6240, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.58% (1.5201 => 1.6201, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (1.4640 => 1.5600, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 6.36% (0.4400 => 0.4680, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (11.6440 => 12.3720, std.dev.: 0.0463) MultiSource/Benchmarks/FreeBench/neural/neural: 6.12% (0.1960 => 0.2080, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.8440 => 1.9560, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.99% (9.4842 => 10.0522, std.dev.: 0.0509) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.97% (0.2680 => 0.2840, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.4840 => 0.5120, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.75% (1.7401 => 1.8401, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (5.8121 => 6.1321, std.dev.: 0.0377) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.31% (0.9800 => 1.0320, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.18% (1.4681 => 1.5441, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.7000 => 0.7360, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (1.5600 => 1.6400, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.7400 => 1.8280, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/gs/gs: 4.93% (5.3600 => 5.6240, std.dev.: 0.0336) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (10.0443 => 10.5283, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.65% (0.3440 => 0.3600, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.1280 => 1.1800, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: 4.54% (21.9606 => 22.9568, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.7721 => 1.8481, std.dev.: 0.0132) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.14% (50.0290 => 52.1010, std.dev.: 0.1289) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.10% (1.6601 => 1.7281, std.dev.: 0.0127) MultiSource/Applications/oggenc/oggenc: 4.07% (6.9844 => 7.2685, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (1.7320 => 1.8000, std.dev.: 0.0133) MultiSource/Applications/lua/lua: 3.76% (4.7880 => 4.9680, std.dev.: 0.0315) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.9681 => 1.0041, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.72% (2.0440 => 2.1200, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0090) MultiSource/Applications/SPASS/SPASS: 3.58% (18.4404 => 19.1005, std.dev.: 0.0432) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 3.53% (38.4046 => 39.7606, std.dev.: 0.0589) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.53% (1.0201 => 1.0561, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (6.5440 => 6.7680, std.dev.: 0.0456) MultiSource/Applications/treecc/treecc: 3.41% (2.5840 => 2.6720, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.26% (6.5080 => 6.7200, std.dev.: 0.0583) MultiSource/Applications/ClamAV/clamscan: 3.26% (19.0444 => 19.6644, std.dev.: 0.0562) MultiSource/Applications/d/make_dparser: 3.02% (3.9681 => 4.0881, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (4.1843 => 4.3083, std.dev.: 0.0121) MultiSource/Applications/kimwitu++/kc: 2.66% (19.6891 => 20.2131, std.dev.: 0.0519) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (16.3483 => 16.7723, std.dev.: 0.0472) MultiSource/Applications/minisat/minisat: 2.33% (0.8600 => 0.8800, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 2.15% (1.4881 => 1.5201, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 1.71% (25.6856 => 26.1256, std.dev.: 0.0239) MultiSource/Benchmarks/mafft/pairlocalalign: 1.01% (13.0563 => 13.1883, std.dev.: 0.0406) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 27.27% (0.9241 => 1.1761, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.33% (2.1401 => 2.4682, std.dev.: 0.0411) MultiSource/Applications/siod/siod: 9.93% (2.8602 => 3.1442, std.dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0303) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0275) MultiSource/Applications/minisat/minisat: 2.22% (6.6684 => 6.8164, std.dev.: 0.0438) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (3.9922 => 4.0803, std.dev.: 0.0266) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.10% (8.1845 => 8.3565, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 1.81% (3.9842 => 4.0563, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.63% (11.5087 => 11.6967, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.33% (8.1245 => 8.2325, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.02% (10.6247 => 2.0161, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.35% (91.8497 => 49.2791, std.dev.: 10.4140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.70% (50.3031 => 32.8461, std.dev.: 0.2207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.52% (26.0616 => 17.0651, std.dev.: 0.0996) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.37% (42.1466 => 28.5058, std.dev.: 0.3450) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.55% (3.1122 => 2.3481, std.dev.: 0.1049) SingleSource/UnitTests/Vector/multiplies: -19.81% (1.6961 => 1.3601, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.09% (1.2481 => 1.1721, std.dev.: 0.0210) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.88% (0.3400 => 0.3200, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: -4.62% (1.3841 => 1.3201, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: -2.21% (2.3561 => 2.3041, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.70% (2.8202 => 2.7722, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.14% (1.4041 => 1.3881, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 19:10:35 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 21:10:35 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430021035.7294F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25151?compare_to=25149&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25151, Order: 207578, Start Time: 2014-04-29 21:35:27, End Time: 2014-04-30 02:17:21 To: 25149, Order: 207567, Start Time: 2014-04-29 18:50:47, End Time: 2014-04-29 23:32:09 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (105 on baseline) Performance Improvements: 3 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1091 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/UnitTests/2002-12-13-MishaTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0160 => 0.0320, std.dev.: 0.0051) SingleSource/Regression/C/test_indvars: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/family/family: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Regression/C/bigstack: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.00% (0.0800 => 0.0960, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.92% (1.2321 => 1.2681, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.59% (0.4640 => 0.4760, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.16% (0.9241 => 0.9441, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.55% (8.4921 => 8.6241, std.dev.: 0.0329) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.29% (15.2042 => 15.4002, std.dev.: 0.0418) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.75% (0.3200 => 0.3320, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.98% (5.4443 => 5.5523, std.dev.: 0.0395) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.1121 => 1.1241, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -3.02% (5.1680 => 5.0120, std.dev.: 0.0571) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/oggenc/oggenc: -8.33% (0.1440 => 0.1320, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -4.50% (1.3321 => 1.2721, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0051) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0133) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0136) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (1.1361 => 1.2321, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (6.0160 => 6.4640, std.dev.: 0.0357) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (10.6960 => 11.4760, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.19% (1.2801 => 1.3721, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.89% (8.1441 => 8.6241, std.dev.: 0.0329) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0285) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0282) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.8000 => 6.0080, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (1.7360 => 1.7960, std.dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.7080 => 1.7640, std.dev.: 0.0183) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (7.8562 => 8.1042, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0715) MultiSource/Applications/sqlite3/sqlite3: 2.93% (23.7574 => 24.4535, std.dev.: 0.0347) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.92% (48.1088 => 49.5130, std.dev.: 0.0858) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 2.46% (37.0925 => 38.0046, std.dev.: 0.0519) MultiSource/Applications/treecc/treecc: 2.45% (2.4480 => 2.5080, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (5.8400 => 5.9640, std.dev.: 0.0283) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 2.08% (18.8170 => 19.2091, std.dev.: 0.0576) MultiSource/Applications/oggenc/oggenc: 1.86% (5.7964 => 5.9044, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 1.57% (17.5484 => 17.8244, std.dev.: 0.0327) MultiSource/Applications/ClamAV/clamscan: 1.31% (17.4082 => 17.6362, std.dev.: 0.0588) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (15.2282 => 15.4002, std.dev.: 0.0418) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 20.60% (0.9321 => 1.1241, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/strcat: 9.38% (0.1280 => 0.1400, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (25.8896 => 26.7817, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 1.38% (21.1533 => 21.4453, std.dev.: 0.0676) MultiSource/Benchmarks/sim/sim: 1.28% (4.6843 => 4.7443, std.dev.: 0.0165) MultiSource/Applications/lambda-0_1_3/lambda: 1.28% (5.0123 => 5.0763, std.dev.: 0.0191) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0547) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/power/power: -5.07% (1.3401 => 1.2721, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0302) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.72% (4.5603 => 4.4363, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 19:23:52 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 21:23:52 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140430022352.ACB4F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25152?compare_to=25143&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25152, Order: 207578, Start Time: 2014-04-29 21:44:52, End Time: 2014-04-30 02:30:41 To: 25143, Order: 207542, Start Time: 2014-04-29 16:37:45, End Time: 2014-04-29 21:23:14 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (146 on baseline) Performance Improvements: 3 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (928 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-09-ArrayResolution: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0030) SingleSource/Regression/C/globalrefs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.87% (0.1840 => 0.2040, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.73% (6.7040 => 6.8200, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.34% (2.3881 => 2.4202, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.33% (2.1121 => 2.1401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.29% (2.1681 => 2.1961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (2.1761 => 2.2041, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.15% (2.0921 => 2.1161, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.07% (1.1201 => 1.1321, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/EH/recursive-throw: -71.43% (0.0280 => 0.0080, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (6.2284 => 6.1564, std.dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -4.62% (1.3841 => 1.3201, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.88% (17.6723 => 19.7723, std.dev.: 0.0568) MultiSource/Applications/sqlite3/sqlite3: 1432.24% (1.7001 => 26.0496, std.dev.: 0.0468) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.18% (50.1010 => 52.1970, std.dev.: 0.0979) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.0520 => 1.0800, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.71% (11.3920 => 12.3840, std.dev.: 0.0865) SingleSource/Benchmarks/Misc/oourafft: -73.16% (11.3407 => 3.0442, std.dev.: 0.0059) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1040, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0643, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7044, std.dev.: 0.0201) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0363) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-23-TransparentUnion: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: 50.00% (0.0240 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Quicksort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.33% (0.0720 => 0.0960, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-6: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.22% (0.1440 => 0.1760, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.75% (0.1920 => 0.2280, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.75% (1.8281 => 2.1161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.47% (1.8361 => 2.1201, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.38% (0.4160 => 0.4800, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.30% (1.8561 => 2.1401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.16% (1.8201 => 2.0961, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.03% (1.9161 => 2.2041, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.80% (2.1361 => 2.4522, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/mst/mst: 14.71% (0.1360 => 0.1560, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.62% (1.8601 => 2.1321, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.49% (1.9601 => 2.2441, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.38% (1.8081 => 2.0681, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.14% (1.9241 => 2.1961, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.93% (1.9521 => 2.2241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.86% (1.8761 => 2.1361, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.81% (2.0281 => 2.3081, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.16% (0.3040 => 0.3440, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.11% (1.8921 => 2.1401, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1840 => 0.2080, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.88% (2.1441 => 2.4202, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.55% (1.9121 => 2.1521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.03% (1.7961 => 2.0121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.96% (1.7721 => 1.9841, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.83% (0.3720 => 0.4160, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.74% (2.1121 => 2.3601, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.43% (1.8201 => 2.0281, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.28% (1.8441 => 2.0521, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.22% (2.0681 => 2.3001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.84% (2.1041 => 2.3321, std.dev.: 0.0100) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.81% (0.1480 => 0.1640, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.71% (0.1120 => 0.1240, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.2240 => 0.2480, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.69% (1.7961 => 1.9881, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2280 => 0.2520, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.53% (1.9001 => 2.1001, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.47% (1.9481 => 2.1521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.46% (1.8361 => 2.0281, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.00% (1.8801 => 2.0681, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: 9.72% (0.2880 => 0.3160, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.46% (1.8601 => 2.0361, std.dev.: 0.0202) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.51% (0.1880 => 0.2040, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.46% (1.0880 => 1.1800, std.dev.: 0.0309) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.33% (0.1440 => 0.1560, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0067) MultiSource/Applications/obsequi/Obsequi: 8.32% (1.8760 => 2.0320, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8881 => 0.9601, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.39% (0.7040 => 0.7560, std.dev.: 0.0128) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.4800 => 6.9320, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 6.69% (1.0160 => 1.0840, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.59% (0.7280 => 0.7760, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.27% (1.2120 => 1.2880, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.9960 => 1.0560, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.8440 => 1.9520, std.dev.: 0.0221) MultiSource/Applications/sgefa/sgefa: 5.84% (0.6160 => 0.6520, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.56% (0.4320 => 0.4560, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.04% (9.6042 => 10.0882, std.dev.: 0.0490) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2400 => 0.2520, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (5.8281 => 6.1041, std.dev.: 0.0441) MultiSource/Applications/treecc/treecc: 4.64% (2.5880 => 2.7080, std.dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.1320 => 1.1840, std.dev.: 0.0140) MultiSource/Applications/JM/ldecod/ldecod: 4.58% (10.2283 => 10.6964, std.dev.: 0.0341) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (1.6641 => 1.7401, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4400 => 0.4600, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (6.5320 => 6.8200, std.dev.: 0.0287) MultiSource/Applications/hbd/hbd: 4.40% (1.7280 => 1.8040, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.14% (2.1240 => 2.2120, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4920 => 0.5120, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (2.3401 => 2.4242, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (6.5360 => 6.7600, std.dev.: 0.0260) MultiSource/Applications/SIBsim4/SIBsim4: 3.36% (1.7841 => 1.8441, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 3.35% (7.0524 => 7.2885, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (16.3003 => 16.8443, std.dev.: 0.0436) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.33% (2.1600 => 2.2320, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.27% (3.0562 => 3.1562, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (5.3960 => 5.5720, std.dev.: 0.0440) MultiSource/Applications/lua/lua: 3.26% (4.7920 => 4.9480, std.dev.: 0.0479) MultiSource/Applications/SPASS/SPASS: 3.07% (18.5284 => 19.0965, std.dev.: 0.0322) MultiSource/Applications/d/make_dparser: 2.92% (3.9761 => 4.0921, std.dev.: 0.0309) MultiSource/Benchmarks/Bullet/bullet: 2.91% (38.6366 => 39.7606, std.dev.: 0.0724) MultiSource/Applications/JM/lencod/lencod: 2.90% (22.2206 => 22.8647, std.dev.: 0.0596) MultiSource/Applications/kimwitu++/kc: 2.34% (19.8291 => 20.2931, std.dev.: 0.0428) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0109) MultiSource/Applications/siod/siod: 1.74% (2.7522 => 2.8002, std.dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (13.0363 => 13.2163, std.dev.: 0.0452) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.78% (2.1201 => 2.4122, std.dev.: 0.0416) MultiSource/Applications/siod/siod: 9.92% (2.8642 => 3.1482, std.dev.: 0.0158) MultiSource/Applications/spiff/spiff: 4.42% (1.9921 => 2.0801, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0132) MultiSource/Applications/minisat/minisat: 3.40% (6.5964 => 6.8204, std.dev.: 0.0248) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (3.7442 => 3.8162, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.4967 => 11.7087, std.dev.: 0.0246) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 1.33% (8.1285 => 8.2365, std.dev.: 0.0300) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (8.3605 => 8.4565, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.0243 => 5.0803, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.36% (94.8339 => 48.9711, std.dev.: 10.1599) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.58% (49.9431 => 33.1701, std.dev.: 0.1704) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.46% (25.7136 => 17.1091, std.dev.: 0.0873) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.01% (37.0863 => 28.5538, std.dev.: 0.4498) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.92% (3.0722 => 2.3681, std.dev.: 0.0922) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0032) SingleSource/Benchmarks/Linpack/linpack-pc: -15.00% (7.8165 => 6.6444, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -10.71% (3.5122 => 3.1362, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.73% (2.7482 => 2.5082, std.dev.: 0.0757) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.52% (1.2681 => 1.1601, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -4.35% (1.3801 => 1.3201, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.69% (0.9441 => 0.9281, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.50% (4.8043 => 4.7323, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.01% (2.7722 => 2.7442, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 19:32:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 21:32:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140430023239.1CFB32A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25153?compare_to=25144&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25153, Order: 207578, Start Time: 2014-04-29 21:53:12, End Time: 2014-04-30 02:39:22 To: 25144, Order: 207547, Start Time: 2014-04-29 16:45:21, End Time: 2014-04-29 21:31:32 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1097 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2008-04-20-LoopBug2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/UnitTests/Threads/2010-12-08-tls: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/Vector/sumarray: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.18% (0.4400 => 0.4760, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.83% (0.4800 => 0.5080, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.46% (1.4640 => 1.5000, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.96% (1.8321 => 1.8681, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.86% (1.7201 => 1.7521, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.55% (1.8081 => 1.8361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.23% (1.9441 => 1.9681, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 30.43% (0.0920 => 0.1200, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 3.89% (4.1083 => 4.2683, std.dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -3.19% (1.3801 => 1.3361, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.08% (0.7280 => 0.5600, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 19:53:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 21:53:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140430025358.499572A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25154?compare_to=25145&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25154, Order: 207579, Start Time: 2014-04-29 22:12:19, End Time: 2014-04-30 03:00:44 To: 25145, Order: 207549, Start Time: 2014-04-29 17:02:20, End Time: 2014-04-29 21:50:51 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (142 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (929 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.46% (0.3320 => 0.3800, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/almabench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 13.79% (0.1160 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.20% (0.1960 => 0.2160, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: 9.09% (0.2200 => 0.2400, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.4160 => 0.4320, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 1.43% (2.7922 => 2.8322, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.37% (2.0481 => 2.0761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.33% (2.1001 => 2.1281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.16% (2.0761 => 2.1001, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 28.57% (0.0560 => 0.0720, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -4.91% (1.3841 => 1.3161, std.dev.: 0.0130) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0063) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/UnitTests/2003-04-22-Switch: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: 50.00% (0.0400 => 0.0600, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-3: 30.00% (0.0400 => 0.0520, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.57% (0.1400 => 0.1800, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 25.53% (0.1880 => 0.2360, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.73% (0.0880 => 0.1080, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/exptree: 21.74% (0.0920 => 0.1120, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.70% (1.6961 => 2.0641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.09% (1.6881 => 2.0441, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.86% (1.7641 => 2.1321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.84% (1.7081 => 2.0641, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.57% (1.6921 => 2.0401, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.42% (1.7241 => 2.0761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.38% (1.6681 => 2.0081, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.36% (1.7681 => 2.1281, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.29% (1.6761 => 2.0161, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.24% (1.6801 => 2.0201, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.22% (1.8001 => 2.1641, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 20.13% (1.8881 => 2.2681, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.09% (1.6721 => 2.0081, std.dev.: 0.0103) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0600 => 0.0720, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.95% (1.8041 => 2.1641, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.95% (1.7441 => 2.0921, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.61% (1.8361 => 2.1961, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.7201 => 2.0561, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.52% (1.9881 => 2.3761, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.23% (0.1040 => 0.1240, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.82% (1.8281 => 2.1721, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.66% (1.9081 => 2.2641, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.7921 => 2.1241, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 18.42% (1.9761 => 2.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.37% (1.9601 => 2.3201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.98% (1.9801 => 2.3361, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.39% (0.1840 => 0.2160, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.31% (1.9641 => 2.3041, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.67% (0.1200 => 0.1400, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.38% (0.6120 => 0.7000, std.dev.: 0.0215) SingleSource/Benchmarks/CoyoteBench/almabench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 13.21% (0.2120 => 0.2400, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.54% (0.1040 => 0.1160, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: 11.11% (0.1080 => 0.1200, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0051) SingleSource/Benchmarks/Linpack/linpack-pc: 8.86% (0.3160 => 0.3440, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.16% (0.7840 => 0.8480, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/neural/neural: 8.00% (0.2000 => 0.2160, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.95% (0.3520 => 0.3800, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (3.5002 => 3.7602, std.dev.: 0.0115) MultiSource/Applications/spiff/spiff: 7.06% (1.0200 => 1.0920, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (6.7200 => 7.1880, std.dev.: 0.0362) SingleSource/Benchmarks/Shootout-C++/moments: 6.42% (0.4360 => 0.4640, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (1.4160 => 1.5040, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (11.7880 => 12.5040, std.dev.: 0.1114) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.07% (1.6481 => 1.7481, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.5240 => 1.6080, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (1.2400 => 1.3080, std.dev.: 0.0263) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.33% (9.9842 => 10.5162, std.dev.: 0.0439) MultiSource/Benchmarks/nbench/nbench: 5.27% (1.8201 => 1.9161, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/18-imp/imp: 5.26% (0.4560 => 0.4800, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (2.0680 => 2.1720, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 4.92% (0.2440 => 0.2560, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0278) MultiSource/Applications/lua/lua: 4.76% (4.7920 => 5.0200, std.dev.: 0.0339) MultiSource/Applications/Burg/burg: 4.62% (1.5600 => 1.6320, std.dev.: 0.0143) MultiSource/Applications/oggenc/oggenc: 4.17% (6.9124 => 7.2005, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (6.8321 => 7.1161, std.dev.: 0.0324) MultiSource/Applications/d/make_dparser: 4.14% (3.9641 => 4.1281, std.dev.: 0.0393) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (5.5480 => 5.7680, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.6120 => 0.6360, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 3.92% (18.4924 => 19.2167, std.dev.: 0.0485) MultiSource/Applications/JM/ldecod/ldecod: 3.84% (10.3203 => 10.7164, std.dev.: 0.0303) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0074) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.70% (51.1089 => 53.0009, std.dev.: 0.0851) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (1.1000 => 1.1400, std.dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.1440 => 1.1840, std.dev.: 0.0140) MultiSource/Applications/kimwitu++/kc: 3.34% (19.7371 => 20.3971, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.19% (3.0122 => 3.1082, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 3.15% (22.6287 => 23.3408, std.dev.: 0.0580) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.09% (1.0361 => 1.0681, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 2.97% (38.9366 => 40.0926, std.dev.: 0.0794) MultiSource/Applications/ClamAV/clamscan: 2.83% (20.2445 => 20.8165, std.dev.: 0.0531) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (1.0001 => 1.0281, std.dev.: 0.0097) MultiSource/Applications/siod/siod: 2.76% (2.7562 => 2.8322, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 2.53% (25.1895 => 25.8256, std.dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (4.2203 => 4.3243, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (16.5963 => 17.0003, std.dev.: 0.0426) MultiSource/Applications/lemon/lemon: 2.14% (1.4921 => 1.5241, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (2.2721 => 2.3161, std.dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: 1.44% (2.7722 => 2.8122, std.dev.: 0.0147) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.18% (29.4578 => 29.8059, std.dev.: 0.0792) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.88% (1.2681 => 1.4441, std.dev.: 0.0388) MultiSource/Applications/siod/siod: 10.04% (2.8282 => 3.1122, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 3.58% (6.8204 => 7.0644, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.64% (6.2884 => 0.8400, std.dev.: 0.0161) SingleSource/UnitTests/Vector/constpool: -81.41% (10.9087 => 2.0281, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0088) SingleSource/Regression/C++/EH/dead_try_block: -60.00% (0.0200 => 0.0080, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: -56.93% (3.1762 => 1.3681, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.19% (1.5881 => 1.1721, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0083) MultiSource/Applications/sgefa/sgefa: -24.21% (0.7600 => 0.5760, std.dev.: 0.0075) MultiSource/Applications/obsequi/Obsequi: -21.76% (2.6481 => 2.0720, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.95% (7.4801 => 6.2120, std.dev.: 0.0616) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.46% (7.5041 => 6.3440, std.dev.: 0.0444) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0065) SingleSource/Regression/C/sumarray2d: -8.38% (0.7160 => 0.6560, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -2.75% (13.5243 => 13.1523, std.dev.: 0.0447) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -40.00% (0.0600 => 0.0360, std.dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.44% (21.6534 => 17.8771, std.dev.: 0.0397) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0062) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/matrix: -4.69% (2.5562 => 2.4362, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/power/power: -4.08% (1.3721 => 1.3161, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.66% (0.3280 => 0.3160, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0195) MultiSource/Applications/lambda-0_1_3/lambda: -2.95% (5.1603 => 5.0083, std.dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.38% (3.3602 => 3.2802) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.26% (4.6083 => 4.5043, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.98% (2.6202 => 2.5682, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0181) MultiSource/Applications/JM/lencod/lencod: -1.40% (8.3085 => 8.1925, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.7041 => 1.6841, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -1.04% (4.9883 => 4.9363, std.dev.: 0.0141) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 20:18:32 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 20:18:32 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430031845.8F153502AA1B@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19407 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207603 Blamelist: rsmith Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 21:13:47 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 21:13:47 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430041418.A90AB502B06E@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19408 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207604 Blamelist: rafael BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Tue Apr 29 21:10:58 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 23:10:58 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430041058.A88872A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25155?compare_to=25151&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25155, Order: 207585, Start Time: 2014-04-29 23:37:56, End Time: 2014-04-30 04:17:43 To: 25151, Order: 207578, Start Time: 2014-04-29 21:35:27, End Time: 2014-04-30 02:17:21 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (113 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (975 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/pointer_member: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2008-04-18-LoopBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.09% (0.1320 => 0.1440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3960 => 0.4120, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (5.0120 => 5.1560, std.dev.: 0.0280) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 16.95% (16.9931 => 19.8732, std.dev.: 0.7172) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0043) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.16% (0.1520 => 0.1720, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 12.12% (0.3960 => 0.4440, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.69% (1.2481 => 1.3441, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.92% (1.1561 => 1.2361, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (10.6960 => 11.4080, std.dev.: 0.0950) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.12% (6.0160 => 6.3840, std.dev.: 0.0497) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.5200 => 1.6080, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3480 => 0.3680, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (4.9200 => 5.1560, std.dev.: 0.0280) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0718) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.9640 => 2.0480, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0097) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0380) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (10.4082 => 10.7962, std.dev.: 0.0358) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.4360 => 0.4520, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0419) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (7.8562 => 8.0882, std.dev.: 0.0231) MultiSource/Applications/sqlite3/sqlite3: 2.91% (23.7574 => 24.4495, std.dev.: 0.0458) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.80% (48.1088 => 49.4569, std.dev.: 0.0750) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.9000 => 5.0360, std.dev.: 0.0403) MultiSource/Applications/minisat/minisat: 2.50% (0.8000 => 0.8200, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 2.33% (37.0925 => 37.9566, std.dev.: 0.0926) MultiSource/Applications/kimwitu++/kc: 2.32% (18.8170 => 19.2531, std.dev.: 0.0440) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0133) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0210) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0598) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (15.2282 => 15.4002, std.dev.: 0.0355) MultiSource/Applications/ClamAV/clamscan: 1.08% (17.4082 => 17.5962, std.dev.: 0.0635) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 13.58% (17.4971 => 19.8732, std.dev.: 0.7172) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (25.8896 => 26.7177, std.dev.: 0.0373) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 1.47% (21.1533 => 21.4653, std.dev.: 0.0894) SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (14.0009 => 14.1809, std.dev.: 0.0449) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -6.87% (1.3401 => 1.2481, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.72% (4.5603 => 4.4363, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.6165 => 8.4925, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Apr 29 21:27:46 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Apr 2014 23:27:46 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430042746.CED732A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25156?compare_to=25155&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25156, Order: 207592, Start Time: 2014-04-29 23:53:28, End Time: 2014-04-30 04:34:32 To: 25155, Order: 207585, Start Time: 2014-04-29 23:37:56, End Time: 2014-04-30 04:17:43 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (104 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ConditionalExpr: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 35.71% (0.0560 => 0.0760, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Queens: 33.33% (0.0360 => 0.0480, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 25.00% (0.0640 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.72% (5.8760 => 6.0360, std.dev.: 0.0288) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.57% (6.3840 => 6.4840, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.19% (1.3441 => 1.3601, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 44.44% (0.0360 => 0.0520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 26.67% (0.1200 => 0.1520, std.dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/dry: 1.76% (0.6800 => 0.6920, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0045) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.47% (1.2281 => 1.3321, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.6840 => 0.7400, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.78% (6.0160 => 6.4840, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.36% (0.6520 => 0.7000, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (10.6960 => 11.4320, std.dev.: 0.0854) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.60% (1.2121 => 1.2921, std.dev.: 0.0154) MultiSource/Applications/spiff/spiff: 6.48% (0.9880 => 1.0520, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (8.1441 => 8.5481, std.dev.: 0.0547) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0233) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (4.9200 => 5.1320, std.dev.: 0.0411) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.8000 => 6.0360, std.dev.: 0.0288) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.7120 => 0.7400, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0247) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0313) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (7.8562 => 8.1042, std.dev.: 0.0292) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.86% (17.6165 => 18.1205, std.dev.: 0.0615) MultiSource/Applications/sqlite3/sqlite3: 2.80% (23.7574 => 24.4215, std.dev.: 0.0555) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.73% (48.1088 => 49.4210, std.dev.: 0.1311) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (2.1201 => 2.1761, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0108) MultiSource/Benchmarks/Bullet/bullet: 2.50% (37.0925 => 38.0206, std.dev.: 0.1189) MultiSource/Applications/treecc/treecc: 2.12% (2.4480 => 2.5000, std.dev.: 0.0192) MultiSource/Applications/kimwitu++/kc: 1.96% (18.8170 => 19.1851, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.92% (5.8400 => 5.9520, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 1.73% (5.7964 => 5.8964, std.dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 1.36% (17.4082 => 17.6442, std.dev.: 0.0490) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0502) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 12.36% (2.8802 => 3.2362, std.dev.: 0.0207) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.03% (1.0921 => 1.1361, std.dev.: 0.0169) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout/lists: 3.16% (5.8164 => 6.0004, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.44% (6.6564 => 6.7524, std.dev.: 0.0317) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -21.05% (0.0760 => 0.0600, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -5.97% (1.3401 => 1.2601, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0022) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0066) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.39% (0.8641 => 0.8521, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 22:14:40 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 22:14:40 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430051455.8380A502B7EE@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19409 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207606 Blamelist: nico Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 22:42:45 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 22:42:45 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430054258.3563C502BBE6@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19410 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207608 Blamelist: compnerd,nico BUILD FAILED: exception interrupted sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Tue Apr 29 23:55:38 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Tue, 29 Apr 2014 23:55:38 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430065551.02449502C612@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19413 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207613 Blamelist: compnerd Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 01:15:58 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 01:15:58 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430081613.A7C10502D157@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19416 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207619 Blamelist: chandlerc Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 03:05:40 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 03:05:40 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430100612.53101502DE42@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19417 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207620 Blamelist: tnorthover BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 30 05:14:57 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 07:14:57 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430121457.1F2C02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25157?compare_to=25156&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25157, Order: 207618, Start Time: 2014-04-30 07:41:37, End Time: 2014-04-30 12:21:35 To: 25156, Order: 207592, Start Time: 2014-04-29 23:53:28, End Time: 2014-04-30 04:34:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 9 (98 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/UnitTests/ms_struct-bitfield-init-1: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C++/EH/function_try_block: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3080 => 0.3200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.17% (1.2921 => 1.3201, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.29% (2.1761 => 2.2041, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 42.86% (0.0280 => 0.0400, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0062) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.22% (1.1761 => 1.3081, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.57% (0.1400 => 0.1520, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.01% (1.2481 => 1.3481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.89% (1.3681 => 1.4761, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (6.0160 => 6.4480, std.dev.: 0.0289) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0512) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 5.04% (4.5200 => 4.7480, std.dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0125) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.32% (8.1441 => 8.4961, std.dev.: 0.0495) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.1201 => 2.2041, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0210) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0444) MultiSource/Applications/JM/lencod/lencod: 3.22% (17.6165 => 18.1845, std.dev.: 0.0358) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.94% (48.1088 => 49.5250, std.dev.: 0.0555) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 2.88% (23.7574 => 24.4415, std.dev.: 0.0523) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (7.8562 => 8.0802, std.dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.4400 => 1.4800, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (5.8000 => 5.9520, std.dev.: 0.0577) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 1.87% (37.0925 => 37.7846, std.dev.: 0.0596) MultiSource/Applications/kimwitu++/kc: 1.74% (18.8170 => 19.1451, std.dev.: 0.0618) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0168) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (5.8400 => 5.9280, std.dev.: 0.0339) MultiSource/Applications/SPASS/SPASS: 1.41% (17.5484 => 17.7964, std.dev.: 0.0451) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0316) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.0921 => 1.1241, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.56% (6.6564 => 6.7604, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0241) MultiSource/Applications/lua/lua: 1.29% (21.1533 => 21.4253, std.dev.: 0.0610) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0406) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0024) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.64% (10.8967 => 2.0001, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0024) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -5.37% (1.3401 => 1.2681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0383) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0076) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.63% (4.5603 => 4.4403, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 05:17:32 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 07:17:32 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140430121732.3CD9F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25158?compare_to=25150&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25158, Order: 207618, Start Time: 2014-04-30 07:41:36, End Time: 2014-04-30 12:24:22 To: 25150, Order: 207577, Start Time: 2014-04-29 21:26:32, End Time: 2014-04-30 02:09:13 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (163 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (918 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-20-FoldBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) MultiSource/Applications/aha/aha: 13.33% (0.1200 => 0.1360, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 11.54% (0.1040 => 0.1160, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.38% (0.1280 => 0.1400, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0022) MultiSource/Applications/obsequi/Obsequi: 2.77% (2.0201 => 2.0761, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0721 => 1.0841, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.19% (11.3687 => 3.0482, std.dev.: 0.0069) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7404, std.dev.: 0.0093) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Puzzle: 296.54% (0.4600 => 1.8241, std.dev.: 0.0100) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0051) SingleSource/Regression/C++/2011-03-28-Bitfield: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038) SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0060) SingleSource/UnitTests/2003-07-09-LoadShorts: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0032) SingleSource/Regression/C/sumarray2d: 66.67% (0.0240 => 0.0400, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/15-trie/trie: 28.57% (0.0560 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.32% (0.1480 => 0.1840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.69% (0.1160 => 0.1400, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.44% (0.2920 => 0.3400, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/almabench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (0.0800 => 0.0920, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.29% (0.1120 => 0.1280, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1440 => 0.1640, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.6600 => 0.7480, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.11% (0.3240 => 0.3600, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.65% (1.1640 => 1.2880, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.28% (1.4401 => 1.5881, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.3120 => 0.3440, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.24% (1.4841 => 1.6361, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.17% (1.6521 => 1.8201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.13% (1.8161 => 2.0001, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.00% (1.5601 => 1.7161, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.89% (0.3640 => 0.4000, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.63% (1.4961 => 1.6401, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: 9.59% (0.5840 => 0.6400, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.5241 => 1.6681, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0128) MultiSource/Applications/obsequi/Obsequi: 9.42% (1.8680 => 2.0440, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.02% (1.5521 => 1.6921, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.95% (1.6081 => 1.7521, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.76% (1.7361 => 1.8881, std.dev.: 0.0088) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.70% (0.4600 => 0.5000, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.05% (0.3480 => 0.3760, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.89% (1.4201 => 1.5321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.63% (1.4161 => 1.5241, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.55% (1.4841 => 1.5961, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.24% (1.4361 => 1.5401, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.17% (1.7841 => 1.9121, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (1.4801 => 1.5841, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.86% (1.6921 => 1.8081, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.75% (1.5401 => 1.6441, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 6.75% (1.0080 => 1.0760, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.67% (0.2400 => 0.2560, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.45% (1.1160 => 1.1880, std.dev.: 0.0259) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (6.4680 => 6.8840, std.dev.: 0.0458) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.31% (1.5841 => 1.6841, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.21% (1.7401 => 1.8481, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.97% (0.2680 => 0.2840, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (11.6440 => 12.3240, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.82% (1.5801 => 1.6721, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.72% (1.4681 => 1.5521, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (5.8121 => 6.1321, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.8440 => 1.9440, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (0.2960 => 0.3120, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0084) MultiSource/Applications/Burg/burg: 5.31% (1.5080 => 1.5880, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.26% (0.4560 => 0.4800, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.14% (0.7000 => 0.7360, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.07% (1.4201 => 1.4921, std.dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.1280 => 1.1840, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0076) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (9.4842 => 9.9402, std.dev.: 0.0493) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.4640 => 1.5320, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.5600 => 1.6320, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.60% (1.7400 => 1.8200, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.47% (2.3281 => 2.4322, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (1.6601 => 1.7321, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (10.0443 => 10.4723, std.dev.: 0.0349) MultiSource/Applications/JM/lencod/lencod: 4.14% (21.9606 => 22.8688, std.dev.: 0.0482) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.03% (50.0290 => 52.0450, std.dev.: 0.0982) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.83% (3.0282 => 3.1442, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 3.61% (6.9844 => 7.2365, std.dev.: 0.0217) MultiSource/Applications/SIBsim4/SIBsim4: 3.57% (1.7921 => 1.8561, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (6.5440 => 6.7720, std.dev.: 0.0494) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (5.3600 => 5.5440, std.dev.: 0.0485) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.7721 => 1.8321, std.dev.: 0.0116) MultiSource/Applications/SPASS/SPASS: 3.34% (18.4404 => 19.0566, std.dev.: 0.0448) SingleSource/Benchmarks/Misc/flops: 3.33% (0.4800 => 0.4960, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.26% (6.5080 => 6.7200, std.dev.: 0.0550) MultiSource/Applications/treecc/treecc: 3.25% (2.5840 => 2.6680, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (4.1843 => 4.3203, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0145) MultiSource/Applications/ClamAV/clamscan: 3.17% (19.0444 => 19.6484, std.dev.: 0.0518) MultiSource/Applications/lua/lua: 2.92% (4.7880 => 4.9280, std.dev.: 0.0423) MultiSource/Benchmarks/Bullet/bullet: 2.86% (38.4046 => 39.5046, std.dev.: 0.0946) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (2.1240 => 2.1800, std.dev.: 0.0195) MultiSource/Applications/d/make_dparser: 2.62% (3.9681 => 4.0721, std.dev.: 0.0226) MultiSource/Applications/kimwitu++/kc: 2.60% (19.6891 => 20.2011, std.dev.: 0.0447) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (16.3483 => 16.7643, std.dev.: 0.0323) MultiSource/Applications/sqlite3/sqlite3: 1.67% (25.6856 => 26.1136, std.dev.: 0.0267) MultiSource/Applications/lemon/lemon: 1.34% (1.4881 => 1.5081, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (13.0563 => 13.2083, std.dev.: 0.0386) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 27.70% (0.9241 => 1.1801, std.dev.: 0.0211) SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.65% (2.1401 => 2.4322, std.dev.: 0.0375) MultiSource/Applications/siod/siod: 9.79% (2.8602 => 3.1402, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 2.52% (6.6684 => 6.8364, std.dev.: 0.0375) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (8.1845 => 8.3605, std.dev.: 0.0151) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.63% (11.5087 => 11.6967, std.dev.: 0.0216) MultiSource/Applications/sqlite3/sqlite3: 1.51% (3.9842 => 4.0443, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.14% (10.6247 => 2.0041, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.73% (1.5641 => 1.0521, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.30% (91.8497 => 49.3191, std.dev.: 10.2693) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.47% (50.3031 => 32.9661, std.dev.: 0.2427) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.43% (26.0616 => 17.0891, std.dev.: 0.1173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.36% (42.1466 => 28.9298, std.dev.: 0.3942) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.42% (3.1122 => 2.3521, std.dev.: 0.1092) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.93% (3.5122 => 3.1282, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0165) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -4.33% (1.3841 => 1.3241, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (4.1243 => 4.0403, std.dev.: 0.0150) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0150) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 05:20:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 07:20:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140430122014.16B822A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25159?compare_to=25152&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25159, Order: 207618, Start Time: 2014-04-30 07:41:41, End Time: 2014-04-30 12:27:02 To: 25152, Order: 207578, Start Time: 2014-04-29 21:44:52, End Time: 2014-04-30 02:30:41 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 13 (142 on baseline) Performance Improvements: 0 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2004-02-03-AggregateCopy: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/recursive-throw: 200.00% (0.0080 => 0.0240, std.dev.: 0.0049) SingleSource/Regression/C/2003-05-21-UnionTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/UnitTests/2003-08-11-VaListArg: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.53% (0.0680 => 0.0840, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 6.12% (0.1960 => 0.2080, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3000 => 0.3120, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.83% (1.5680 => 1.6280, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.67% (0.1800 => 0.1920, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.64% (0.9641 => 1.0281, std.dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.82% (17.6723 => 19.7604, std.dev.: 0.0539) MultiSource/Applications/sqlite3/sqlite3: 1433.65% (1.7001 => 26.0736, std.dev.: 0.0227) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.86% (50.1010 => 52.0330, std.dev.: 0.0893) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.94% (1.0520 => 1.1040, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (11.3920 => 12.3560, std.dev.: 0.0468) SingleSource/Benchmarks/Misc/oourafft: -73.30% (11.3407 => 3.0282, std.dev.: 0.0116) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0283, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0117) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 317.62% (0.4320 => 1.8041, std.dev.: 0.0109) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0050) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/17-bintr/bintr: 27.78% (0.0720 => 0.0920, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/llubenchmark/llu: 23.08% (0.0520 => 0.0640, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.73% (0.0880 => 0.1080, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 20.83% (0.1920 => 0.2320, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.69% (0.1160 => 0.1400, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.51% (0.1560 => 0.1880, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.60% (0.1720 => 0.2040, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 16.07% (0.2240 => 0.2600, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.00% (0.1000 => 0.1160, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.09% (1.8561 => 2.1361, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.03% (1.8361 => 2.1121, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.72% (1.8201 => 2.0881, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.60% (1.8081 => 2.0721, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 14.29% (0.0840 => 0.0960, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.19% (1.8601 => 2.1241, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.00% (1.9721 => 2.2481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.99% (1.9161 => 2.1841, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.93% (1.9241 => 2.1921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.74% (1.8921 => 2.1521, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.65% (1.8761 => 2.1321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.61% (2.0281 => 2.3041, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 13.39% (1.9121 => 2.1681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.91% (1.9521 => 2.2041, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.12% (2.1121 => 2.3681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.75% (2.1441 => 2.3961, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.74% (1.7721 => 1.9801, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 11.43% (0.1400 => 0.1560, std.dev.: 0.0054) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.21% (1.8201 => 2.0241, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.06% (1.8441 => 2.0481, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.06% (1.8081 => 2.0081, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.04% (1.9201 => 2.1321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.93% (1.9761 => 2.1921, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.8801 => 2.0841, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.71% (0.3360 => 0.3720, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.65% (2.1041 => 2.3281, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/power/power: 10.64% (0.1880 => 0.2080, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.53% (2.0521 => 2.2681, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.53% (1.9001 => 2.1001, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.25% (2.0681 => 2.2801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.8361 => 2.0241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/05-eks/eks: 10.00% (0.6800 => 0.7480, std.dev.: 0.0173) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.73% (0.7400 => 0.8120, std.dev.: 0.0213) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 9.68% (0.1240 => 0.1360, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.58% (1.7961 => 1.9681, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/09-vor/vor: 9.57% (0.3760 => 0.4120, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.45% (1.9481 => 2.1321, std.dev.: 0.0086) MultiSource/Applications/obsequi/Obsequi: 9.38% (1.8760 => 2.0520, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.93% (0.2240 => 0.2440, std.dev.: 0.0056) SingleSource/Regression/C/bigstack: 8.89% (0.1800 => 0.1960, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: 8.33% (0.2880 => 0.3120, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.22% (0.2920 => 0.3160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.90% (0.2320 => 0.2480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.90% (0.4640 => 0.4960, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.2920 => 0.3120, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.76% (0.8881 => 0.9481, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (6.4800 => 6.9000, std.dev.: 0.0373) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.12% (0.1960 => 0.2080, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.9960 => 1.0560, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.7280 => 0.7680, std.dev.: 0.0140) MultiSource/Benchmarks/nbench/nbench: 5.19% (1.7721 => 1.8641, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: 5.04% (0.4760 => 0.5000, std.dev.: 0.0070) MultiSource/Applications/Burg/burg: 4.97% (1.5280 => 1.6040, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (5.8281 => 6.1041, std.dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4320 => 0.4520, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.48% (1.6960 => 1.7720, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.40% (0.3640 => 0.3800, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.6042 => 10.0162, std.dev.: 0.0340) SingleSource/Benchmarks/Misc/flops: 4.24% (0.4720 => 0.4920, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.2283 => 10.6604, std.dev.: 0.0356) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.09% (1.5640 => 1.6280, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4920 => 0.5120, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.85% (1.6641 => 1.7281, std.dev.: 0.0122) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.69% (1.3000 => 1.3480, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.9801 => 1.0161, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (6.5320 => 6.7520, std.dev.: 0.0438) MultiSource/Applications/oggenc/oggenc: 3.29% (7.0524 => 7.2845, std.dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: 3.14% (1.7841 => 1.8401, std.dev.: 0.0144) MultiSource/Applications/treecc/treecc: 3.09% (2.5880 => 2.6680, std.dev.: 0.0243) MultiSource/Applications/SPASS/SPASS: 3.02% (18.5284 => 19.0884, std.dev.: 0.0440) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (3.0562 => 3.1482, std.dev.: 0.0126) MultiSource/Applications/d/make_dparser: 2.92% (3.9761 => 4.0921, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (16.3003 => 16.7563, std.dev.: 0.0565) MultiSource/Applications/lua/lua: 2.67% (4.7920 => 4.9200, std.dev.: 0.0434) MultiSource/Applications/JM/lencod/lencod: 2.59% (22.2206 => 22.7967, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.51% (6.5360 => 6.7000, std.dev.: 0.0411) MultiSource/Benchmarks/Bullet/bullet: 2.24% (38.6366 => 39.5006, std.dev.: 0.0637) MultiSource/Applications/lemon/lemon: 2.15% (1.4881 => 1.5201, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 1.82% (19.8291 => 20.1891, std.dev.: 0.0510) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.2243 => 4.3003, std.dev.: 0.0146) MultiSource/Applications/siod/siod: 1.45% (2.7522 => 2.7922, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 33.33% (0.0360 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 22.51% (0.9241 => 1.1321, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.48% (2.1201 => 2.4482, std.dev.: 0.0477) MultiSource/Applications/siod/siod: 9.92% (2.8642 => 3.1482, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 3.31% (7.3725 => 7.6165, std.dev.: 0.0277) MultiSource/Applications/minisat/minisat: 2.97% (6.5964 => 6.7924, std.dev.: 0.0345) MultiSource/Applications/hexxagon/hexxagon: 1.84% (11.4967 => 11.7087, std.dev.: 0.0146) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1961 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.38% (8.1285 => 8.2405, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9684 => 6.0484, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.20% (8.3605 => 8.4605, std.dev.: 0.0354) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (3.9442 => 3.9882, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.0243 => 5.0803, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.73% (10.4007 => 2.0041, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.15% (2.9562 => 0.9120, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.00% (1.5881 => 1.0641, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.91% (0.6880 => 0.6680, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.20% (94.8339 => 49.1231, std.dev.: 9.7230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.91% (49.9431 => 33.0061, std.dev.: 0.1442) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.70% (25.7136 => 17.0491, std.dev.: 0.1071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.16% (37.0863 => 28.4978, std.dev.: 0.4774) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.05% (3.0722 => 2.3641, std.dev.: 0.1035) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: -14.89% (7.8165 => 6.6524, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: -3.77% (1.3801 => 1.3281, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.69% (0.9441 => 0.9281, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.58% (4.8043 => 4.7283, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: -1.36% (2.3521 => 2.3201, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.01% (2.7722 => 2.7442, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 05:21:07 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 07:21:07 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140430122107.B406F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25160?compare_to=25153&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25160, Order: 207618, Start Time: 2014-04-30 07:41:36, End Time: 2014-04-30 12:27:55 To: 25153, Order: 207578, Start Time: 2014-04-29 21:53:12, End Time: 2014-04-30 02:39:22 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (0 on baseline) Performance Improvements: 2 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1100 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0024) SingleSource/UnitTests/2003-08-11-VaListArg: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0240 => 0.0360, std.dev.: 0.0043) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.77% (0.0520 => 0.0680, std.dev.: 0.0048) SingleSource/Benchmarks/SmallPT/smallpt: 14.29% (0.1400 => 0.1600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.11% (0.1080 => 0.1200, std.dev.: 0.0030) SingleSource/Regression/C/bigstack: 6.82% (0.1760 => 0.1880, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 44.44% (0.0360 => 0.0520, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 38.46% (0.0520 => 0.0720, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 5.51% (3.8482 => 4.0603, std.dev.: 0.0594) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.55% (0.9401 => 0.9161, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -9.62% (0.2080 => 0.1880, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0106) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 05:22:13 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 07:22:13 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140430122213.3F86B2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25161?compare_to=25140&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25161, Order: 207618, Start Time: 2014-04-30 07:41:16, End Time: 2014-04-30 12:29:01 To: 25140, Order: 207538, Start Time: 2014-04-29 16:21:57, End Time: 2014-04-29 21:03:48 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 17 (158 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027) SingleSource/Regression/C/DuffsDevice: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/mason/mason: 26.67% (0.0600 => 0.0760, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.08% (0.1040 => 0.1280, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 13.64% (0.0880 => 0.1000, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: 12.24% (0.1960 => 0.2200, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.2960 => 0.3120, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.47% (1.3561 => 1.3761, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.46% (1.3721 => 1.3921, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/distray/distray: 7.89% (0.1520 => 0.1640, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.15% (5.4043 => 5.5203, std.dev.: 0.0437) SingleSource/Benchmarks/Misc/mandel-2: 1.65% (0.9681 => 0.9841, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.39% (0.8641 => 0.8761, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 1.09% (1.1041 => 1.1161, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -4.90% (1.3881 => 1.3201, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2362.50% (0.0320 => 0.7880, std.dev.: 0.0089) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0073) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 979.08% (0.0760 => 0.8201, std.dev.: 0.0084) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0090) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: 271.43% (0.0280 => 0.1040, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 204.76% (0.2520 => 0.7680, std.dev.: 0.0137) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0054) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0360 => 0.0720, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 96.15% (0.1040 => 0.2040, std.dev.: 0.0106) SingleSource/Regression/C/test_indvars: 87.50% (0.0320 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0054) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/whetstone: 50.00% (0.1040 => 0.1560, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0028) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) MultiSource/Applications/obsequi/Obsequi: 44.83% (1.3920 => 2.0160, std.dev.: 0.0274) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 36.84% (0.0760 => 0.1040, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 31.58% (0.0760 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.36% (1.2481 => 1.5521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 24.35% (1.2321 => 1.5321, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.04% (1.2481 => 1.5481, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 22.73% (0.0880 => 0.1080, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.11% (1.1761 => 1.4361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 21.80% (1.1561 => 1.4081, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.12% (1.1361 => 1.3761, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 21.05% (1.1401 => 1.3801, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.98% (1.1441 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.83% (1.1521 => 1.3921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.75% (1.1761 => 1.4201, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (1.2921 => 1.5561, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.14% (1.1321 => 1.3601, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.53% (1.1881 => 1.4201, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.39% (1.1761 => 1.4041, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.31% (1.1601 => 1.3841, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.85% (1.2521 => 1.4881, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 18.74% (8.5802 => 10.1883, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.24% (1.2281 => 1.4521, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.18% (1.2321 => 1.4561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.18% (1.2321 => 1.4561, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.76% (1.2841 => 1.5121, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.70% (1.2881 => 1.5161, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.34% (1.3841 => 1.6241, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: 17.02% (0.3760 => 0.4400, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.79% (0.0760 => 0.0880, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.79% (0.0760 => 0.0880, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 15.17% (19.5406 => 22.5047, std.dev.: 0.0648) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.69% (5.3360 => 6.1201, std.dev.: 0.0344) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0117) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.33% (1.7400 => 1.9720, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.3160 => 0.3520, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.2480 => 0.2760, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.53% (0.1520 => 0.1680, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.53% (0.1520 => 0.1680, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 9.59% (11.3843 => 12.4763, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0127) MultiSource/Applications/oggenc/oggenc: 9.23% (6.2844 => 6.8644, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.80% (5.7280 => 6.2320, std.dev.: 0.0380) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.61% (5.6680 => 6.1560, std.dev.: 0.0473) SingleSource/Benchmarks/Shootout-C++/ary: 8.57% (0.2800 => 0.3040, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.00% (11.4440 => 12.3600, std.dev.: 0.0561) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.88% (0.8721 => 0.9321, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.9800 => 1.0440, std.dev.: 0.0171) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.51% (9.5802 => 10.2042, std.dev.: 0.0519) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.69% (1.1240 => 1.1880, std.dev.: 0.0237) MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.14% (1.3240 => 1.3920, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 4.78% (4.7720 => 5.0000, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.10% (6.8280 => 7.1080, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4960 => 0.5160, std.dev.: 0.0069) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.02% (49.1529 => 51.1289, std.dev.: 0.0702) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.88% (1.3400 => 1.3920, std.dev.: 0.0142) MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0105) MultiSource/Applications/SIBsim4/SIBsim4: 3.77% (1.6961 => 1.7601, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 3.44% (24.7575 => 25.6096, std.dev.: 0.0535) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (2.0920 => 2.1640, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 3.12% (5.3840 => 5.5520, std.dev.: 0.0584) MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (2.7282 => 2.8002, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 2.46% (19.2243 => 19.6964, std.dev.: 0.0827) MultiSource/Applications/kimwitu++/kc: 1.94% (19.7491 => 20.1331, std.dev.: 0.0500) MultiSource/Applications/siod/siod: 1.45% (2.7562 => 2.7962, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: 1.33% (39.0726 => 39.5926, std.dev.: 0.0647) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.32% (3.0402 => 3.0802, std.dev.: 0.0124) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.15% (29.3298 => 29.6659, std.dev.: 0.0605) MultiSource/Applications/SPASS/SPASS: 1.06% (18.7966 => 18.9965, std.dev.: 0.0443) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 20.78% (0.9241 => 1.1161, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.81% (1.2401 => 1.4361, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (3.9842 => 4.3003, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.5920 => 0.6200, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 3.75% (2.9842 => 3.0962, std.dev.: 0.0190) SingleSource/Benchmarks/McGill/queens: 3.67% (2.1801 => 2.2601, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.63% (1.6521 => 1.7121, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 3.34% (6.8204 => 7.0484, std.dev.: 0.0341) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (25.4536 => 25.8456, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/oourafft: 1.51% (7.3965 => 7.5085, std.dev.: 0.0145) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (4.2403 => 4.3043, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.26% (2.5442 => 2.5762, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0563 => 4.1043, std.dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-10-13-BadLoad: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.74% (11.0207 => 2.0121, std.dev.: 0.0128) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.57% (21.6534 => 17.8491, std.dev.: 0.0575) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0030) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.67% (5.2763 => 4.9243, std.dev.: 0.0952) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.05% (2.0601 => 1.9561, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: -2.94% (1.3601 => 1.3201, std.dev.: 0.0120) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: -1.80% (3.5602 => 3.4962, std.dev.: 0.0190) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.0963 => 5.0123, std.dev.: 0.0227) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 05:23:28 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 07:23:28 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140430122328.D538C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25162?compare_to=25154&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25162, Order: 207618, Start Time: 2014-04-30 07:41:39, End Time: 2014-04-30 12:30:06 To: 25154, Order: 207579, Start Time: 2014-04-29 22:12:19, End Time: 2014-04-30 03:00:44 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (133 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR491: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/member-function-pointers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.93% (0.4480 => 0.4880, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.89% (0.1520 => 0.1640, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 7.89% (0.1520 => 0.1640, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (1.1400 => 1.1600, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.32% (2.1241 => 2.1521, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.41% (0.3120 => 0.3320, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.13% (0.3120 => 0.3280, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/NPB-serial/is/is: -17.86% (0.1120 => 0.0920, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/member-function-pointers: 400.00% (0.0040 => 0.0200, std.dev.: 0.0028) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 299.14% (0.4560 => 1.8201, std.dev.: 0.0063) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.71% (0.1400 => 0.1760, std.dev.: 0.0111) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.39% (0.1640 => 0.2040, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.99% (1.6961 => 2.0521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.87% (1.7441 => 2.1081, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.78% (1.7321 => 2.0921, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.42% (1.7241 => 2.0761, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.14% (1.6881 => 2.0281, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.09% (1.7921 => 2.1521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.00% (1.7201 => 2.0641, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.90% (1.6681 => 2.0001, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.77% (1.7401 => 2.0841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.49% (1.8881 => 2.2561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.46% (1.7681 => 2.1121, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.38% (1.6921 => 2.0201, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.29% (1.8041 => 2.1521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.29% (1.8041 => 2.1521, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.22% (1.7481 => 2.0841, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.03% (1.8081 => 2.1521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.02% (1.7241 => 2.0521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.91% (1.9881 => 2.3641, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.52% (1.8361 => 2.1761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.46% (1.8201 => 2.1561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.38% (1.8281 => 2.1641, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 18.03% (1.9081 => 2.2521, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.72% (1.9641 => 2.3121, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/ary3: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.57% (1.9801 => 2.3281, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.41% (1.9761 => 2.3201, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.81% (0.1480 => 0.1640, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.81% (0.1480 => 0.1640, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 8.77% (0.2280 => 0.2480, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2080 => 0.2240, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.86% (3.5002 => 3.7402, std.dev.: 0.0260) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (6.7200 => 7.1760, std.dev.: 0.0327) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.51% (0.8601 => 0.9161, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.45% (1.2400 => 1.3200, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/oourafft: 6.25% (0.3200 => 0.3400, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (0.1960 => 0.2080, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.4600 => 0.4880, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (1.6481 => 1.7441, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.73% (11.7880 => 12.4640, std.dev.: 0.0931) MultiSource/Applications/SIBsim4/SIBsim4: 5.71% (1.6801 => 1.7761, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/football/football: 5.45% (1.1000 => 1.1600, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.25% (1.5240 => 1.6040, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.6120 => 0.6440, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.7280 => 1.8120, std.dev.: 0.0231) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.76% (0.7560 => 0.7920, std.dev.: 0.0136) MultiSource/Applications/lua/lua: 4.67% (4.7920 => 5.0160, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.62% (0.2600 => 0.2720, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.4160 => 1.4800, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (2.0680 => 2.1600, std.dev.: 0.0219) MultiSource/Applications/oggenc/oggenc: 4.34% (6.9124 => 7.2124, std.dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (9.9842 => 10.4042, std.dev.: 0.0564) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (6.8321 => 7.1041, std.dev.: 0.0311) MultiSource/Applications/d/make_dparser: 3.83% (3.9641 => 4.1161, std.dev.: 0.0256) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0078) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.73% (0.6440 => 0.6680, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (10.3203 => 10.7004, std.dev.: 0.0285) MultiSource/Applications/SPASS/SPASS: 3.29% (18.4924 => 19.1006, std.dev.: 0.0521) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.7320 => 1.7880, std.dev.: 0.0215) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.19% (51.1089 => 52.7409, std.dev.: 0.1091) MultiSource/Applications/Burg/burg: 3.08% (1.5600 => 1.6080, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.05% (3.0122 => 3.1042, std.dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: 2.95% (22.6287 => 23.2967, std.dev.: 0.0501) MultiSource/Applications/minisat/minisat: 2.80% (0.8560 => 0.8800, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (5.5480 => 5.6960, std.dev.: 0.0345) MultiSource/Applications/sqlite3/sqlite3: 2.60% (25.1895 => 25.8456, std.dev.: 0.0222) MultiSource/Applications/ClamAV/clamscan: 2.57% (20.2445 => 20.7645, std.dev.: 0.0632) MultiSource/Applications/kimwitu++/kc: 2.51% (19.7371 => 20.2331, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (2.2721 => 2.3241, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2203 => 4.3043, std.dev.: 0.0156) MultiSource/Benchmarks/Bullet/bullet: 1.95% (38.9366 => 39.6966, std.dev.: 0.0957) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (16.5963 => 16.9043, std.dev.: 0.0488) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (6.0244 => 6.1284, std.dev.: 0.0149) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (29.4578 => 29.8179, std.dev.: 0.0512) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0093) MultiSource/Applications/siod/siod: 10.18% (2.8282 => 3.1162, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.04% (1.0881 => 1.1321, std.dev.: 0.0122) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0131) MultiSource/Applications/minisat/minisat: 3.46% (6.8204 => 7.0564, std.dev.: 0.0446) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (2.5322 => 2.5762, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.36% (4.1323 => 4.1883, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4041 => 1.4201, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.51% (6.2884 => 0.8480, std.dev.: 0.0191) SingleSource/UnitTests/Vector/constpool: -81.56% (10.9087 => 2.0121, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/nestedloop: -60.73% (2.9642 => 1.1641, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.30% (3.1762 => 1.3561, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -26.19% (1.5881 => 1.1721, std.dev.: 0.0075) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0061) MultiSource/Applications/obsequi/Obsequi: -21.30% (2.6481 => 2.0840, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.31% (7.4801 => 6.2600, std.dev.: 0.0376) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.99% (7.5041 => 6.3040, std.dev.: 0.0400) SingleSource/UnitTests/Vector/multiplies: -12.20% (0.1640 => 0.1440, std.dev.: 0.0066) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: -2.63% (13.5243 => 13.1683, std.dev.: 0.0451) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -40.00% (0.0600 => 0.0360, std.dev.: 0.0078) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.74% (21.6534 => 17.8131, std.dev.: 0.0613) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.21% (2.6082 => 2.3681, std.dev.: 0.0882) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.9281 => 0.8641, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: -6.41% (0.6240 => 0.5840, std.dev.: 0.0080) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: -4.37% (1.3721 => 1.3121, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9202 => 2.8162, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -3.41% (5.1603 => 4.9843, std.dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.34% (4.6083 => 4.5003, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -1.75% (11.6527 => 11.4487, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: -1.35% (8.3085 => 8.1965, std.dev.: 0.0313) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.14% (2.4522 => 2.4242, std.dev.: 0.0083) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 05:45:31 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 07:45:31 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430124531.E88F52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25163?compare_to=25157&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25163, Order: 207619, Start Time: 2014-04-30 08:04:57, End Time: 2014-04-30 12:52:19 To: 25157, Order: 207618, Start Time: 2014-04-30 07:41:37, End Time: 2014-04-30 12:21:35 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (106 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (982 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 60.00% (0.0200 => 0.0320, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Towers: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.05% (0.0760 => 0.0920, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.14% (0.1680 => 0.1800, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 5.32% (0.3760 => 0.3960, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.9520 => 0.9760, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (1.3841 => 1.4041, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: 1.20% (2.0001 => 2.0241, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (2.3161 => 2.3441, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0063) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.45% (1.1241 => 1.2641, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.53% (0.3040 => 0.3360, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (1.2721 => 1.4041, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/09-vor/vor: 10.00% (0.3600 => 0.3960, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0111) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.78% (1.1841 => 1.2881, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (10.6960 => 11.4400, std.dev.: 0.0720) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.9200 => 0.9760, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0202) MultiSource/Applications/lua/lua: 4.78% (4.5200 => 4.7360, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.60% (0.3480 => 0.3640, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0187) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (8.1441 => 8.5041, std.dev.: 0.0530) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0186) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (10.4082 => 10.7922, std.dev.: 0.0449) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 3.12% (23.7574 => 24.4975, std.dev.: 0.0413) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.8322 => 2.9162, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (4.9000 => 5.0400, std.dev.: 0.0267) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.84% (48.1088 => 49.4729, std.dev.: 0.0796) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0654) MultiSource/Applications/JM/ldecod/ldecod: 2.29% (7.8562 => 8.0362, std.dev.: 0.0300) MultiSource/Applications/oggenc/oggenc: 2.14% (5.7964 => 5.9204, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: 1.90% (37.0925 => 37.7966, std.dev.: 0.0870) MultiSource/Applications/kimwitu++/kc: 1.87% (18.8170 => 19.1691, std.dev.: 0.0375) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 1.54% (17.4082 => 17.6762, std.dev.: 0.0377) MultiSource/Applications/SPASS/SPASS: 1.53% (17.5484 => 17.8164, std.dev.: 0.0459) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.2640 => 0.2800, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.76% (0.3360 => 0.3520, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.34% (1.6601 => 1.7321, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0320) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0088) SingleSource/Benchmarks/SmallPT/smallpt: 1.06% (14.0009 => 14.1489, std.dev.: 0.0450) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/bmm/bmm: -28.57% (0.0840 => 0.0600, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0028) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: -6.27% (1.3401 => 1.2561, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0054) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0278) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 06:23:05 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 06:23:05 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430132317.79FA8502FBCF@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19425 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207642 Blamelist: dsanders,jamesm,logan Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 06:45:30 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 06:45:30 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430134612.27072503005A@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19426 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207643 Blamelist: rafael BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 07:21:16 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 07:21:16 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430142129.742FF5030575@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19428 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207650 Blamelist: tnorthover Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 30 07:21:16 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 09:21:16 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430142116.095CE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25164?compare_to=25163&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25164, Order: 207620, Start Time: 2014-04-30 09:46:28, End Time: 2014-04-30 14:28:03 To: 25163, Order: 207619, Start Time: 2014-04-30 08:04:57, End Time: 2014-04-30 12:52:19 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (105 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (983 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-08-20-FoldBug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0020) SingleSource/Regression/C++/EH/recursive-throw: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 40.00% (0.0400 => 0.0560, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.74% (0.0920 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 18.52% (0.1080 => 0.1280, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.29% (0.0840 => 0.0960, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 22.22% (0.0720 => 0.0880, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.39% (0.0920 => 0.1080, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.79% (0.0760 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 14.29% (0.1120 => 0.1280, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.0840 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.4400 => 0.4800, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.6800 => 0.7320, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.92% (10.6960 => 11.4360, std.dev.: 0.0609) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.72% (6.0160 => 6.4200, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.16% (1.3641 => 1.4481, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.5200 => 1.6120, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.85% (1.3681 => 1.4481, std.dev.: 0.0151) MultiSource/Applications/spiff/spiff: 5.67% (0.9880 => 1.0440, std.dev.: 0.0165) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (1.3760 => 1.4440, std.dev.: 0.0182) MultiSource/Applications/lua/lua: 4.51% (4.5200 => 4.7240, std.dev.: 0.0267) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (8.1441 => 8.4841, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0221) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.45% (0.3480 => 0.3600, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0264) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.4082 => 10.7522, std.dev.: 0.0506) MultiSource/Applications/Burg/burg: 3.29% (1.4600 => 1.5080, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (4.9200 => 5.0760, std.dev.: 0.0478) MultiSource/Applications/sqlite3/sqlite3: 3.12% (23.7574 => 24.4975, std.dev.: 0.0508) MultiSource/Applications/JM/lencod/lencod: 2.95% (17.6165 => 18.1365, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0124) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.62% (48.1088 => 49.3690, std.dev.: 0.1080) MultiSource/Applications/treecc/treecc: 2.29% (2.4480 => 2.5040, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0402) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0302) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 2.07% (5.7964 => 5.9164, std.dev.: 0.0210) MultiSource/Benchmarks/Bullet/bullet: 2.03% (37.0925 => 37.8446, std.dev.: 0.0739) MultiSource/Applications/kimwitu++/kc: 1.93% (18.8170 => 19.1811, std.dev.: 0.0586) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0152) MultiSource/Applications/SPASS/SPASS: 1.28% (17.5484 => 17.7724, std.dev.: 0.0518) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.16% (15.2282 => 15.4042, std.dev.: 0.0366) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 12.22% (2.8802 => 3.2322, std.dev.: 0.0241) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (25.8896 => 26.7457, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0250) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.0643 => 4.1083, std.dev.: 0.0160) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/perlin: -16.67% (0.0720 => 0.0600, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -5.97% (1.3401 => 1.2601, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.86% (1.2601 => 1.2241, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.60% (4.2563 => 4.1883, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 07:45:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 09:45:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430144502.96F9F2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25165?compare_to=25164&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25165, Order: 207621, Start Time: 2014-04-30 10:09:35, End Time: 2014-04-30 14:51:49 To: 25164, Order: 207620, Start Time: 2014-04-30 09:46:28, End Time: 2014-04-30 14:28:03 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 11 (117 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (969 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 100.00% (0.0160 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/objinst: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.84% (0.3040 => 0.3400, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.62% (0.2320 => 0.2520, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.45% (0.6960 => 0.7200, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.93% (1.4481 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 15.07% (1.1681 => 1.3441, std.dev.: 0.0496) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.81% (0.1080 => 0.1240, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.55% (0.2200 => 0.2520, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 12.00% (0.2000 => 0.2240, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.84% (0.3040 => 0.3400, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0120) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0113) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: 8.86% (0.3160 => 0.3440, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.78% (6.0160 => 6.4840, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.99% (1.1441 => 1.2241, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/18-imp/imp: 6.80% (0.4120 => 0.4400, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0787) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/EH/except: 5.00% (0.2400 => 0.2520, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0481) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3800 => 1.4360, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.9200 => 5.1080, std.dev.: 0.0459) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0283) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0480) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.6080 => 0.6280, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0205) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.10% (4.9000 => 5.0520, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 2.97% (17.6165 => 18.1405, std.dev.: 0.0590) MultiSource/Applications/sqlite3/sqlite3: 2.64% (23.7574 => 24.3855, std.dev.: 0.0471) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (7.8562 => 8.0602, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.50% (48.1088 => 49.3130, std.dev.: 0.1042) MultiSource/Applications/oggenc/oggenc: 2.48% (5.7964 => 5.9404, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: 2.39% (37.0925 => 37.9805, std.dev.: 0.0749) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1211, std.dev.: 0.0437) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0517) MultiSource/Applications/ClamAV/clamscan: 1.24% (17.4082 => 17.6242, std.dev.: 0.0673) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (15.2282 => 15.4002, std.dev.: 0.0337) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 3.51% (5.8164 => 6.0204, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (25.8896 => 26.7337, std.dev.: 0.0262) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0204) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0552) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -26.32% (0.0760 => 0.0560, std.dev.: 0.0073) SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -6.87% (1.3401 => 1.2481, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 07:54:02 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 07:54:02 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430145503.9C84C50309F6@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19429 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207651 Blamelist: eugenis BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 08:07:29 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 08:07:29 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430150742.220915030C19@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19430 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207654 Blamelist: alexmc,tstellar Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 30 08:16:30 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 10:16:30 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430151630.CBF242A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25166?compare_to=25165&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25166, Order: 207623, Start Time: 2014-04-30 10:39:30, End Time: 2014-04-30 15:23:18 To: 25165, Order: 207621, Start Time: 2014-04-30 10:09:35, End Time: 2014-04-30 14:51:49 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 23 (98 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1089 (990 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/div: 100.00% (0.0160 => 0.0320, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-6: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 26.67% (0.0600 => 0.0760, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.00% (0.0800 => 0.1000, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.75% (0.0640 => 0.0760, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.34% (0.2320 => 0.2560, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3000 => 0.3160, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2320 => 0.2440, std.dev.: 0.0041) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.02% (1.1960 => 1.2560, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/lists1: 4.65% (0.3440 => 0.3600, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 4.29% (0.2800 => 0.2920, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 2.50% (0.8000 => 0.8200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.29% (1.2241 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.89% (1.2721 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.51% (1.3241 => 1.3441, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.04% (1.1441 => 1.2361, std.dev.: 0.0142) MultiSource/Applications/lemon/lemon: 5.46% (0.9521 => 1.0041, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.02% (3.9722 => 4.0923, std.dev.: 0.0397) SingleSource/Benchmarks/Misc/ffbench: 1.35% (0.8921 => 0.9041, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9442 => 3.9922, std.dev.: 0.0131) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0042) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0104) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.03% (1.1961 => 1.3161, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.80% (1.1841 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.75% (1.2721 => 1.3961, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.62% (0.6240 => 0.6840, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.49% (1.2721 => 1.3801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.39% (1.1921 => 1.2921, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.96% (1.1561 => 1.2481, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (6.0160 => 6.4520, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (10.6960 => 11.4280, std.dev.: 0.0752) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.43% (1.3681 => 1.4561, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0070) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.72% (1.1880 => 1.2560, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0172) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (8.1441 => 8.5521, std.dev.: 0.0430) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.91% (0.6520 => 0.6840, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.9200 => 5.1280, std.dev.: 0.0463) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0234) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7880 => 0.8200, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 3.89% (4.5200 => 4.6960, std.dev.: 0.0241) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0407) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0327) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (5.8000 => 5.9720, std.dev.: 0.0494) MultiSource/Applications/sqlite3/sqlite3: 2.95% (23.7574 => 24.4575, std.dev.: 0.0435) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0103) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.66% (48.1088 => 49.3889, std.dev.: 0.1154) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0423) MultiSource/Applications/oggenc/oggenc: 2.35% (5.7964 => 5.9324, std.dev.: 0.0127) MultiSource/Benchmarks/Bullet/bullet: 2.17% (37.0925 => 37.8965, std.dev.: 0.0927) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (4.0122 => 4.0763, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 1.51% (18.8170 => 19.1011, std.dev.: 0.0544) MultiSource/Applications/SPASS/SPASS: 1.34% (17.5484 => 17.7844, std.dev.: 0.0497) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0186) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0045) SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -6.57% (1.3401 => 1.2521, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0055) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.6165 => 8.4765, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 08:46:53 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 08:46:53 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430154709.B1F0450312A9@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19431 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207655 Blamelist: matheusalmeida BUILD FAILED: exception interrupted sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 30 10:14:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 12:14:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430171436.8D98C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25167?compare_to=25166&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25167, Order: 207639, Start Time: 2014-04-30 12:42:27, End Time: 2014-04-30 17:21:17 To: 25166, Order: 207623, Start Time: 2014-04-30 10:39:30, End Time: 2014-04-30 15:23:18 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (110 on baseline) Performance Improvements: 2 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1096 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0025) SingleSource/Regression/C++/EH/exception_spec_test: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.53% (0.2280 => 0.2520, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 4.24% (0.9440 => 0.9840, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 2.46% (1.1400 => 1.1680, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.25% (1.2441 => 1.2721, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.9561 => 0.9721, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.60% (1.2481 => 1.2681, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.23% (1.3001 => 1.3161, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.14% (5.9720 => 6.0400, std.dev.: 0.0189) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-05-31-CastToBool: -57.14% (0.0280 => 0.0120, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.80% (5.5443 => 5.4443, std.dev.: 0.0330) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0041) SingleSource/Regression/C++/pointer_member: 150.00% (0.0080 => 0.0200, std.dev.: 0.0033) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.97% (1.1361 => 1.2721, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.15% (1.1841 => 1.3161, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.37% (1.1961 => 1.3201, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.09% (1.1441 => 1.2481, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0639) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3920 => 0.4160, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.02% (0.6640 => 0.7040, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9200 => 0.9720, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0189) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (8.1441 => 8.5321, std.dev.: 0.0516) MultiSource/Benchmarks/MallocBench/gs/gs: 4.55% (4.9200 => 5.1440, std.dev.: 0.0349) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.8000 => 6.0400, std.dev.: 0.0189) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0171) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0319) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0448) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0239) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0232) MultiSource/Applications/Burg/burg: 3.84% (1.4600 => 1.5160, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/football/football: 3.80% (0.9480 => 0.9840, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (4.9000 => 5.0720, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: 3.00% (17.6165 => 18.1445, std.dev.: 0.0502) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.93% (48.1088 => 49.5169, std.dev.: 0.0700) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.91% (1.3760 => 1.4160, std.dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 2.74% (23.7574 => 24.4095, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.8322 => 2.9082, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 2.41% (37.0925 => 37.9846, std.dev.: 0.0821) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0295) MultiSource/Applications/kimwitu++/kc: 2.08% (18.8170 => 19.2090, std.dev.: 0.0558) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.9561 => 0.9721, std.dev.: 0.0059) MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.64% (1.2200 => 1.2400, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 1.55% (17.5484 => 17.8204, std.dev.: 0.0478) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0188) MultiSource/Applications/ClamAV/clamscan: 1.13% (17.4082 => 17.6042, std.dev.: 0.0446) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5882 => 2.6162, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (15.2282 => 15.3842, std.dev.: 0.0425) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0268) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (25.8896 => 26.7257, std.dev.: 0.0378) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.82% (2.1921 => 2.2321, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 1.34% (21.1533 => 21.4373, std.dev.: 0.0661) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0027) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -6.57% (1.3401 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0061) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: -1.34% (2.3841 => 2.3521, std.dev.: 0.0122) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 5.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 10:21:01 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 12:21:01 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140430172101.E89F52A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25168?compare_to=25158&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25168, Order: 207641, Start Time: 2014-04-30 12:45:14, End Time: 2014-04-30 17:27:48 To: 25158, Order: 207618, Start Time: 2014-04-30 07:41:36, End Time: 2014-04-30 12:24:22 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 18 (168 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (913 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/random: 66.67% (0.0240 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 8.33% (0.2880 => 0.3120, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.19% (1.0800 => 1.1360, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.17% (0.2320 => 0.2440, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.55% (0.2640 => 0.2760, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.4440 => 0.4640, std.dev.: 0.0057) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.59% (1.3360 => 1.3840, std.dev.: 0.0101) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.58% (1.3400 => 1.3880, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 2.50% (0.4800 => 0.4920, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 1.87% (4.9280 => 5.0200, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.9441 => 0.9601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.34% (1.4921 => 1.5121, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.11% (1.4401 => 1.4561, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0086) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7364, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0078) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0030) SingleSource/UnitTests/2002-05-03-NotTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 100.00% (0.0120 => 0.0240, std.dev.: 0.0028) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Bubblesort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 41.18% (0.0680 => 0.0960, std.dev.: 0.0077) SingleSource/UnitTests/vla: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-1: 33.33% (0.0360 => 0.0480, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 21.74% (0.0920 => 0.1120, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.62% (0.1480 => 0.1800, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/almabench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: 20.83% (0.0960 => 0.1160, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.55% (0.2920 => 0.3520, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.45% (0.1760 => 0.2120, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: 18.18% (0.1760 => 0.2080, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/mason/mason: 17.65% (0.0680 => 0.0800, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.15% (0.1320 => 0.1520, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.79% (0.1160 => 0.1320, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.58% (0.3240 => 0.3680, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 13.55% (0.6200 => 0.7040, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: 13.10% (0.3360 => 0.3800, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.6600 => 0.7400, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.76% (0.2040 => 0.2280, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0092) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.94% (1.0240 => 1.1360, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.64% (0.1880 => 0.2080, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.55% (1.4401 => 1.5921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.41% (1.6521 => 1.8241, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.39% (1.4241 => 1.5721, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.34% (0.3480 => 0.3840, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.91% (1.8161 => 1.9961, std.dev.: 0.0080) MultiSource/Applications/viterbi/viterbi: 9.80% (0.2040 => 0.2240, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0066) MultiSource/Applications/obsequi/Obsequi: 9.42% (1.8680 => 2.0440, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.31% (1.4601 => 1.5961, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.28% (1.1640 => 1.2720, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.20% (1.6081 => 1.7561, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.16% (1.4841 => 1.6201, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 8.93% (0.2240 => 0.2440, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.89% (1.4841 => 1.6161, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.82% (0.1360 => 0.1480, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.78% (1.5481 => 1.6841, std.dev.: 0.0074) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.66% (1.5241 => 1.6561, std.dev.: 0.0141) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.2320 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.4961 => 1.6241, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.44% (1.6121 => 1.7481, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.44% (1.6121 => 1.7481, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.33% (1.7761 => 1.9241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.29% (1.7361 => 1.8801, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8881 => 0.9601, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.07% (1.7841 => 1.9281, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2480 => 0.2680, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.89% (0.4560 => 0.4920, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.85% (1.5281 => 1.6481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.61% (1.4201 => 1.5281, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.43% (0.7000 => 0.7520, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.30% (1.4801 => 1.5881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.04% (11.6440 => 12.4640, std.dev.: 0.0552) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.4040 => 0.4320, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.91% (1.4481 => 1.5481, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.78% (1.4161 => 1.5121, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.68% (1.4361 => 1.5321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.59% (1.4561 => 1.5521, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.58% (1.5801 => 1.6841, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.49% (1.5401 => 1.6401, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.48% (1.4201 => 1.5121, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.44% (1.7400 => 1.8520, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.8440 => 1.9600, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (6.4680 => 6.8680, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.15% (0.2600 => 0.2760, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.08% (0.7240 => 0.7680, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.05% (1.5201 => 1.6121, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.03% (0.7960 => 0.8440, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.99% (1.4681 => 1.5561, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.9681 => 1.0241, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (9.4842 => 10.0322, std.dev.: 0.0388) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.63% (0.2840 => 0.3000, std.dev.: 0.0054) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.49% (1.3120 => 1.3840, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.46% (1.4640 => 1.5440, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/fibo: 5.45% (0.2200 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 5.45% (0.4400 => 0.4640, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.31% (1.7320 => 1.8240, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (5.8121 => 6.1201, std.dev.: 0.0450) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.5480 => 1.6280, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/gs/gs: 4.93% (5.3600 => 5.6240, std.dev.: 0.0487) MultiSource/Applications/lua/lua: 4.85% (4.7880 => 5.0200, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2480 => 0.2600, std.dev.: 0.0036) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.83% (1.3240 => 1.3880, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.80% (1.5841 => 1.6601, std.dev.: 0.0128) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.7721 => 1.8521, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (2.0440 => 2.1360, std.dev.: 0.0261) MultiSource/Applications/treecc/treecc: 4.49% (2.5840 => 2.7000, std.dev.: 0.0213) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 4.48% (0.2680 => 0.2800, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.0443 => 10.4843, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.5600 => 1.6280, std.dev.: 0.0225) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (6.5440 => 6.8240, std.dev.: 0.0332) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.25% (50.0290 => 52.1530, std.dev.: 0.0509) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (6.5080 => 6.7840, std.dev.: 0.0557) SingleSource/Benchmarks/Misc/flops: 4.17% (0.4800 => 0.5000, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 4.15% (21.9606 => 22.8728, std.dev.: 0.0685) MultiSource/Applications/hbd/hbd: 3.92% (1.7360 => 1.8040, std.dev.: 0.0243) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.86% (1.6601 => 1.7241, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.7480 => 0.7760, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (3.0282 => 3.1362, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: 3.45% (38.4046 => 39.7286, std.dev.: 0.0762) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (2.3281 => 2.4082, std.dev.: 0.0129) MultiSource/Applications/oggenc/oggenc: 3.32% (6.9844 => 7.2165, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3680 => 0.3800, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 3.23% (3.9681 => 4.0961, std.dev.: 0.0175) MultiSource/Applications/SPASS/SPASS: 3.08% (18.4404 => 19.0085, std.dev.: 0.0500) MultiSource/Applications/ClamAV/clamscan: 3.00% (19.0444 => 19.6164, std.dev.: 0.0507) MultiSource/Applications/siod/siod: 2.95% (2.7162 => 2.7962, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.74% (1.0201 => 1.0481, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (16.3483 => 16.7883, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (4.1843 => 4.2923, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 2.54% (19.6891 => 20.1891, std.dev.: 0.0334) MultiSource/Applications/sqlite3/sqlite3: 1.26% (25.6856 => 26.0096, std.dev.: 0.0291) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (13.0563 => 13.2043, std.dev.: 0.0315) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.1044 => 6.1724, std.dev.: 0.0227) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.08% (2.1401 => 2.4842, std.dev.: 0.0523) MultiSource/Applications/siod/siod: 9.79% (2.8602 => 3.1402, std.dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 2.52% (6.6684 => 6.8364, std.dev.: 0.0513) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (3.9922 => 4.0883, std.dev.: 0.0218) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.30% (8.1845 => 8.3725, std.dev.: 0.0213) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 1.60% (11.5087 => 11.6927, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 1.27% (5.9724 => 6.0484, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.21% (3.9842 => 4.0323, std.dev.: 0.0167) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.99% (10.6247 => 2.0201, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -68.62% (2.9442 => 0.9240, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -32.99% (1.5641 => 1.0481, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.36% (91.8497 => 49.2711, std.dev.: 9.5348) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.46% (26.0616 => 17.0811, std.dev.: 0.1816) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.15% (50.3031 => 33.1221, std.dev.: 0.1886) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.87% (42.1466 => 28.7138, std.dev.: 0.3712) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.81% (3.1122 => 2.3401, std.dev.: 0.1065) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -14.44% (7.7845 => 6.6604, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: -11.05% (3.5122 => 3.1242, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.77% (1.2481 => 1.1761, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.76% (1.3841 => 1.3321, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.58% (4.8083 => 4.6843, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.23% (4.1243 => 4.0323, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.84% (2.8202 => 2.7682, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (2.8442 => 2.7962, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.63% (2.4602 => 2.4202, std.dev.: 0.0118) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.1563 => 5.0923, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 10:26:14 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 12:26:14 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140430172614.7C66C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25169?compare_to=25159&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25169, Order: 207641, Start Time: 2014-04-30 12:47:54, End Time: 2014-04-30 17:33:00 To: 25159, Order: 207618, Start Time: 2014-04-30 07:41:41, End Time: 2014-04-30 12:27:02 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 16 (149 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (924 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ms_struct-bitfield-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/treeadd/treeadd: 50.00% (0.0400 => 0.0600, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 8.33% (0.1440 => 0.1560, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.69% (0.1560 => 0.1680, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 6.10% (0.3280 => 0.3480, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.42% (0.4520 => 0.4720, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.66% (0.7520 => 0.7720, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.51% (1.9120 => 1.9600, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.48% (1.7720 => 1.8160, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.09% (2.1921 => 2.2161, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 8.96% (0.2680 => 0.2920, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.31% (0.7240 => 0.7480, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.09% (1.1481 => 1.1721, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.12% (2.1361 => 2.1121, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.91% (17.6723 => 19.7764, std.dev.: 0.0719) MultiSource/Applications/sqlite3/sqlite3: 1425.42% (1.7001 => 25.9336, std.dev.: 0.0373) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.04% (50.1010 => 52.1250, std.dev.: 0.0975) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (1.0520 => 1.1240, std.dev.: 0.0280) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.78% (11.3920 => 12.3920, std.dev.: 0.0659) SingleSource/Benchmarks/Misc/oourafft: -73.23% (11.3407 => 3.0362, std.dev.: 0.0129) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0283, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3561, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0096) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0143) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0066) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 150.00% (0.0080 => 0.0200, std.dev.: 0.0044) SingleSource/Regression/C/sumarray2d: 120.00% (0.0200 => 0.0440, std.dev.: 0.0020) SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032) SingleSource/UnitTests/2003-08-05-CastFPToUint: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-7: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/17-bintr/bintr: 38.89% (0.0720 => 0.1000, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Bubblesort: 37.50% (0.0320 => 0.0440, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/FloatMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.00% (0.1440 => 0.1800, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.28% (0.1720 => 0.2000, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.13% (0.2480 => 0.2880, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.44% (1.8281 => 2.0921, std.dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.4160 => 0.4760, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.07% (1.8201 => 2.0761, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.98% (1.8601 => 2.1201, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.79% (1.8561 => 2.1121, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.72% (1.8361 => 2.0881, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.64% (0.0880 => 0.1000, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.49% (2.1361 => 2.4242, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.43% (1.8761 => 2.1281, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.41% (2.0281 => 2.3001, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.36% (1.9161 => 2.1721, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.11% (1.9521 => 2.2081, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.55% (1.9121 => 2.1521, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.43% (0.7400 => 0.8320, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.15% (1.9761 => 2.2161, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.05% (1.8921 => 2.1201, std.dev.: 0.0173) MultiSource/Benchmarks/NPB-serial/is/is: 12.00% (0.1000 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.73% (1.8081 => 2.0201, std.dev.: 0.0072) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.36% (2.1121 => 2.3521, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.36% (1.7961 => 2.0001, std.dev.: 0.0087) SingleSource/Regression/C/bigstack: 11.11% (0.1800 => 0.2000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.95% (1.9001 => 2.1081, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.91% (1.7961 => 1.9921, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.87% (0.1840 => 0.2040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.71% (0.2240 => 0.2480, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.53% (0.3040 => 0.3360, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.42% (1.8801 => 2.0761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.42% (1.9201 => 2.1201, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.38% (1.7721 => 1.9561, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.34% (0.1160 => 0.1280, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.32% (1.8601 => 2.0521, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.25% (2.0681 => 2.2801, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.8361 => 2.0241, std.dev.: 0.0115) MultiSource/Applications/obsequi/Obsequi: 10.02% (1.8760 => 2.0640, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.98% (1.8441 => 2.0281, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.86% (1.9481 => 2.1401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.67% (1.8201 => 1.9961, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.66% (0.7040 => 0.7720, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.52% (0.3360 => 0.3680, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 9.43% (0.2120 => 0.2320, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.35% (1.7961 => 1.9641, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4320 => 0.4720, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 8.66% (1.0160 => 1.1040, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/EH/except: 8.62% (0.2320 => 0.2520, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.6800 => 0.7360, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.69% (0.7280 => 0.7840, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.35% (6.4800 => 6.9560, std.dev.: 0.0340) MultiSource/Applications/sgefa/sgefa: 7.14% (0.6160 => 0.6600, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (1.6960 => 1.8160, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.2880 => 0.3080, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.8440 => 1.9600, std.dev.: 0.0175) SingleSource/Benchmarks/Linpack/linpack-pc: 6.25% (0.3200 => 0.3400, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 6.01% (1.1320 => 1.2000, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3360 => 0.3560, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: 5.93% (0.4720 => 0.5000, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (0.4760 => 0.5040, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (2.9721 => 3.1442, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3560 => 0.3760, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3600 => 0.3800, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 5.45% (0.4400 => 0.4640, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.17% (0.2320 => 0.2440, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0182) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.55% (0.6160 => 0.6440, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.49% (0.9801 => 1.0241, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (9.6042 => 10.0282, std.dev.: 0.0702) MultiSource/Applications/JM/ldecod/ldecod: 4.38% (10.2283 => 10.6764, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (5.8281 => 6.0801, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/hash: 4.31% (0.4640 => 0.4840, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 4.25% (0.8480 => 0.8840, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (6.5320 => 6.8040, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 3.93% (5.3960 => 5.6080, std.dev.: 0.0473) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.4400 => 0.4560, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 3.59% (4.7920 => 4.9640, std.dev.: 0.0349) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3360 => 0.3480, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 3.55% (2.5880 => 2.6800, std.dev.: 0.0216) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.12% (1.6641 => 1.7161, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (6.5360 => 6.7400, std.dev.: 0.0511) MultiSource/Applications/SPASS/SPASS: 3.11% (18.5284 => 19.1046, std.dev.: 0.0397) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (3.0562 => 3.1482, std.dev.: 0.0117) MultiSource/Applications/oggenc/oggenc: 3.01% (7.0524 => 7.2645, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.94% (0.5440 => 0.5600, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 2.91% (1.7841 => 1.8361, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (2.3401 => 2.4082, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 2.85% (38.6366 => 39.7366, std.dev.: 0.0548) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (16.3003 => 16.7403, std.dev.: 0.0646) MultiSource/Applications/JM/lencod/lencod: 2.68% (22.2206 => 22.8167, std.dev.: 0.0387) MultiSource/Applications/d/make_dparser: 2.62% (3.9761 => 4.0801, std.dev.: 0.0271) MultiSource/Applications/kimwitu++/kc: 2.42% (19.8291 => 20.3091, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (13.0363 => 13.1763, std.dev.: 0.0505) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 21.64% (0.9241 => 1.1241, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.97% (2.1201 => 2.4162, std.dev.: 0.0637) MultiSource/Applications/siod/siod: 9.92% (2.8642 => 3.1482, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.11% (1.6561 => 1.7241, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 4.01% (7.3725 => 7.6685, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 3.09% (6.5964 => 6.8004, std.dev.: 0.0296) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.82% (3.7442 => 3.8122, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.60% (11.4967 => 11.6807, std.dev.: 0.0183) MultiSource/Applications/JM/lencod/lencod: 1.43% (8.1285 => 8.2445, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9684 => 6.0524, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.10% (8.3605 => 8.4525, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.03% (5.0243 => 5.0763, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.62% (10.4007 => 2.0161, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -34.00% (1.5881 => 1.0481, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.6880 => 0.6640, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.16% (94.8339 => 49.1591, std.dev.: 8.5269) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.14% (49.9431 => 32.8941, std.dev.: 0.1402) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.88% (25.7136 => 17.0011, std.dev.: 0.1601) SingleSource/Benchmarks/CoyoteBench/fftbench: -22.79% (3.0722 => 2.3721, std.dev.: 0.0962) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.47% (37.0863 => 28.7538, std.dev.: 0.2796) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0036) SingleSource/Benchmarks/Linpack/linpack-pc: -14.84% (7.8165 => 6.6564, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.57% (1.2681 => 1.1721, std.dev.: 0.0082) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: -4.35% (1.3801 => 1.3201, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.58% (4.8043 => 4.7283, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: -1.53% (2.3521 => 2.3161, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (5.1563 => 5.0843, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.30% (2.7722 => 2.7362, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 10:28:02 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 12:28:02 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140430172802.C1ACC2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25170?compare_to=25160&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25170, Order: 207641, Start Time: 2014-04-30 12:48:46, End Time: 2014-04-30 17:34:46 To: 25160, Order: 207618, Start Time: 2014-04-30 07:41:36, End Time: 2014-04-30 12:27:55 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (0 on baseline) Performance Improvements: 1 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1102 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.00% (0.0800 => 0.0920, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.78% (0.2360 => 0.2520, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 6.56% (0.2440 => 0.2600, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.4440 => 0.4640, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.40% (0.3640 => 0.3800, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.38% (1.7760 => 1.8360, std.dev.: 0.0153) MultiSource/Benchmarks/nbench/nbench: 1.48% (1.8961 => 1.9241, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -10.00% (0.1600 => 0.1440, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.18% (0.7280 => 0.5520, std.dev.: 0.0142) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 4.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 10:28:21 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 12:28:21 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140430172821.AB4C62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25171?compare_to=25161&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25171, Order: 207641, Start Time: 2014-04-30 12:49:59, End Time: 2014-04-30 17:35:10 To: 25161, Order: 207618, Start Time: 2014-04-30 07:41:16, End Time: 2014-04-30 12:29:01 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 15 (168 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (922 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 14.29% (0.0840 => 0.0960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.64% (0.1880 => 0.2080, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.84% (0.2040 => 0.2200, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.56% (0.3600 => 0.3800, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 3.68% (1.0880 => 1.1280, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.71% (1.4041 => 1.4281, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.65% (1.4521 => 1.4761, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.89% (0.1800 => 0.1960, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.06% (0.9241 => 0.9801, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/ary3: 1.26% (3.4962 => 3.5402, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2350.00% (0.0320 => 0.7840, std.dev.: 0.0100) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0084) SingleSource/Regression/C/sumarray2d: 1000.00% (0.0360 => 0.3960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0091) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: 325.91% (0.2320 => 0.9881, std.dev.: 0.0130) SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 190.48% (0.2520 => 0.7320, std.dev.: 0.0191) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 111.54% (0.1040 => 0.2200, std.dev.: 0.0062) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: 80.00% (0.0200 => 0.0360, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 77.78% (0.0360 => 0.0640, std.dev.: 0.0038) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: 74.29% (0.1400 => 0.2440, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.00% (0.0800 => 0.1360, std.dev.: 0.0043) SingleSource/Regression/C/bigstack: 61.54% (0.0520 => 0.0840, std.dev.: 0.0045) SingleSource/Regression/C/sumarray: 55.56% (0.0360 => 0.0560, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 52.27% (0.7040 => 1.0720, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0056) MultiSource/Benchmarks/NPB-serial/is/is: 38.89% (0.0720 => 0.1000, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 35.00% (0.1600 => 0.2160, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: 34.62% (0.1040 => 0.1400, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.28% (1.2160 => 1.5721, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 29.17% (0.0960 => 0.1240, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 26.67% (0.0600 => 0.0760, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.65% (1.2321 => 1.5481, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.87% (1.2401 => 1.5361, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/power/power: 23.68% (0.1520 => 0.1880, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.08% (0.1040 => 0.1280, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.63% (1.1841 => 1.4521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.14% (1.1561 => 1.4121, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.00% (1.2001 => 1.4641, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 21.74% (0.0920 => 0.1120, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 21.05% (0.0760 => 0.0920, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.92% (1.3001 => 1.5721, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.83% (0.0960 => 0.1160, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.74% (1.2921 => 1.5601, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.45% (1.2321 => 1.4841, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.35% (1.1401 => 1.3721, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.28% (1.1441 => 1.3761, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.28% (1.1441 => 1.3761, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.19% (1.2281 => 1.4761, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.72% (1.1361 => 1.3601, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.65% (1.1601 => 1.3881, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.30% (1.3681 => 1.6321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.17% (1.2521 => 1.4921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.15% (1.2321 => 1.4681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 18.88% (8.5802 => 10.2003, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.83% (1.2321 => 1.4641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.69% (1.2841 => 1.5241, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.33% (1.2001 => 1.4201, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.21% (1.3841 => 1.6361, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.90% (1.1841 => 1.3961, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.57% (1.2521 => 1.4721, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 15.79% (0.0760 => 0.0880, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 15.76% (19.5406 => 22.6207, std.dev.: 0.0549) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.56% (0.1800 => 0.2080, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.07% (5.3360 => 6.1401, std.dev.: 0.0374) MultiSource/Benchmarks/nbench/nbench: 14.50% (1.3521 => 1.5481, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/fbench: 14.29% (0.0840 => 0.0960, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.92% (0.3160 => 0.3600, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.79% (1.7400 => 1.9800, std.dev.: 0.0230) MultiSource/Applications/sgefa/sgefa: 12.50% (0.4480 => 0.5040, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.90% (0.3360 => 0.3760, std.dev.: 0.0090) SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0057) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.07% (0.5560 => 0.6120, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/distray/distray: 10.00% (0.1200 => 0.1320, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 9.86% (0.2840 => 0.3120, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 9.49% (11.3843 => 12.4643, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.20% (0.3480 => 0.3800, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.10% (5.6680 => 6.1840, std.dev.: 0.0400) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.08% (5.7280 => 6.2480, std.dev.: 0.0345) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.82% (0.1360 => 0.1480, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 8.78% (6.2844 => 6.8364, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.63% (11.4440 => 12.4320, std.dev.: 0.0507) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2920 => 0.3160, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2440 => 0.2640, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0109) MultiSource/Applications/spiff/spiff: 7.63% (1.0480 => 1.1280, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.7640 => 0.8200, std.dev.: 0.0151) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2320 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (9.5802 => 10.2322, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.3000 => 0.3200, std.dev.: 0.0070) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.31% (0.4440 => 0.4720, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wc: 6.25% (0.2560 => 0.2720, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (1.1240 => 1.1920, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.02% (0.3320 => 0.3520, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.83% (0.4800 => 0.5080, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/matrix: 5.80% (0.2760 => 0.2920, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.69% (1.4760 => 1.5600, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (1.0680 => 1.1200, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.4120 => 0.4320, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (0.4960 => 0.5200, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 4.78% (0.8360 => 0.8760, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 4.61% (4.7720 => 4.9920, std.dev.: 0.0301) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (5.3840 => 5.6240, std.dev.: 0.0425) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.45% (6.8280 => 7.1320, std.dev.: 0.0434) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.26% (49.1529 => 51.2489, std.dev.: 0.0816) MultiSource/Applications/SIBsim4/SIBsim4: 4.25% (1.6961 => 1.7681, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7600 => 1.8240, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (2.0920 => 2.1680, std.dev.: 0.0184) MultiSource/Applications/ClamAV/clamscan: 3.14% (19.2243 => 19.8284, std.dev.: 0.0519) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.1480 => 1.1840, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 3.13% (24.7575 => 25.5336, std.dev.: 0.0370) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.76% (0.5800 => 0.5960, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (2.2081 => 2.2681, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 2.47% (19.7491 => 20.2371, std.dev.: 0.0838) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (2.7282 => 2.7922, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 1.93% (39.0726 => 39.8286, std.dev.: 0.0691) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0124 => 6.1044, std.dev.: 0.0260) MultiSource/Applications/SPASS/SPASS: 1.47% (18.7966 => 19.0725, std.dev.: 0.0425) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.05% (3.0402 => 3.0722, std.dev.: 0.0112) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.04% (29.3298 => 29.6339, std.dev.: 0.0505) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 19.91% (0.9241 => 1.1081, std.dev.: 0.0109) SingleSource/Benchmarks/Stanford/Treesort: 18.75% (0.0640 => 0.0760, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 3.75% (2.9842 => 3.0962, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.50% (3.3122 => 3.4282, std.dev.: 0.0420) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.28% (6.8204 => 7.0444, std.dev.: 0.0398) MultiSource/Benchmarks/Olden/bisort/bisort: 2.75% (0.7280 => 0.7480, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (1.3521 => 1.3881, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.3085 => 7.5005, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.87% (1.0681 => 1.0881, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (25.4536 => 25.8736, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4802 => 3.5362, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.32% (4.2403 => 4.2963, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.11% (3.2362 => 3.2722, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0101) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.46% (21.6534 => 17.8731, std.dev.: 0.0403) SingleSource/Benchmarks/Linpack/linpack-pc: -16.54% (7.8605 => 6.5604, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -9.79% (3.4722 => 3.1322, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.63% (2.2241 => 2.0321, std.dev.: 0.0036) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.44% (5.2763 => 4.9363, std.dev.: 0.0623) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.69% (2.9242 => 2.8162, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: -3.24% (1.3601 => 1.3161, std.dev.: 0.0153) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.68% (4.7643 => 4.6843, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (5.0963 => 5.0163, std.dev.: 0.0172) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 10:32:33 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 12:32:33 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140430173233.B76E02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25172?compare_to=25162&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25172, Order: 207641, Start Time: 2014-04-30 12:51:18, End Time: 2014-04-30 17:39:20 To: 25162, Order: 207618, Start Time: 2014-04-30 07:41:39, End Time: 2014-04-30 12:30:06 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (148 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (921 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/2003-06-13-Crasher: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: 45.45% (0.0440 => 0.0640, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0520 => 0.0640, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 13.79% (0.2320 => 0.2640, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/rem: 12.50% (0.1280 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: 12.00% (0.2000 => 0.2240, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.2520 => 0.2720, std.dev.: 0.0060) SingleSource/Benchmarks/Linpack/linpack-pc: 4.82% (0.3320 => 0.3480, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4800 => 0.4960, std.dev.: 0.0056) MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.88% (1.3880 => 1.4280, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (0.9161 => 0.9361, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 8.95% (1.0721 => 1.1681, std.dev.: 0.0358) SingleSource/Benchmarks/Dhrystone/fldry: 2.74% (0.5840 => 0.6000, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 1.83% (1.3121 => 1.3361, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0091) SingleSource/UnitTests/2002-10-12-StructureArgs: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0047) SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0160 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.85% (1.6881 => 2.0401, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.62% (1.6681 => 2.0121, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.55% (1.7321 => 2.0881, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.52% (1.6961 => 2.0441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.41% (1.7441 => 2.1001, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.33% (1.6921 => 2.0361, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.23% (1.7201 => 2.0681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.14% (1.7081 => 2.0521, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 20.13% (1.8081 => 2.1721, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 19.81% (1.6961 => 2.0321, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.80% (1.9801 => 2.3721, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.76% (1.6801 => 2.0121, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.68% (1.7481 => 2.0921, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.64% (1.7921 => 2.1441, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 19.62% (1.6921 => 2.0241, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.57% (1.6761 => 2.0041, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.54% (1.7401 => 2.0801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.51% (1.8041 => 2.1561, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.50% (1.7641 => 2.1081, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.49% (1.7241 => 2.0601, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.31% (1.9881 => 2.3721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.90% (1.8201 => 2.1641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.78% (1.7681 => 2.1001, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.62% (1.8041 => 2.1401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.60% (1.8281 => 2.1681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.43% (1.8881 => 2.2361, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.13% (1.9641 => 2.3201, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.08% (1.8361 => 2.1681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.61% (1.9081 => 2.2441, std.dev.: 0.0144) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.35% (1.9601 => 2.3001, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.21% (1.9761 => 2.3161, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.77% (1.9801 => 2.3121, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.79% (0.1160 => 0.1320, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 13.33% (0.1200 => 0.1360, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.04% (0.1840 => 0.2080, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.12% (0.1320 => 0.1480, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.76% (0.6120 => 0.6840, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.54% (0.2080 => 0.2320, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 10.81% (0.1480 => 0.1640, std.dev.: 0.0050) SingleSource/Benchmarks/Linpack/linpack-pc: 10.13% (0.3160 => 0.3480, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 10.00% (0.2000 => 0.2200, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2040 => 0.2240, std.dev.: 0.0055) SingleSource/UnitTests/SignlessTypes/rem: 9.09% (0.1320 => 0.1440, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.8601 => 0.9361, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.54% (0.3280 => 0.3560, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 8.05% (0.3480 => 0.3760, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4600 => 0.4960, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (3.5002 => 3.7642, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.08% (6.7200 => 7.1960, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.75% (11.7880 => 12.5840, std.dev.: 0.0652) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.45% (0.2480 => 0.2640, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0051) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.93% (1.3480 => 1.4280, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.88% (0.4080 => 0.4320, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.5560 => 0.5880, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (1.4160 => 1.4960, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4400 => 0.4640, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (1.6481 => 1.7361, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2280 => 0.2400, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.09% (9.9842 => 10.4922, std.dev.: 0.0362) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.7320 => 1.8200, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.99% (1.5240 => 1.6000, std.dev.: 0.0267) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.97% (0.6440 => 0.6760, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 4.73% (1.1000 => 1.1520, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.60% (0.3480 => 0.3640, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 4.42% (4.7920 => 5.0040, std.dev.: 0.0285) SingleSource/Benchmarks/Misc-C++/bigfib: 4.32% (0.7400 => 0.7720, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0259) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (6.8321 => 7.1081, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.8201 => 1.8921, std.dev.: 0.0189) MultiSource/Applications/SPASS/SPASS: 3.87% (18.4924 => 19.2087, std.dev.: 0.0326) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.79% (1.3720 => 1.4240, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (2.0440 => 2.1200, std.dev.: 0.0139) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (10.3203 => 10.6884, std.dev.: 0.0260) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.40% (51.1089 => 52.8489, std.dev.: 0.1257) MultiSource/Applications/treecc/treecc: 3.36% (2.6200 => 2.7080, std.dev.: 0.0288) MultiSource/Applications/JM/lencod/lencod: 3.04% (22.6287 => 23.3167, std.dev.: 0.0526) MultiSource/Benchmarks/sim/sim: 3.03% (0.3960 => 0.4080, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 2.88% (20.2445 => 20.8285, std.dev.: 0.0682) MultiSource/Benchmarks/Bullet/bullet: 2.71% (38.9366 => 39.9926, std.dev.: 0.0770) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (5.5480 => 5.6920, std.dev.: 0.0480) MultiSource/Applications/kimwitu++/kc: 2.59% (19.7371 => 20.2491, std.dev.: 0.0502) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (16.5963 => 16.9763, std.dev.: 0.0403) MultiSource/Applications/sqlite3/sqlite3: 2.13% (25.1895 => 25.7256, std.dev.: 0.0400) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.09% (4.2203 => 4.3083, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 2.03% (2.7562 => 2.8122, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.99% (6.0244 => 6.1444, std.dev.: 0.0166) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.7722 => 2.8202, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.58% (2.2721 => 2.3081, std.dev.: 0.0104) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (29.4578 => 29.8179, std.dev.: 0.0236) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 24.47% (7.3405 => 9.1366, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 18.53% (0.9281 => 1.1001, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 15.38% (0.2600 => 0.3000, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0118) MultiSource/Applications/siod/siod: 10.18% (2.8282 => 3.1162, std.dev.: 0.0221) SingleSource/Benchmarks/McGill/queens: 3.86% (2.1761 => 2.2601, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.79% (3.4842 => 3.6162, std.dev.: 0.0318) MultiSource/Applications/minisat/minisat: 3.52% (6.8204 => 7.0604, std.dev.: 0.0403) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.31% (1.0881 => 1.1241, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (3.4402 => 3.5362, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (4.2443 => 4.3203, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/salsa20: 1.70% (7.5485 => 7.6765, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.36% (4.1323 => 4.1883, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0180) SingleSource/UnitTests/Vector/constpool: -81.45% (10.9087 => 2.0241, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/nestedloop: -60.59% (2.9642 => 1.1681, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.05% (3.1762 => 1.3641, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.44% (1.5881 => 1.1841, std.dev.: 0.0083) MultiSource/Applications/sgefa/sgefa: -25.26% (0.7600 => 0.5680, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0064) MultiSource/Applications/obsequi/Obsequi: -21.45% (2.6481 => 2.0800, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.99% (7.4801 => 6.2840, std.dev.: 0.0451) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.25% (7.5041 => 6.3600, std.dev.: 0.0408) SingleSource/UnitTests/Vector/multiplies: -9.76% (0.1640 => 0.1480, std.dev.: 0.0049) SingleSource/Regression/C/sumarray2d: -8.94% (0.7160 => 0.6520, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -2.66% (13.5243 => 13.1643, std.dev.: 0.0423) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.00% (1.7001 => 1.3601, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.46% (21.6534 => 17.8731, std.dev.: 0.0363) SingleSource/Benchmarks/Linpack/linpack-pc: -15.28% (7.8005 => 6.6084, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.05% (2.6082 => 2.3721, std.dev.: 0.0878) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: -3.85% (0.6240 => 0.6000, std.dev.: 0.0042) MultiSource/Applications/obsequi/Obsequi: -3.57% (2.1281 => 2.0521, std.dev.: 0.0275) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -2.79% (5.1603 => 5.0163, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/power/power: -2.62% (1.3721 => 1.3361, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.98% (2.6202 => 2.5682, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -1.82% (11.6527 => 11.4407, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: -1.44% (8.3085 => 8.1885, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.43% (4.7603 => 4.6923, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.7041 => 1.6841, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 10:51:19 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 12:51:19 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430175119.0A66E2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25173?compare_to=25167&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25173, Order: 207643, Start Time: 2014-04-30 13:13:40, End Time: 2014-04-30 17:58:04 To: 25167, Order: 207639, Start Time: 2014-04-30 12:42:27, End Time: 2014-04-30 17:21:17 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 14 (120 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (971 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Threads/2010-12-08-tls: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/Regression/C/globalrefs: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-31-CastToBool: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 21.43% (0.0560 => 0.0680, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.0840 => 0.0960, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 14.29% (0.0840 => 0.0960, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1440 => 0.1600, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 10.42% (0.1920 => 0.2120, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.86% (0.2840 => 0.3120, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (1.6041 => 1.6321, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.52% (1.3201 => 1.3401, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.69% (0.1160 => 0.1400, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.31% (1.7281 => 1.6881, std.dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0062) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 29.03% (0.1240 => 0.1600, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 25.00% (0.0480 => 0.0600, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.0840 => 0.0960, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.04% (0.0920 => 0.1040, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.79% (1.1881 => 1.3401, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 11.39% (0.3160 => 0.3520, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.93% (1.2081 => 1.3401, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.00% (0.4400 => 0.4840, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.43% (1.2721 => 1.3921, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.1881 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (1.2481 => 1.3641, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.21% (1.2161 => 1.3281, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.11% (6.0160 => 6.5040, std.dev.: 0.0396) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.30% (1.2601 => 1.3521, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0863) SingleSource/Benchmarks/Shootout-C++/methcall: 6.90% (0.2320 => 0.2480, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.6840 => 0.7280, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.81% (1.3760 => 1.4560, std.dev.: 0.0247) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2320 => 0.2440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.5200 => 1.5960, std.dev.: 0.0225) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (8.1441 => 8.5401, std.dev.: 0.0504) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.71% (1.1880 => 1.2440, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.68% (1.7080 => 1.7880, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.67% (0.8561 => 0.8961, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (4.9200 => 5.1360, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0210) MultiSource/Applications/lua/lua: 4.07% (4.5200 => 4.7040, std.dev.: 0.0350) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (10.4082 => 10.8002, std.dev.: 0.0290) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.67% (4.9000 => 5.0800, std.dev.: 0.0368) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.8000 => 6.0120, std.dev.: 0.0397) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.9640 => 2.0280, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0151) MultiSource/Applications/JM/lencod/lencod: 3.02% (17.6165 => 18.1485, std.dev.: 0.0567) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0141) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.79% (48.1088 => 49.4529, std.dev.: 0.1308) MultiSource/Applications/sqlite3/sqlite3: 2.76% (23.7574 => 24.4135, std.dev.: 0.0336) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (7.8562 => 8.0722, std.dev.: 0.0323) MultiSource/Benchmarks/Bullet/bullet: 2.72% (37.0925 => 38.1006, std.dev.: 0.0628) MultiSource/Applications/kimwitu++/kc: 2.49% (18.8170 => 19.2851, std.dev.: 0.0475) MultiSource/Applications/siod/siod: 2.33% (2.5721 => 2.6321, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9161 => 0.9361, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.12% (5.8400 => 5.9640, std.dev.: 0.0398) MultiSource/Applications/oggenc/oggenc: 1.86% (5.7964 => 5.9044, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (4.0122 => 4.0843, std.dev.: 0.0119) MultiSource/Applications/SPASS/SPASS: 1.71% (17.5484 => 17.8484, std.dev.: 0.0578) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (5.7564 => 5.8204, std.dev.: 0.0198) MultiSource/Applications/d/make_dparser: 1.05% (3.8240 => 3.8641, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0258) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 3.40% (25.8896 => 26.7697, std.dev.: 0.0187) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.33% (0.9601 => 0.9921, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 1.57% (21.1533 => 21.4853, std.dev.: 0.0855) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0032) SingleSource/Benchmarks/SmallPT/smallpt: 1.20% (14.0009 => 14.1689, std.dev.: 0.0471) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.42% (10.8967 => 2.0241, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -5.67% (1.3401 => 1.2641, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0444) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 12:21:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 14:21:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430192156.185722A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25174?compare_to=25173&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25174, Order: 207651, Start Time: 2014-04-30 14:49:03, End Time: 2014-04-30 19:28:42 To: 25173, Order: 207643, Start Time: 2014-04-30 13:13:40, End Time: 2014-04-30 17:58:04 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (115 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (975 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2007-01-04-KNR-Args: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.78% (0.2360 => 0.2520, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 3.45% (0.3480 => 0.3600, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.82% (0.7080 => 0.7280, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.8961 => 0.9161, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.69% (0.3640 => 0.3920, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0066) MultiSource/Benchmarks/llubenchmark/llu: 4.68% (5.1283 => 5.3683, std.dev.: 0.0896) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 133.33% (0.0120 => 0.0280, std.dev.: 0.0061) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.27% (0.1320 => 0.1680, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.58% (0.1240 => 0.1520, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.65% (0.3680 => 0.4440, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3960 => 0.4400, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.88% (1.1761 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.47% (1.1841 => 1.3081, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.84% (1.2201 => 1.3401, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.73% (1.1921 => 1.3081, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (6.0160 => 6.4640, std.dev.: 0.0329) MultiSource/Benchmarks/McCat/05-eks/eks: 7.06% (0.6800 => 0.7280, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.73% (10.6960 => 11.4160, std.dev.: 0.0997) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0127) MultiSource/Benchmarks/sim/sim: 5.88% (0.3400 => 0.3600, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.65% (8.1441 => 8.6041, std.dev.: 0.0413) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (1.7360 => 1.8280, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0195) MultiSource/Applications/lua/lua: 5.13% (4.5200 => 4.7520, std.dev.: 0.0307) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (0.2400 => 0.2520, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.69% (0.2560 => 0.2680, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.1240 => 1.1760, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0074) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.38% (1.1880 => 1.2400, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0345) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (10.4082 => 10.8322, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.1201 => 2.2041, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (4.9200 => 5.1120, std.dev.: 0.0344) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.4320 => 0.4480, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0056) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.21% (48.1088 => 49.6530, std.dev.: 0.0892) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.9000 => 5.0440, std.dev.: 0.0319) MultiSource/Applications/JM/lencod/lencod: 2.93% (17.6165 => 18.1325, std.dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0151) MultiSource/Benchmarks/Bullet/bullet: 2.79% (37.0925 => 38.1286, std.dev.: 0.0655) MultiSource/Applications/kimwitu++/kc: 2.53% (18.8170 => 19.2931, std.dev.: 0.0392) MultiSource/Applications/siod/siod: 2.49% (2.5721 => 2.6361, std.dev.: 0.0124) MultiSource/Applications/treecc/treecc: 2.45% (2.4480 => 2.5080, std.dev.: 0.0211) MultiSource/Applications/sqlite3/sqlite3: 2.39% (23.7574 => 24.3255, std.dev.: 0.0566) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0426) MultiSource/Applications/SPASS/SPASS: 2.10% (17.5484 => 17.9164, std.dev.: 0.0387) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.2480 => 1.2680, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (2.5882 => 2.6282, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (5.7564 => 5.8204, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.95% (0.3360 => 0.3560, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.66% (1.0921 => 1.1321, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0240) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0042) SingleSource/Benchmarks/SmallPT/smallpt: 1.20% (14.0009 => 14.1689, std.dev.: 0.0569) MultiSource/Applications/lambda-0_1_3/lambda: 1.12% (5.0123 => 5.0683, std.dev.: 0.0215) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++/mandel-text: -42.86% (0.0280 => 0.0160, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -6.57% (1.3401 => 1.2521, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0275) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0073) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 12:37:10 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 12:37:10 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430193722.8F419503367B@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19440 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207683 Blamelist: majnemer,samsonov Build succeeded! sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 30 12:32:39 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 14:32:39 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430193239.A1D922A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25175?compare_to=25174&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25175, Order: 207654, Start Time: 2014-04-30 14:57:33, End Time: 2014-04-30 19:39:18 To: 25174, Order: 207651, Start Time: 2014-04-30 14:49:03, End Time: 2014-04-30 19:28:42 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 18 (119 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (970 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/Threads/tls: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0020) SingleSource/Regression/C/sumarraymalloc: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 40.00% (0.0400 => 0.0560, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/random: 37.50% (0.0320 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.00% (0.0800 => 0.0960, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 7.94% (0.2520 => 0.2720, std.dev.: 0.0042) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (0.4480 => 0.4640, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.25% (1.2761 => 1.2921, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 16.67% (0.1200 => 0.1400, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.02% (5.4403 => 5.6044, std.dev.: 0.0420) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.4762 => 3.4362, std.dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0018) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0061) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0041) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/random: 57.14% (0.0280 => 0.0440, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 22.22% (0.0720 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0076) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.52% (0.1080 => 0.1280, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1560 => 0.1840, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 13.13% (0.3960 => 0.4480, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.12% (1.1881 => 1.3321, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.06% (1.1281 => 1.2641, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.84% (0.3040 => 0.3400, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.03% (1.1241 => 1.2481, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (1.1681 => 1.2921, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.45% (1.1481 => 1.2681, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.34% (1.1601 => 1.2801, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.26% (1.2081 => 1.3321, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/sieve: 10.26% (0.3120 => 0.3440, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.90% (1.2121 => 1.3321, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.57% (0.1400 => 0.1520, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.21% (1.3641 => 1.4761, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0764) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.02% (1.1961 => 1.2801, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (6.0160 => 6.4360, std.dev.: 0.0605) SingleSource/Benchmarks/Shootout-C++/random: 6.90% (0.2320 => 0.2480, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0134) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.72% (1.1880 => 1.2560, std.dev.: 0.0205) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.45% (0.4400 => 0.4640, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (8.1441 => 8.5761, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.9640 => 2.0600, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.7360 => 1.8200, std.dev.: 0.0202) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.2600 => 0.2720, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 4.42% (4.5200 => 4.7200, std.dev.: 0.0295) MultiSource/Applications/Burg/burg: 4.38% (1.4600 => 1.5240, std.dev.: 0.0191) MultiSource/Benchmarks/mafft/pairlocalalign: 4.27% (10.4082 => 10.8522, std.dev.: 0.0270) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0476) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (0.3160 => 0.3280, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (2.1201 => 2.2001, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.67% (4.9000 => 5.0800, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 3.11% (17.6165 => 18.1645, std.dev.: 0.0417) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.11% (48.1088 => 49.6049, std.dev.: 0.0729) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.97% (5.8000 => 5.9720, std.dev.: 0.0613) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (1.1440 => 1.1760, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 2.79% (37.0925 => 38.1286, std.dev.: 0.0370) MultiSource/Applications/treecc/treecc: 2.61% (2.4480 => 2.5120, std.dev.: 0.0201) MultiSource/Applications/sqlite3/sqlite3: 2.54% (23.7574 => 24.3615, std.dev.: 0.0475) MultiSource/Applications/kimwitu++/kc: 2.51% (18.8170 => 19.2891, std.dev.: 0.0401) MultiSource/Applications/JM/ldecod/ldecod: 2.39% (7.8562 => 8.0442, std.dev.: 0.0262) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0175) MultiSource/Applications/SPASS/SPASS: 1.87% (17.5484 => 17.8764, std.dev.: 0.0454) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (4.0122 => 4.0803, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 1.45% (17.4082 => 17.6602, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.10% (15.2282 => 15.3962, std.dev.: 0.0398) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 20.60% (0.9321 => 1.1241, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.52% (0.2480 => 0.2840, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0512) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (25.8896 => 26.7537, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 1.50% (6.6564 => 6.7564, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0060) SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (14.0009 => 14.1649, std.dev.: 0.0608) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -81.57% (10.8967 => 2.0081, std.dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: -9.80% (0.4080 => 0.3680, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -5.67% (1.3401 => 1.2641, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0025) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0094) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 13:05:34 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 15:05:34 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430200534.3D8182A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25176?compare_to=25175&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25176, Order: 207656, Start Time: 2014-04-30 15:29:06, End Time: 2014-04-30 20:12:20 To: 25175, Order: 207654, Start Time: 2014-04-30 14:57:33, End Time: 2014-04-30 19:39:18 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (116 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1097 (975 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/globalrefs: 500.00% (0.0040 => 0.0240, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1560 => 0.1760, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.00% (0.1000 => 0.1120, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: 6.25% (0.1920 => 0.2040, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.4040 => 0.4200, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.58% (0.6200 => 0.6360, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.87% (1.2801 => 1.3041, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.63% (1.2161 => 1.2481, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/five11/five11: 1.39% (2.3041 => 2.3361, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/heapsort: 1.16% (3.4362 => 3.4762, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.40% (1.3321 => 1.3001, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -2.14% (1.1241 => 1.1001, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0048) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0060) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/Towers: 25.00% (0.0480 => 0.0600, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 13.51% (0.1480 => 0.1680, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.69% (1.1561 => 1.2681, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.40% (1.1921 => 1.3041, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.25% (1.1681 => 1.2761, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.09% (1.2321 => 1.3441, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.03% (1.1961 => 1.3041, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sieve: 8.97% (0.3120 => 0.3400, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary3: 8.45% (0.2840 => 0.3080, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.85% (6.0160 => 6.4880, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (10.6960 => 11.4960, std.dev.: 0.0740) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (1.3681 => 1.4681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.26% (1.2121 => 1.3001, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3920 => 0.4200, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (1.5200 => 1.6200, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.7400 => 0.7880, std.dev.: 0.0125) MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.06% (1.1880 => 1.2600, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0128) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.35% (8.1441 => 8.5801, std.dev.: 0.0304) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0338) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3800 => 1.4440, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.60% (0.3480 => 0.3640, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.59% (0.4360 => 0.4560, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 4.42% (0.4520 => 0.4720, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 4.31% (4.9200 => 5.1320, std.dev.: 0.0335) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (10.4082 => 10.8202, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.9640 => 2.0400, std.dev.: 0.0228) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.10% (5.8000 => 5.9800, std.dev.: 0.0562) MultiSource/Applications/JM/lencod/lencod: 3.04% (17.6165 => 18.1525, std.dev.: 0.0446) MultiSource/Applications/sqlite3/sqlite3: 2.88% (23.7574 => 24.4415, std.dev.: 0.0281) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.84% (48.1088 => 49.4770, std.dev.: 0.0863) MultiSource/Benchmarks/Bullet/bullet: 2.62% (37.0925 => 38.0646, std.dev.: 0.0709) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: 2.30% (18.8170 => 19.2491, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.29% (4.9000 => 5.0120, std.dev.: 0.0374) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0366) MultiSource/Applications/SPASS/SPASS: 1.82% (17.5484 => 17.8684, std.dev.: 0.0415) MultiSource/Applications/oggenc/oggenc: 1.66% (5.7964 => 5.8924, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.39% (1.1480 => 1.1640, std.dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 1.17% (17.4082 => 17.6122, std.dev.: 0.0719) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 18.02% (0.9321 => 1.1001, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.50% (0.0960 => 0.1080, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (25.8896 => 26.7657, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout/lists: 3.37% (5.8164 => 6.0124, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.71% (4.6843 => 4.7643, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.53% (10.8967 => 2.0121, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -6.27% (1.3401 => 1.2561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 13:16:02 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 13:16:02 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140430201702.0C1DF5033BC9@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19441 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207686 Blamelist: rnk BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 30 15:14:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 17:14:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430221429.E30A02A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25177?compare_to=25176&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25177, Order: 207674, Start Time: 2014-04-30 17:43:04, End Time: 2014-04-30 22:21:05 To: 25176, Order: 207656, Start Time: 2014-04-30 15:29:06, End Time: 2014-04-30 20:12:20 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (108 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (980 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-23-UnionInit: 133.33% (0.0120 => 0.0280, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 80.00% (0.0200 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/lowercase: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.14% (0.1680 => 0.1800, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.49% (0.3080 => 0.3280, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.56% (0.4320 => 0.4560, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 133.33% (0.0120 => 0.0280, std.dev.: 0.0061) SingleSource/Regression/C++/EH/inlined_cleanup: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.78% (0.0720 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.62% (0.1480 => 0.1800, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0052) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1520 => 0.1760, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.44% (1.1881 => 1.3121, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1960 => 0.2160, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.93% (1.2081 => 1.3281, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.68% (0.2480 => 0.2720, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.33% (0.3000 => 0.3280, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.31% (1.1601 => 1.2681, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.09% (0.1320 => 0.1440, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.06% (1.2361 => 1.3481, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.80% (1.2721 => 1.3841, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.11% (1.1841 => 1.2801, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.77% (1.1841 => 1.2761, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.75% (1.1361 => 1.2241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.69% (1.1441 => 1.2321, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.47% (1.2321 => 1.3241, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.41% (1.1881 => 1.2761, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.38% (1.1921 => 1.2801, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (1.2481 => 1.3401, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.02% (1.1961 => 1.2801, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.85% (1.1681 => 1.2481, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.0818) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.74% (1.3641 => 1.4561, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (6.0160 => 6.3920, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.07% (1.2521 => 1.3281, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (1.7360 => 1.8280, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3120 => 0.3280, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0378) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0231) MultiSource/Applications/lua/lua: 3.81% (4.5200 => 4.6920, std.dev.: 0.0299) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (10.4082 => 10.7842, std.dev.: 0.0280) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 3.41% (4.9200 => 5.0880, std.dev.: 0.0431) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.8000 => 5.9880, std.dev.: 0.0341) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.77% (48.1088 => 49.4409, std.dev.: 0.0603) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.69% (4.9000 => 5.0320, std.dev.: 0.0383) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (7.8562 => 8.0642, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 2.57% (17.6165 => 18.0685, std.dev.: 0.0590) MultiSource/Applications/sqlite3/sqlite3: 2.56% (23.7574 => 24.3655, std.dev.: 0.0475) MultiSource/Applications/lambda-0_1_3/lambda: 2.54% (0.7880 => 0.8080, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: 2.31% (37.0925 => 37.9486, std.dev.: 0.0661) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.22% (1.4400 => 1.4720, std.dev.: 0.0109) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 1.62% (18.8170 => 19.1210, std.dev.: 0.0690) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.30% (4.0122 => 4.0643, std.dev.: 0.0109) MultiSource/Applications/oggenc/oggenc: 1.17% (5.7964 => 5.8644, std.dev.: 0.0192) MultiSource/Applications/SPASS/SPASS: 1.16% (17.5484 => 17.7524, std.dev.: 0.0614) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/hash: 4.76% (0.5040 => 0.5280, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.60% (3.5322 => 3.6242, std.dev.: 0.0348) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 1.54% (4.6843 => 4.7563, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0168) MultiSource/Applications/lua/lua: 1.27% (21.1533 => 21.4213, std.dev.: 0.0800) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.9041 => 1.9241, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0296) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -20.00% (0.0600 => 0.0480, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.50% (0.0960 => 0.0840, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -6.27% (1.3401 => 1.2561, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0097) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.39% (8.6165 => 8.4965, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 15:25:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 17:25:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140430222508.264102A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25178?compare_to=25168&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25178, Order: 207675, Start Time: 2014-04-30 17:49:34, End Time: 2014-04-30 22:31:54 To: 25168, Order: 207641, Start Time: 2014-04-30 12:45:14, End Time: 2014-04-30 17:27:48 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 9 (155 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (926 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 66.67% (0.0240 => 0.0400, std.dev.: 0.0062) SingleSource/UnitTests/initp1: 40.00% (0.0400 => 0.0560, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.56% (0.2160 => 0.2280, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 3.97% (0.5040 => 0.5240, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 22.22% (0.2520 => 0.3080, std.dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3687 => 3.0402, std.dev.: 0.0117) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_throw: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045) SingleSource/UnitTests/2002-08-02-CastTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 299.15% (0.4600 => 1.8361, std.dev.: 0.0102) SingleSource/Regression/C++/EH/ctor_dtor_count: 233.33% (0.0120 => 0.0400, std.dev.: 0.0031) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 80.00% (0.0200 => 0.0360, std.dev.: 0.0045) SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/methcall: 57.14% (0.0280 => 0.0440, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.00% (0.0400 => 0.0560, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-7: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 35.29% (0.0680 => 0.0920, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: 30.00% (0.0400 => 0.0520, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: 27.27% (0.0440 => 0.0560, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 22.58% (0.1240 => 0.1520, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.83% (0.0960 => 0.1160, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.05% (0.0840 => 0.1000, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 18.75% (0.0640 => 0.0760, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.52% (0.1080 => 0.1280, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.86% (0.3360 => 0.3960, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (1.0240 => 1.2040, std.dev.: 0.0134) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.67% (0.1200 => 0.1400, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.91% (0.1760 => 0.2040, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.79% (0.0760 => 0.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.69% (0.2040 => 0.2360, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.29% (0.2520 => 0.2880, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.26% (0.4240 => 0.4760, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.26% (0.6200 => 0.6960, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.2360 => 0.2640, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.54% (0.3120 => 0.3480, std.dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.84% (0.3320 => 0.3680, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.67% (1.4241 => 1.5761, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.44% (1.4561 => 1.6081, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.97% (1.1640 => 1.2800, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.70% (1.4841 => 1.6281, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 9.68% (1.6521 => 1.8121, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.59% (1.4601 => 1.6001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.04% (1.5481 => 1.6881, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (1.0240 => 1.1160, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/random: 8.93% (0.2240 => 0.2440, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.92% (1.5241 => 1.6601, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 8.90% (0.5840 => 0.6360, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.89% (1.4401 => 1.5681, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.68% (1.6121 => 1.7521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.5281 => 1.6601, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.52% (1.7361 => 1.8841, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.50% (1.5521 => 1.6841, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.46% (1.6081 => 1.7441, std.dev.: 0.0116) MultiSource/Applications/obsequi/Obsequi: 8.35% (1.8680 => 2.0240, std.dev.: 0.0208) MultiSource/Benchmarks/Olden/bh/bh: 8.26% (0.4840 => 0.5240, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1960 => 0.2120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.09% (1.4841 => 1.6041, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.83% (0.4600 => 0.4960, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.40% (1.7841 => 1.9161, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.32% (1.4201 => 1.5241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.27% (1.5401 => 1.6521, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.21% (1.7761 => 1.9041, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.06% (1.4161 => 1.5161, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.90% (0.3480 => 0.3720, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2960 => 0.3160, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.2960 => 0.3160, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (1.4801 => 1.5801, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (6.4680 => 6.9000, std.dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.60% (11.6440 => 12.4120, std.dev.: 0.0603) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.54% (1.4681 => 1.5641, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.8440 => 1.9640, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (1.7401 => 1.8521, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6921 => 1.8001, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.32% (1.4561 => 1.5481, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.7680 => 0.8160, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (1.7400 => 1.8480, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.81% (1.5841 => 1.6761, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.79% (1.5201 => 1.6081, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (9.4842 => 10.0322, std.dev.: 0.0367) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.4640 => 1.5480, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.9800 => 1.0360, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.66% (1.4841 => 1.5681, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.57% (1.5801 => 1.6681, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.5240 => 0.5520, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.1280 => 1.1880, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (5.8121 => 6.1201, std.dev.: 0.0375) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.4720 => 0.4960, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.96% (0.9681 => 1.0161, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.4040 => 0.4240, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.5480 => 1.6240, std.dev.: 0.0215) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.0443 => 10.5163, std.dev.: 0.0227) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.58% (1.6601 => 1.7361, std.dev.: 0.0072) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.52% (0.6200 => 0.6480, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 4.40% (5.3600 => 5.5960, std.dev.: 0.0469) MultiSource/Applications/JM/lencod/lencod: 4.34% (21.9606 => 22.9128, std.dev.: 0.0549) MultiSource/Applications/lua/lua: 4.26% (4.7880 => 4.9920, std.dev.: 0.0306) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.16% (50.0290 => 52.1090, std.dev.: 0.0995) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (1.7320 => 1.8040, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (2.3281 => 2.4242, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.5600 => 1.6240, std.dev.: 0.0221) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (6.5440 => 6.7880, std.dev.: 0.0448) SingleSource/Benchmarks/Linpack/linpack-pc: 3.70% (0.3240 => 0.3360, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (3.0282 => 3.1402, std.dev.: 0.0120) MultiSource/Applications/treecc/treecc: 3.56% (2.5840 => 2.6760, std.dev.: 0.0255) MultiSource/Applications/oggenc/oggenc: 3.55% (6.9844 => 7.2325, std.dev.: 0.0200) MultiSource/Applications/SPASS/SPASS: 3.43% (18.4404 => 19.0726, std.dev.: 0.0387) MultiSource/Benchmarks/Bullet/bullet: 3.39% (38.4046 => 39.7046, std.dev.: 0.0674) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (6.5080 => 6.7280, std.dev.: 0.0387) MultiSource/Applications/siod/siod: 3.24% (2.7162 => 2.8042, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.7921 => 1.8481, std.dev.: 0.0111) MultiSource/Applications/d/make_dparser: 3.02% (3.9681 => 4.0881, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (2.1240 => 2.1880, std.dev.: 0.0247) MultiSource/Applications/ClamAV/clamscan: 2.98% (19.0444 => 19.6124, std.dev.: 0.0665) MultiSource/Applications/minisat/minisat: 2.79% (0.8600 => 0.8840, std.dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 2.58% (19.6891 => 20.1971, std.dev.: 0.0348) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (4.1843 => 4.2883, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (16.3483 => 16.7523, std.dev.: 0.0544) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.51% (6.1044 => 6.1964, std.dev.: 0.0146) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (13.0563 => 13.2083, std.dev.: 0.0289) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0295) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.45% (2.1401 => 2.4922, std.dev.: 0.0344) SingleSource/Benchmarks/Misc-C++/bigfib: 14.93% (0.2680 => 0.3080, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 10.21% (2.8602 => 3.1522, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.28% (1.5921 => 1.6921, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.84% (1.6521 => 1.7321, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0219) MultiSource/Applications/minisat/minisat: 2.40% (6.6684 => 6.8284, std.dev.: 0.0287) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (8.1845 => 8.3605, std.dev.: 0.0425) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.74% (11.5087 => 11.7087, std.dev.: 0.0185) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.53% (8.1245 => 8.2485, std.dev.: 0.0473) MultiSource/Applications/sqlite3/sqlite3: 1.51% (3.9842 => 4.0443, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (2.5562 => 2.5882, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.87% (10.6247 => 2.0321, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.50% (1.5641 => 1.0401, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.22% (91.8497 => 49.3951, std.dev.: 9.4780) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.09% (50.3031 => 33.1541, std.dev.: 0.2064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.80% (26.0616 => 17.2531, std.dev.: 0.0974) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -31.95% (42.1466 => 28.6818, std.dev.: 0.3915) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.29% (3.1122 => 2.3561, std.dev.: 0.1108) SingleSource/UnitTests/Vector/multiplies: -20.52% (1.6961 => 1.3481, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.41% (1.2481 => 1.1681, std.dev.: 0.0177) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -4.05% (1.3841 => 1.3281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (4.1243 => 4.0403, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.83% (2.8442 => 2.7922, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.70% (2.8202 => 2.7722, std.dev.: 0.0050) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.61% (5.7084 => 5.6164, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.1563 => 5.0883, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4602 => 2.4282, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (2.7442 => 2.7162, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 15:33:40 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 17:33:40 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140430223340.4E5612A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25179?compare_to=25169&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25179, Order: 207676, Start Time: 2014-04-30 17:55:05, End Time: 2014-04-30 22:40:26 To: 25169, Order: 207641, Start Time: 2014-04-30 12:47:54, End Time: 2014-04-30 17:33:00 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 8 (135 on baseline) Performance Improvements: 2 (25 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (939 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/2003-07-09-SignedArgs: 125.00% (0.0160 => 0.0360, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-6: 30.00% (0.0400 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 4.26% (0.7520 => 0.7840, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.81% (0.6640 => 0.6760, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.63% (1.7161 => 1.7441, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/test_indvars: -16.00% (0.1000 => 0.0840, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: -5.00% (0.3200 => 0.3040, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.93% (17.6723 => 19.7804, std.dev.: 0.0417) MultiSource/Applications/sqlite3/sqlite3: 1424.48% (1.7001 => 25.9176, std.dev.: 0.0541) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.09% (50.1010 => 52.1490, std.dev.: 0.0912) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (1.0520 => 1.1000, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.06% (11.3920 => 12.4240, std.dev.: 0.0763) SingleSource/Benchmarks/Misc/oourafft: -73.26% (11.3407 => 3.0322, std.dev.: 0.0117) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0363, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0133) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 319.47% (0.4320 => 1.8121, std.dev.: 0.0064) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 300.00% (0.0040 => 0.0160, std.dev.: 0.0027) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0028) SingleSource/Regression/C++/EH/throw_rethrow_test: 133.33% (0.0120 => 0.0280, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0120 => 0.0240, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/shr: 80.00% (0.0200 => 0.0360, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/sieve: 60.00% (0.0200 => 0.0320, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 50.00% (0.0320 => 0.0480, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-6: 44.44% (0.0360 => 0.0520, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Stanford/RealMM: 37.50% (0.0320 => 0.0440, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 37.50% (0.0320 => 0.0440, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: 36.36% (0.0440 => 0.0600, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/heapsort: 36.36% (0.0440 => 0.0600, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 27.78% (0.1440 => 0.1840, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.0800 => 0.1000, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 20.00% (0.0800 => 0.0960, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.74% (0.2480 => 0.2920, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: 17.39% (0.0920 => 0.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 15.38% (0.1040 => 0.1200, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.38% (0.1560 => 0.1800, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.32% (1.8281 => 2.1081, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.26% (1.8081 => 2.0841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.44% (1.8561 => 2.1241, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.40% (2.0281 => 2.3201, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 14.29% (0.1400 => 0.1600, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.28% (1.8201 => 2.0801, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.24% (2.1361 => 2.4402, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (1.9161 => 2.1881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.88% (1.9601 => 2.2321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.79% (1.9721 => 2.2441, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.51% (1.8361 => 2.0841, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (1.9241 => 2.1761, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.01% (1.8761 => 2.1201, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.91% (1.9521 => 2.2041, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.68% (1.8921 => 2.1321, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 12.55% (1.9121 => 2.1521, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.13% (2.1441 => 2.4041, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.74% (1.9761 => 2.2081, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.58% (1.7961 => 2.0041, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.55% (2.1121 => 2.3561, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.49% (0.3480 => 0.3880, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0047) SingleSource/Benchmarks/SmallPT/smallpt: 11.43% (0.1400 => 0.1560, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.28% (1.8081 => 2.0121, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/health/health: 10.87% (0.1840 => 0.2040, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.77% (1.8201 => 2.0161, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.67% (1.8361 => 2.0321, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.62% (1.9201 => 2.1241, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.53% (1.9001 => 2.1001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.47% (1.7961 => 1.9841, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.46% (2.1041 => 2.3241, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 10.44% (2.0681 => 2.2841, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/n-body: 10.34% (0.1160 => 0.1280, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.27% (0.7400 => 0.8160, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.21% (1.8801 => 2.0721, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.19% (1.8441 => 2.0321, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.16% (1.7721 => 1.9521, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.11% (1.8601 => 2.0481, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.06% (1.9481 => 2.1441, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.94% (2.0521 => 2.2561, std.dev.: 0.0095) MultiSource/Applications/obsequi/Obsequi: 8.96% (1.8760 => 2.0440, std.dev.: 0.0323) MultiSource/Benchmarks/McCat/05-eks/eks: 8.82% (0.6800 => 0.7400, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/power/power: 8.51% (0.1880 => 0.2040, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.33% (0.3360 => 0.3640, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 7.87% (1.0160 => 1.0960, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/fibo: 7.55% (0.2120 => 0.2280, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.8881 => 0.9521, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (6.4800 => 6.9160, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.72% (1.8440 => 1.9680, std.dev.: 0.0166) MultiSource/Applications/Burg/burg: 6.54% (1.5280 => 1.6280, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.4320 => 0.4600, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (2.9721 => 3.1522, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.7400 => 0.7840, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.2800 => 0.2960, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.70% (0.7720 => 0.8160, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.41% (0.2960 => 0.3120, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.1320 => 1.1920, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 5.17% (0.4640 => 0.4880, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (9.6042 => 10.1002, std.dev.: 0.0474) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.01% (5.8281 => 6.1201, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.92% (0.2440 => 0.2560, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.90% (0.4080 => 0.4280, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (0.4920 => 0.5160, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.81% (1.6641 => 1.7441, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.48% (1.6960 => 1.7720, std.dev.: 0.0204) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (10.2283 => 10.6844, std.dev.: 0.0306) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (5.3960 => 5.6320, std.dev.: 0.0226) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0160) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.90% (0.6160 => 0.6400, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 3.76% (4.7920 => 4.9720, std.dev.: 0.0333) MultiSource/Applications/hbd/hbd: 3.70% (1.7280 => 1.7920, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.42% (2.3401 => 2.4202, std.dev.: 0.0124) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.38% (1.3000 => 1.3440, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9801 => 1.0121, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (6.5320 => 6.7440, std.dev.: 0.0499) MultiSource/Applications/SPASS/SPASS: 2.96% (18.5284 => 19.0765, std.dev.: 0.0472) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (16.3003 => 16.7763, std.dev.: 0.0514) MultiSource/Applications/oggenc/oggenc: 2.89% (7.0524 => 7.2565, std.dev.: 0.0281) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (3.0562 => 3.1442, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.88% (6.5360 => 6.7240, std.dev.: 0.0371) MultiSource/Applications/minisat/minisat: 2.83% (0.8480 => 0.8720, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 2.74% (38.6366 => 39.6966, std.dev.: 0.0427) MultiSource/Applications/JM/lencod/lencod: 2.68% (22.2206 => 22.8167, std.dev.: 0.0503) MultiSource/Applications/SIBsim4/SIBsim4: 2.47% (1.7841 => 1.8281, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 2.20% (19.8291 => 20.2651, std.dev.: 0.0395) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (4.2243 => 4.3043, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 22.08% (0.9241 => 1.1281, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.66% (2.1201 => 2.4522, std.dev.: 0.0430) MultiSource/Applications/siod/siod: 9.78% (2.8642 => 3.1442, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.35% (1.6561 => 1.7281, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 3.96% (7.3725 => 7.6645, std.dev.: 0.0331) MultiSource/Applications/minisat/minisat: 3.58% (6.5964 => 6.8324, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.40% (3.4122 => 3.5282, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.32% (4.4803 => 4.5843, std.dev.: 0.0202) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 1.81% (11.4967 => 11.7047, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/whetstone: 1.69% (1.4241 => 1.4481, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (4.0003 => 4.0563, std.dev.: 0.0183) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.20% (8.3605 => 8.4605, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.11% (5.0243 => 5.0803, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.46% (10.4007 => 2.0321, std.dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.56% (2.9562 => 0.9000, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.74% (0.6880 => 0.6760, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.05% (94.8339 => 49.2631, std.dev.: 9.6401) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.95% (49.9431 => 32.9861, std.dev.: 0.0892) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -33.82% (25.7136 => 17.0171, std.dev.: 0.0962) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.44% (3.0722 => 2.3521, std.dev.: 0.1023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.37% (37.0863 => 28.7898, std.dev.: 0.4972) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.83% (1.2681 => 1.1561, std.dev.: 0.0191) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0012) MultiSource/Applications/aha/aha: -6.10% (2.7522 => 2.5842, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -4.06% (1.3801 => 1.3241, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.83% (2.8442 => 2.7922, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.69% (0.9441 => 0.9281, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.67% (4.8043 => 4.7243, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.64% (5.6124 => 5.5203, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (5.1563 => 5.0803, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.14% (2.8002 => 2.7682, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 15:34:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 17:34:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140430223445.CE76C2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25180?compare_to=25171&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25180, Order: 207676, Start Time: 2014-04-30 17:56:48, End Time: 2014-04-30 22:41:35 To: 25171, Order: 207641, Start Time: 2014-04-30 12:49:59, End Time: 2014-04-30 17:35:10 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 11 (156 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1101 (932 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0043) SingleSource/UnitTests/Vector/simple: 75.00% (0.0160 => 0.0280, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/partialsums: 57.14% (0.0280 => 0.0440, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/family/family: 44.44% (0.0360 => 0.0520, std.dev.: 0.0018) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.50% (0.0320 => 0.0440, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.34% (0.1160 => 0.1280, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.00% (0.1200 => 0.1320, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/nestedloop: 2.56% (0.7840 => 0.8041, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 35.71% (0.0560 => 0.0760, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2412.81% (0.0320 => 0.8041, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 1193.63% (0.1240 => 1.6041, std.dev.: 0.0087) SingleSource/Regression/C/sumarray2d: 1011.11% (0.0360 => 0.4000, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 320.73% (0.2320 => 0.9761, std.dev.: 0.0092) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 201.59% (0.2520 => 0.7600, std.dev.: 0.0187) SingleSource/Regression/C++/EH/ctor_dtor_count: 175.00% (0.0160 => 0.0440, std.dev.: 0.0047) SingleSource/Regression/C++/EH/inlined_cleanup: 133.33% (0.0120 => 0.0280, std.dev.: 0.0039) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0360 => 0.0760, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 103.85% (0.1040 => 0.2120, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: 77.14% (0.1400 => 0.2480, std.dev.: 0.0047) SingleSource/Regression/C/bigstack: 76.92% (0.0520 => 0.0920, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0065) SingleSource/Regression/C/test_indvars: 75.00% (0.0320 => 0.0560, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0058) SingleSource/Regression/C/sumarray: 66.67% (0.0360 => 0.0600, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0320 => 0.0480, std.dev.: 0.0051) SingleSource/Regression/C++/EH/exception_spec_test: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 49.43% (0.7040 => 1.0520, std.dev.: 0.0210) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0069) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.33% (0.0960 => 0.1280, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 29.17% (0.1920 => 0.2480, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 28.30% (1.2160 => 1.5601, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.50% (0.1600 => 0.2040, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.27% (0.0440 => 0.0560, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 26.32% (0.1520 => 0.1920, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 26.32% (0.0760 => 0.0960, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 26.32% (0.0760 => 0.0960, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.93% (0.1080 => 0.1360, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.32% (1.2321 => 1.5441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.84% (1.2401 => 1.5481, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.40% (1.2481 => 1.5401, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.75% (1.2481 => 1.5321, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 21.66% (1.2001 => 1.4601, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 21.43% (0.0560 => 0.0680, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 21.28% (0.3760 => 0.4560, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.05% (1.2921 => 1.5641, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.93% (0.1720 => 0.2080, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.72% (1.2161 => 1.4681, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.70% (1.1401 => 1.3761, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.61% (1.3001 => 1.5681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.49% (1.1321 => 1.3641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.41% (1.1761 => 1.4161, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.41% (1.1761 => 1.4161, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.27% (1.1841 => 1.4241, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.13% (1.1721 => 1.4081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.07% (1.1361 => 1.3641, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.07% (1.1561 => 1.3881, std.dev.: 0.0144) MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.79% (1.1721 => 1.4041, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.79% (1.1521 => 1.3801, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.15% (1.2321 => 1.4681, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 19.11% (8.5802 => 10.2203, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.01% (1.1361 => 1.3521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.96% (1.1601 => 1.3801, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 18.88% (1.1441 => 1.3601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 18.85% (1.1881 => 1.4121, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.53% (1.2521 => 1.4841, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.53% (1.2521 => 1.4841, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.52% (0.1080 => 0.1280, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.50% (1.2321 => 1.4601, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.50% (1.2321 => 1.4601, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.24% (1.2281 => 1.4521, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.90% (1.1841 => 1.3961, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.44% (1.2841 => 1.5081, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.08% (1.2881 => 1.5081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.05% (1.3841 => 1.6201, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.67% (1.2001 => 1.4001, std.dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: 15.33% (19.5406 => 22.5367, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.84% (5.3360 => 6.1281, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/ffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.29% (0.3360 => 0.3840, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 14.20% (1.3521 => 1.5441, std.dev.: 0.0149) SingleSource/UnitTests/Vector/SSE/sse_isamax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 13.39% (0.4480 => 0.5080, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2920 => 0.3280, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.2480 => 0.2720, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6800 => 0.7440, std.dev.: 0.0146) MultiSource/Benchmarks/mafft/pairlocalalign: 9.07% (11.3843 => 12.4163, std.dev.: 0.0295) MultiSource/Applications/oggenc/oggenc: 9.04% (6.2844 => 6.8524, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.86% (0.3160 => 0.3440, std.dev.: 0.0093) SingleSource/UnitTests/Vectorizer/gcc-loops: 8.63% (0.5560 => 0.6040, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists: 8.45% (0.2840 => 0.3080, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.35% (11.4440 => 12.4000, std.dev.: 0.0533) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.33% (0.1440 => 0.1560, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.03% (5.7280 => 6.1880, std.dev.: 0.0660) SingleSource/Benchmarks/Misc/oourafft: 8.00% (0.3000 => 0.3240, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.97% (5.6680 => 6.1200, std.dev.: 0.0483) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.6120 => 0.6600, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.9800 => 1.0520, std.dev.: 0.0179) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.89% (9.5802 => 10.2402, std.dev.: 0.0398) SingleSource/Benchmarks/Linpack/linpack-pc: 6.41% (0.3120 => 0.3320, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.98% (0.7360 => 0.7800, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.8721 => 0.9241, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 5.34% (1.0480 => 1.1040, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0225) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.4760 => 1.5440, std.dev.: 0.0229) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (6.8280 => 7.1400, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (1.0680 => 1.1120, std.dev.: 0.0127) MultiSource/Applications/lua/lua: 4.11% (4.7720 => 4.9680, std.dev.: 0.0387) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.92% (49.1529 => 51.0809, std.dev.: 0.0999) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.90% (1.2320 => 1.2800, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: 3.35% (0.8360 => 0.8640, std.dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: 3.00% (19.2243 => 19.8003, std.dev.: 0.0378) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (5.3840 => 5.5400, std.dev.: 0.0565) MultiSource/Applications/sqlite3/sqlite3: 2.71% (24.7575 => 25.4295, std.dev.: 0.0586) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.6961 => 1.7401, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (2.2081 => 2.2641, std.dev.: 0.0096) MultiSource/Applications/treecc/treecc: 2.42% (2.6480 => 2.7120, std.dev.: 0.0150) MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (2.7282 => 2.7882, std.dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 2.09% (19.7491 => 20.1611, std.dev.: 0.0457) MultiSource/Benchmarks/Bullet/bullet: 1.64% (39.0726 => 39.7126, std.dev.: 0.0806) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (6.0124 => 6.0884, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (1.0201 => 1.0321, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.13% (18.7966 => 19.0085, std.dev.: 0.0619) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 18.61% (0.9241 => 1.0961, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.48% (1.2401 => 1.4321, std.dev.: 0.0176) MultiSource/Benchmarks/McCat/09-vor/vor: 12.50% (0.0960 => 0.1080, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (3.9842 => 4.3163, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.02% (0.3320 => 0.3520, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (0.8281 => 0.8761, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 3.75% (6.8204 => 7.0764, std.dev.: 0.0347) MultiSource/Applications/siod/siod: 3.75% (2.9842 => 3.0962, std.dev.: 0.0164) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: 3.30% (0.7280 => 0.7520, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.3085 => 7.4885, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (1.3521 => 1.3801, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.84% (3.4802 => 3.5442) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (25.4536 => 25.8936, std.dev.: 0.0602) SingleSource/Benchmarks/Misc/oourafft: 1.57% (7.3965 => 7.5125, std.dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/perlin: 1.41% (5.9724 => 6.0564, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.4761 => 1.4921, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0102) SingleSource/UnitTests/2009-12-07-StructReturn: -80.00% (0.0200 => 0.0040, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -19.03% (8.9566 => 7.2525, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.44% (21.6534 => 17.8771, std.dev.: 0.0403) SingleSource/Benchmarks/Linpack/linpack-pc: -16.49% (7.8605 => 6.5644, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -13.25% (0.6040 => 0.5240, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -9.68% (3.4722 => 3.1362, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.90% (5.2763 => 4.9123, std.dev.: 0.0814) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (4.5123 => 4.2923, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.85% (2.0601 => 1.9601, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9242 => 2.8202, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -3.24% (1.3601 => 1.3161, std.dev.: 0.0104) MultiSource/Applications/aha/aha: -2.36% (2.8802 => 2.8122, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.0963 => 5.0123, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.51% (4.7643 => 4.6923, std.dev.: 0.0210) MultiSource/Applications/hexxagon/hexxagon: -1.04% (11.5567 => 11.4367, std.dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 15:36:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 17:36:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140430223617.E3F2B2A6C03B@llvm.org> http://llvm.org/perf/db_default/v4/nts/25181?compare_to=25170&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25181, Order: 207676, Start Time: 2014-04-30 17:56:47, End Time: 2014-04-30 22:43:06 To: 25170, Order: 207641, Start Time: 2014-04-30 12:48:46, End Time: 2014-04-30 17:34:46 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1103 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: 29.41% (0.0680 => 0.0880, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/exptree: 12.00% (0.1000 => 0.1120, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.34% (0.1160 => 0.1280, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 8.33% (0.1440 => 0.1560, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 3.00% (0.4000 => 0.4120, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.14% (1.4001 => 1.4161, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 131.58% (0.2280 => 0.5280, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -24.73% (0.7280 => 0.5480, std.dev.: 0.0132) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 15:42:29 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 17:42:29 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140430224229.6AC672A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25182?compare_to=25172&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25182, Order: 207676, Start Time: 2014-04-30 18:01:01, End Time: 2014-04-30 22:49:09 To: 25172, Order: 207641, Start Time: 2014-04-30 12:51:18, End Time: 2014-04-30 17:39:20 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (130 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (942 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/cast2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0043) SingleSource/UnitTests/ms_struct_pack_layout: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.39% (0.0920 => 0.1080, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.67% (0.0960 => 0.1120, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.04% (0.1840 => 0.2080, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.72% (0.7800 => 0.8480, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.37% (0.7320 => 0.7640, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C++/2003-06-13-Crasher: -100.00% (0.0160 => 0.0000, std.dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.02% (0.4560 => 1.8241, std.dev.: 0.0058) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0033) SingleSource/UnitTests/conditional-gnu-ext-cxx: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.29% (0.1400 => 0.1880, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0480 => 0.0640, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1880 => 0.2440, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 26.32% (0.0760 => 0.0960, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/exptree: 26.09% (0.0920 => 0.1160, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.08% (0.1040 => 0.1280, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.95% (0.1640 => 0.2000, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.01% (1.7321 => 2.0961, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 20.52% (1.6961 => 2.0441, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.41% (1.7641 => 2.1241, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.33% (1.6721 => 2.0121, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.14% (1.6681 => 2.0041, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.09% (1.6921 => 2.0321, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.09% (1.6921 => 2.0321, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.05% (1.6961 => 2.0361, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 20.00% (1.9801 => 2.3761, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.6801 => 2.0161, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 19.91% (1.7081 => 2.0481, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.86% (1.7921 => 2.1481, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.78% (1.8001 => 2.1561, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.73% (1.8041 => 2.1601, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.49% (1.7441 => 2.0841, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.30% (1.7201 => 2.0521, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.30% (1.7201 => 2.0521, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.09% (1.6761 => 1.9961, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.04% (1.8281 => 2.1761, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.00% (1.7681 => 2.1041, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.85% (1.8881 => 2.2441, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 18.85% (1.8041 => 2.1441, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 18.58% (1.8081 => 2.1441, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.56% (1.7241 => 2.0441, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 18.31% (1.9881 => 2.3521, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.30% (1.8361 => 2.1721, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.24% (1.8201 => 2.1521, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.16% (1.7401 => 2.0561, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 17.65% (0.6120 => 0.7200, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 17.62% (1.7481 => 2.0561, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.51% (1.9641 => 2.3081, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 17.40% (1.9081 => 2.2401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.00% (1.9761 => 2.3121, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.77% (1.9801 => 2.3121, std.dev.: 0.0146) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.67% (0.1440 => 0.1680, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.25% (0.2360 => 0.2720, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.22% (0.1840 => 0.2120, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.15% (0.1320 => 0.1520, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.64% (0.3480 => 0.3920, std.dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_isamax: 12.50% (0.0960 => 0.1080, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 10.64% (0.1880 => 0.2080, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 10.34% (0.3480 => 0.3840, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.16% (0.1960 => 0.2120, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.8601 => 0.9281, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.69% (0.1560 => 0.1680, std.dev.: 0.0044) SingleSource/Benchmarks/Linpack/linpack-pc: 7.59% (0.3160 => 0.3400, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 7.45% (1.0200 => 1.0960, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5560 => 0.5960, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/random: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4600 => 0.4920, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.9920 => 1.0560, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.40% (3.5002 => 3.7242, std.dev.: 0.0247) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.31% (6.7200 => 7.1440, std.dev.: 0.0496) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.11% (0.7200 => 0.7640, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.11% (11.7880 => 12.5080, std.dev.: 0.0868) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (1.5240 => 1.6160, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.81% (1.2400 => 1.3120, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (2.0680 => 2.1840, std.dev.: 0.0155) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6801 => 1.7681, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (1.6481 => 1.7281, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.41% (0.2720 => 0.2840, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.30% (0.3720 => 0.3880, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (9.9842 => 10.4122, std.dev.: 0.0400) MultiSource/Applications/lua/lua: 4.26% (4.7920 => 4.9960, std.dev.: 0.0402) MultiSource/Applications/d/make_dparser: 4.24% (3.9641 => 4.1321, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.4160 => 1.4720, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/bigfib: 3.78% (0.7400 => 0.7680, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 3.74% (1.8201 => 1.8881, std.dev.: 0.0229) MultiSource/Applications/oggenc/oggenc: 3.70% (6.9124 => 7.1684, std.dev.: 0.0228) MultiSource/Applications/treecc/treecc: 3.66% (2.6200 => 2.7160, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.63% (6.8321 => 7.0801, std.dev.: 0.0460) MultiSource/Applications/SPASS/SPASS: 3.20% (18.4924 => 19.0847, std.dev.: 0.0611) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (1.0001 => 1.0321, std.dev.: 0.0104) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.02% (51.1089 => 52.6529, std.dev.: 0.1237) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (1.7320 => 1.7840, std.dev.: 0.0178) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (10.3203 => 10.6203, std.dev.: 0.0605) MultiSource/Applications/JM/lencod/lencod: 2.86% (22.6287 => 23.2767, std.dev.: 0.0497) MultiSource/Applications/kimwitu++/kc: 2.65% (19.7371 => 20.2611, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (3.0122 => 3.0882, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 2.36% (38.9366 => 39.8566, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.32% (1.0361 => 1.0601, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.00% (25.1895 => 25.6936, std.dev.: 0.0293) MultiSource/Applications/ClamAV/clamscan: 1.96% (20.2445 => 20.6405, std.dev.: 0.0839) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.93% (6.0244 => 6.1404, std.dev.: 0.0265) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 1.88% (1.4921 => 1.5201, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (2.2721 => 2.3121, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (16.5963 => 16.8883, std.dev.: 0.0583) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (4.2203 => 4.2883, std.dev.: 0.0103) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7722 => 2.8042, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.44% (6.6644 => 17.1571, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 19.39% (0.9281 => 1.1081, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.19% (1.2681 => 1.4481, std.dev.: 0.0155) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 3.69% (6.8204 => 7.0724, std.dev.: 0.0351) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0161) MultiSource/Applications/spiff/spiff: 3.48% (2.1841 => 2.2601, std.dev.: 0.0283) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.30% (1.0921 => 1.1281, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (4.2443 => 4.3443, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (5.0963 => 5.1883, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 1.61% (5.9604 => 6.0564, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (4.0203 => 4.0843, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/salsa20: 1.59% (7.5485 => 7.6685, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.55% (2.0601 => 2.0921, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (4.1323 => 4.1923, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 1.03% (2.3241 => 2.3481, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.32% (6.2884 => 0.8600, std.dev.: 0.0093) SingleSource/UnitTests/Vector/constpool: -81.48% (10.9087 => 2.0201, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/nestedloop: -60.46% (2.9642 => 1.1721, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.43% (3.1762 => 1.3521, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: -26.84% (0.7600 => 0.5560, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/matrix: -25.00% (0.1280 => 0.0960, std.dev.: 0.0038) MultiSource/Applications/obsequi/Obsequi: -22.06% (2.6481 => 2.0640, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.99% (7.4801 => 6.2840, std.dev.: 0.0424) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.25% (7.5041 => 6.3600, std.dev.: 0.0468) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (13.5243 => 13.1243, std.dev.: 0.0411) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -20.70% (1.7001 => 1.3481, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.40% (21.6534 => 17.8851, std.dev.: 0.0572) SingleSource/Benchmarks/Linpack/linpack-pc: -15.33% (7.8005 => 6.6044, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.54% (3.4442 => 3.0122, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.36% (2.6082 => 2.3641, std.dev.: 0.0740) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.03% (0.9281 => 0.8721, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0074) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.03% (5.8884 => 5.5923, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -3.57% (2.9122 => 2.8082, std.dev.: 0.0255) MultiSource/Benchmarks/Olden/power/power: -3.50% (1.3721 => 1.3241, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.42% (2.9202 => 2.8202, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -2.95% (5.1603 => 5.0083, std.dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.8002 => 3.7162, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -1.78% (11.6527 => 11.4447, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: -1.49% (8.3085 => 8.1845, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.43% (4.7603 => 4.6923, std.dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.08% (2.2161 => 2.1921, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 4.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 15:56:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 17:56:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140430225612.639FD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25183?compare_to=25177&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25183, Order: 207677, Start Time: 2014-04-30 18:19:53, End Time: 2014-04-30 23:02:57 To: 25177, Order: 207674, Start Time: 2014-04-30 17:43:04, End Time: 2014-04-30 22:21:05 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (99 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (988 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Bubblesort: 42.86% (0.0280 => 0.0400, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.54% (0.1040 => 0.1160, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 6.86% (0.4080 => 0.4360, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.2880 => 0.3040, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 4.23% (0.2840 => 0.2960, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.20% (1.2481 => 1.2881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.25% (1.2801 => 1.2961, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.3160 => 0.3280, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (1.2441 => 1.2721, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0036) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 50.00% (0.0320 => 0.0480, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-1: 42.86% (0.0280 => 0.0400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 29.63% (0.1080 => 0.1400, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.64% (0.0880 => 0.1000, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.90% (0.6240 => 0.6920, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.68% (1.1241 => 1.2441, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.00% (0.2800 => 0.3080, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.76% (1.1881 => 1.3041, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.57% (1.1281 => 1.2361, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.12% (1.2281 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (1.1601 => 1.2641, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.88% (1.2161 => 1.3241, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.72% (1.1921 => 1.2961, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.71% (1.1481 => 1.2481, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.65% (1.1561 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.57% (1.2601 => 1.3681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.39% (1.1441 => 1.2401, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.86% (1.2721 => 1.3721, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (1.2801 => 1.3801, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.33% (1.3641 => 1.4641, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (10.6960 => 11.4680, std.dev.: 0.0488) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.07% (1.1881 => 1.2721, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.03% (1.2521 => 1.3401, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.02% (1.1961 => 1.2801, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.82% (1.2321 => 1.3161, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.65% (6.0160 => 6.4160, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.07% (0.8561 => 0.9081, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (8.1441 => 8.5601, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (1.7360 => 1.8240, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.5200 => 1.5880, std.dev.: 0.0228) MultiSource/Applications/spiff/spiff: 4.45% (0.9880 => 1.0320, std.dev.: 0.0157) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.7080 => 1.7720, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (10.4082 => 10.7722, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.9640 => 2.0320, std.dev.: 0.0244) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0528) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.71% (48.1088 => 49.4130, std.dev.: 0.1010) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (7.8562 => 8.0682, std.dev.: 0.0284) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 2.54% (17.6165 => 18.0645, std.dev.: 0.0597) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.8322 => 2.9042, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.9000 => 5.0240, std.dev.: 0.0407) MultiSource/Applications/sqlite3/sqlite3: 2.32% (23.7574 => 24.3095, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (2.1201 => 2.1681, std.dev.: 0.0129) MultiSource/Applications/kimwitu++/kc: 2.00% (18.8170 => 19.1931, std.dev.: 0.0325) MultiSource/Benchmarks/Bullet/bullet: 1.75% (37.0925 => 37.7405, std.dev.: 0.0635) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.40% (4.0122 => 4.0683, std.dev.: 0.0094) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0111) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0186) MultiSource/Applications/SPASS/SPASS: 1.21% (17.5484 => 17.7604, std.dev.: 0.0435) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 11.80% (2.8802 => 3.2202, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.89% (0.3040 => 0.3280, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 3.64% (5.8164 => 6.0284, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (25.8896 => 26.7777, std.dev.: 0.0329) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.61% (21.1533 => 21.4933, std.dev.: 0.0549) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.39% (10.8967 => 2.0281, std.dev.: 0.0067) MultiSource/Benchmarks/Fhourstones/fhourstones: -20.45% (0.1760 => 0.1400, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -5.67% (1.3401 => 1.2641, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -3.95% (0.6080 => 0.5840, std.dev.: 0.0068) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (3.7962 => 3.7042, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -1.71% (0.7000 => 0.6880, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 16:37:31 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 16:37:31 -0700 Subject: [llvm-testresults] buildbot success in lab.llvm.org on phase1 - sanity Message-ID: <20140430233743.8171F5035B9D@lab.llvm.org> The Buildbot has detected a restored build on builder phase1 - sanity while building cfe. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19448 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207712 Blamelist: garious,gribozavr,rafael,samsonov Build succeeded! sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 17:17:38 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 17:17:38 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140501001807.85D3550361BD@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/15012 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207721 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17894 of 17895) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17895 of 17895) 1 warning(s) in tests. Testing Time: 380.47s ******************** Failing Tests (1): LLVM :: CodeGen/SPARC/exception.ll Expected Passes : 17744 Expected Failures : 106 Unsupported Tests : 44 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::exception.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/SPARC/exception.ll:70:10: error: expected string not found in input ; V9ABS: .cfi_lsda 27, ^ :10:1: note: scanning from here .Leh_func_begin0: ^ :11:2: note: possible intended match here .cfi_lsda 0, .Lexception0 ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 17:17:37 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 17:17:37 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140501001807.4264D50361BC@lab.llvm.org> The Buildbot has detected a new failure on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/15012 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207721 Blamelist: BUILD FAILED: failed run.llvm.tests sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PASS: LLVM-Unit :: Transforms/Utils/Release+Asserts/UtilsTests/SpecialCaseListTest.Substring (17894 of 17895) PASS: LLVM-Unit :: Support/Release+Asserts/SupportTests/ProgramTest.TestExecuteNoWait (17895 of 17895) 1 warning(s) in tests. Testing Time: 380.47s ******************** Failing Tests (1): LLVM :: CodeGen/SPARC/exception.ll Expected Passes : 17744 Expected Failures : 106 Unsupported Tests : 44 Unexpected Failures: 1 make[1]: *** [check-local-all] Error 1 make: *** [check-all] Error 2 Last 15 lines of 'LLVM::exception.ll': Command Output (stderr): -- /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/llvm/test/CodeGen/SPARC/exception.ll:70:10: error: expected string not found in input ; V9ABS: .cfi_lsda 27, ^ :10:1: note: scanning from here .Leh_func_begin0: ^ :11:2: note: possible intended match here .cfi_lsda 0, .Lexception0 ^ -- ******************** Last 15 lines of 'warnings (1)': lit.py: discovery.py:190: warning: test suite 'Extra Tools Unit Tests' contained no tests From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 17:16:55 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 17:16:55 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140501001807.D1F2A50361BE@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19449 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207721 Blamelist: alexmc,dblaikie,ghoflehner,joerg,samsonov BUILD FAILED: exception sincerely, -The Buildbot From llvm-testresults at cs.uiuc.edu Wed Apr 30 17:23:56 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 19:23:56 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140501002356.62CFA2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25184?compare_to=25183&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25184, Order: 207692, Start Time: 2014-04-30 19:50:50, End Time: 2014-05-01 00:30:43 To: 25183, Order: 207677, Start Time: 2014-04-30 18:19:53, End Time: 2014-04-30 23:02:57 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 8 (102 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1103 (989 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.2480 => 0.2680, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.2880 => 0.3040, std.dev.: 0.0045) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.99% (0.5360 => 0.5520, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.84% (1.3041 => 1.3281, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/strcat: 17.24% (0.1160 => 0.1360, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.97% (0.7240 => 0.7600, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.06% (1.3561 => 1.3281, std.dev.: 0.0101) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0057) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/health/health: 17.50% (0.1600 => 0.1880, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.13% (0.3680 => 0.4200, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (1.1281 => 1.2481, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.21% (1.1361 => 1.2521, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6640 => 0.7280, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 9.61% (1.1241 => 1.2321, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.51% (1.1361 => 1.2441, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.46% (1.1841 => 1.2961, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.84% (1.1761 => 1.2801, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.78% (1.1841 => 1.2881, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (1.2161 => 1.3161, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.22% (1.1681 => 1.2641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.06% (1.2401 => 1.3401, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.04% (1.1441 => 1.2361, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.92% (1.2121 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.79% (1.2321 => 1.3281, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.77% (1.2361 => 1.3321, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.55% (1.2721 => 1.3681, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.24% (1.1601 => 1.2441, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.18% (10.6960 => 11.4640, std.dev.: 0.0682) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.05% (1.1921 => 1.2761, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.87% (1.2801 => 1.3681, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.71% (1.2521 => 1.3361, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (6.0160 => 6.4080, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.45% (1.3641 => 1.4521, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.41% (1.2481 => 1.3281, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.14% (1.3681 => 1.4521, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.9200 => 0.9720, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.2840 => 0.3000, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.8561 => 0.9041, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.53% (1.5200 => 1.6040, std.dev.: 0.0133) MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.05% (1.1880 => 1.2480, std.dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (8.1441 => 8.5241, std.dev.: 0.0399) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.9640 => 2.0520, std.dev.: 0.0175) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/lists: 4.11% (0.2920 => 0.3040, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0341) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.7360 => 1.8000, std.dev.: 0.0208) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (10.4082 => 10.7682, std.dev.: 0.0292) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0446) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (2.1201 => 2.1841, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0048) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.79% (48.1088 => 49.4490, std.dev.: 0.0754) MultiSource/Applications/JM/lencod/lencod: 2.61% (17.6165 => 18.0765, std.dev.: 0.0312) MultiSource/Benchmarks/Bullet/bullet: 2.49% (37.0925 => 38.0166, std.dev.: 0.0839) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (7.8562 => 8.0322, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.19% (5.8400 => 5.9680, std.dev.: 0.0183) MultiSource/Applications/sqlite3/sqlite3: 2.09% (23.7574 => 24.2535, std.dev.: 0.0570) MultiSource/Applications/kimwitu++/kc: 2.06% (18.8170 => 19.2051, std.dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (4.0122 => 4.0563, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.90% (0.2480 => 0.2800, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0223) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.40% (0.7280 => 0.7600, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.10% (1.6601 => 1.7281, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (25.8896 => 26.7177, std.dev.: 0.0347) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.92% (0.9601 => 0.9881, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.57% (21.1533 => 21.4853, std.dev.: 0.1044) MultiSource/Applications/minisat/minisat: 1.38% (6.6564 => 6.7484, std.dev.: 0.0347) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0643 => 4.1123, std.dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: 1.04% (5.0123 => 5.0643, std.dev.: 0.0189) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0245) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -6.57% (1.3401 => 1.2521, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -3.89% (2.6762 => 2.5722, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 17:41:34 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 17:41:34 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140501004154.C931C5036582@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/15013 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207726 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PLEASE ATTACH THE FOLLOWING FILES TO THE BUG REPORT: Preprocessed source(s) and associated run script(s) are located at: clang: note: diagnostic msg: /var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/asan_fake_stack-b896e1.cpp clang: note: diagnostic msg: /var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/asan_fake_stack-b896e1.sh clang: note: diagnostic msg: ******************** make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/asan_osx_dynamic/i386/SubDir.lib__asan/asan_fake_stack.o] Error 254 make[4]: *** [BuildRuntimeLibraries] Error 2 rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/clang/3.5.0/lib/darwin/.dir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/clang/3.5.0/lib/macho_embedded/.dir make[3]: *** [compiler-rt/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 17:42:04 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 17:42:04 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140501004215.E670850365A3@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19450 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207726 Blamelist: chandlerc,dblaikie,joerg BUILD FAILED: failed sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 17:42:04 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 17:42:04 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on phase1 - sanity Message-ID: <20140501004215.E527550365A2@lab.llvm.org> The Buildbot has detected a new failure on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19450 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207726 Blamelist: chandlerc,dblaikie,joerg BUILD FAILED: failed sincerely, -The Buildbot ================================================================================ CHANGES: File: lib/dfsan/CMakeLists.txt On: http://10.1.1.2/svn/llvm-project For: compiler-rt At: Wed 30 Apr 2014 16:55:35 Changed By: chandlerc Comments: The newest versions of CMake require outputs of custom commands be in DEPENDS rather than SOURCES. The SOURCES just end up looking on the filesystem and not finding anything. Makes for very hard to debug build errors. =/Properties: File: lib/MC/MCObjectFileInfo.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Wed 30 Apr 2014 16:55:35 Changed By: joerg Comments: Add missing breaks. Properties: Files: include/llvm/CodeGen/LexicalScopes.h lib/CodeGen/LexicalScopes.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Wed 30 Apr 2014 16:55:35 Changed By: dblaikie Comments: LexicalScopes: use unique_ptr to own LexicalScope objects. Ownership of abstract scopes coming soon.Properties: File: lib/CodeGen/LexicalScopes.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Wed 30 Apr 2014 16:55:35 Changed By: dblaikie Comments: Forgotten reformatting.Properties: Files: include/llvm/CodeGen/LexicalScopes.h lib/CodeGen/LexicalScopes.cpp On: http://10.1.1.2/svn/llvm-project For: llvm At: Wed 30 Apr 2014 16:55:35 Changed By: dblaikie Comments: LexicalScopes: Use unique_ptr to manage ownership of abstract LexicalScopes.Properties: LOGS: From llvm-testresults at cs.uiuc.edu Wed Apr 30 17:35:38 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 19:35:38 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140501003538.129822A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25185?compare_to=25184&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25185, Order: 207693, Start Time: 2014-04-30 20:00:56, End Time: 2014-05-01 00:42:25 To: 25184, Order: 207692, Start Time: 2014-04-30 19:50:50, End Time: 2014-05-01 00:30:43 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (111 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (977 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 166.67% (0.0120 => 0.0320, std.dev.: 0.0036) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/UnitTests/2007-03-02-VaCopy: 150.00% (0.0080 => 0.0200, std.dev.: 0.0031) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4280 => 0.4560, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.57% (1.2441 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.11% (1.3281 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.46% (1.3681 => 1.3881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.22% (1.3161 => 1.3321, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 15.32% (1.0441 => 1.2041, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/lists1: 9.23% (0.2600 => 0.2840, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0075) SingleSource/UnitTests/2003-09-18-BitFieldTest: 150.00% (0.0080 => 0.0200, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/health/health: 12.50% (0.1600 => 0.1800, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1600 => 0.1760, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.93% (1.1281 => 1.2401, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.86% (1.1761 => 1.2921, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.54% (1.2161 => 1.3321, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.51% (1.2201 => 1.3361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.12% (1.1841 => 1.2921, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.79% (1.2281 => 1.3361, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.74% (1.2361 => 1.3441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.69% (1.1961 => 1.3001, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.25% (1.2601 => 1.3641, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.25% (1.2121 => 1.3121, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 8.08% (0.3960 => 0.4280, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.05% (1.1921 => 1.2881, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.88% (1.1681 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.72% (1.1921 => 1.2841, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (10.6960 => 11.4800, std.dev.: 0.0527) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.14% (1.2321 => 1.3201, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (6.0160 => 6.4280, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.72% (1.3681 => 1.4601, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.54% (0.8561 => 0.9121, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.9640 => 2.0600, std.dev.: 0.0156) MultiSource/Applications/spiff/spiff: 4.86% (0.9880 => 1.0360, std.dev.: 0.0132) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0489) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0195) MultiSource/Applications/lua/lua: 4.34% (4.5200 => 4.7160, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (4.9200 => 5.1160, std.dev.: 0.0364) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (10.4082 => 10.7202, std.dev.: 0.0411) MultiSource/Applications/obsequi/Obsequi: 2.85% (1.2640 => 1.3000, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 2.81% (37.0925 => 38.1366, std.dev.: 0.0545) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.75% (17.6165 => 18.1005, std.dev.: 0.0336) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.69% (5.8000 => 5.9560, std.dev.: 0.0407) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (48.1088 => 49.2969, std.dev.: 0.1104) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 2.24% (23.7574 => 24.2895, std.dev.: 0.0449) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.20% (4.9000 => 5.0080, std.dev.: 0.0345) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (7.8562 => 8.0282, std.dev.: 0.0310) MultiSource/Applications/kimwitu++/kc: 1.59% (18.8170 => 19.1171, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: 1.39% (17.5484 => 17.7924, std.dev.: 0.0386) MultiSource/Applications/ClamAV/clamscan: 1.15% (17.4082 => 17.6082, std.dev.: 0.0377) MultiSource/Applications/oggenc/oggenc: 1.10% (5.7964 => 5.8604, std.dev.: 0.0207) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 30.00% (0.0800 => 0.1040, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/lists1: 7.58% (0.2640 => 0.2840, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (25.8896 => 26.7417, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.65% (1.6601 => 1.7041, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.36% (3.2242 => 3.3002, std.dev.: 0.0159) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.32% (6.6564 => 6.7444, std.dev.: 0.0297) SingleSource/Benchmarks/SmallPT/smallpt: 1.03% (14.0009 => 14.1449, std.dev.: 0.0477) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -5.97% (1.3401 => 1.2601, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.48% (4.4683 => 4.2683, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -2.86% (0.7000 => 0.6800, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 18:00:44 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 18:00:44 -0700 Subject: [llvm-testresults] buildbot exception in lab.llvm.org on phase1 - sanity Message-ID: <20140501010057.8C509503684F@lab.llvm.org> The Buildbot has detected a build exception on builder phase1 - sanity while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/phase1%20-%20sanity/builds/19451 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: macpro1 Build Reason: scheduler Build Source Stamp: 207730 Blamelist: joerg,rafael BUILD FAILED: exception sincerely, -The Buildbot From llvmlab-buildmaster at lab.llvm.org Wed Apr 30 18:05:17 2014 From: llvmlab-buildmaster at lab.llvm.org (llvmlab-buildmaster at lab.llvm.org) Date: Wed, 30 Apr 2014 18:05:17 -0700 Subject: [llvm-testresults] buildbot failure in lab.llvm.org on clang-x86_64-darwin11-nobootstrap-RAincremental Message-ID: <20140501010533.583FF50368F8@lab.llvm.org> The Buildbot has detected a failed build on builder clang-x86_64-darwin11-nobootstrap-RAincremental while building llvm. Full details are available at: http://lab.llvm.org:8013/builders/clang-x86_64-darwin11-nobootstrap-RAincremental/builds/15014 Buildbot URL: http://lab.llvm.org:8013/ Buildslave for this Build: xserve5 Build Reason: Triggerable(phase1-stage0) Build Source Stamp: 207730 Blamelist: BUILD FAILED: failed make sincerely, -The Buildbot ================================================================================ CHANGES: LOGS: Last 15 lines of 'stdio': PLEASE ATTACH THE FOLLOWING FILES TO THE BUG REPORT: Preprocessed source(s) and associated run script(s) are located at: clang: note: diagnostic msg: /var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/asan_globals-100048.cpp clang: note: diagnostic msg: /var/folders/_s/4_4ptjx54tq6cyfjg154ygbh0000gn/T/asan_globals-100048.sh clang: note: diagnostic msg: ******************** make[5]: *** [/Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/tools/clang/runtime/compiler-rt/clang_darwin/asan_osx_dynamic/i386/SubDir.lib__asan/asan_globals.o] Error 254 make[4]: *** [BuildRuntimeLibraries] Error 2 rm /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/clang/3.5.0/lib/darwin/.dir /Users/buildslave/zorg/buildbot/smooshlab/slave-0.8/build.clang-x86_64-darwin11-nobootstrap-RAincremental/clang-build/Release+Asserts/lib/clang/3.5.0/lib/macho_embedded/.dir make[3]: *** [compiler-rt/.makeall] Error 2 make[2]: *** [all] Error 1 make[1]: *** [clang/.makeall] Error 2 make: *** [all] Error 1 From llvm-testresults at cs.uiuc.edu Wed Apr 30 18:09:48 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 20:09:48 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140501010948.03B3D2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25186?compare_to=25185&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25186, Order: 207696, Start Time: 2014-04-30 20:34:30, End Time: 2014-05-01 01:16:34 To: 25185, Order: 207693, Start Time: 2014-04-30 20:00:56, End Time: 2014-05-01 00:42:25 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (100 on baseline) Performance Improvements: 0 (24 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (986 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/DuffsDevice: 75.00% (0.0160 => 0.0280, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/div: 50.00% (0.0240 => 0.0360, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 37.50% (0.0640 => 0.0880, std.dev.: 0.0093) SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 31.25% (0.0640 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.52% (0.1680 => 0.1840, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 8.47% (0.2360 => 0.2560, std.dev.: 0.0072) MultiSource/Applications/Burg/burg: 4.40% (1.4560 => 1.5200, std.dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.08% (0.3920 => 0.4080, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0037) SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0058) SingleSource/Regression/C/PR1386: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 37.50% (0.0320 => 0.0440, std.dev.: 0.0036) MultiSource/Benchmarks/llubenchmark/llu: 25.00% (0.0480 => 0.0600, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.24% (0.1320 => 0.1640, std.dev.: 0.0052) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3680 => 0.4240, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.00% (0.1600 => 0.1840, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.32% (1.1241 => 1.2401, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.28% (1.1281 => 1.2441, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.10% (1.1481 => 1.2641, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.52% (1.1761 => 1.2881, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.46% (1.1841 => 1.2961, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.27% (1.2081 => 1.3201, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.90% (1.1681 => 1.2721, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.85% (1.2201 => 1.3281, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.80% (1.1361 => 1.2361, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.55% (1.2161 => 1.3201, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.45% (1.1841 => 1.2841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.44% (1.2801 => 1.3881, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.41% (1.2361 => 1.3401, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.39% (1.1921 => 1.2921, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (1.2721 => 1.3761, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.14% (1.2281 => 1.3281, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.08% (1.1881 => 1.2841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.05% (1.1921 => 1.2881, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.01% (1.1481 => 1.2401, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.99% (1.2521 => 1.3521, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.94% (1.2601 => 1.3601, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6640 => 0.7160, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.78% (6.0160 => 6.4840, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.74% (1.2401 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.69% (0.6240 => 0.6720, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.59% (1.2121 => 1.3041, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (10.6960 => 11.4040, std.dev.: 0.0782) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.10% (0.3280 => 0.3480, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2120 => 0.2240, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (8.1441 => 8.5641, std.dev.: 0.0374) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.5200 => 1.5840, std.dev.: 0.0196) MultiSource/Applications/lua/lua: 4.16% (4.5200 => 4.7080, std.dev.: 0.0292) MultiSource/Applications/Burg/burg: 4.11% (1.4600 => 1.5200, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0258) MultiSource/Applications/hexxagon/hexxagon: 3.56% (1.1240 => 1.1640, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.48% (1.3800 => 1.4280, std.dev.: 0.0168) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (10.4082 => 10.7642, std.dev.: 0.0455) MultiSource/Benchmarks/Prolangs-C/football/football: 3.38% (0.9480 => 0.9800, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 3.25% (4.9200 => 5.0800, std.dev.: 0.0451) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0205) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.99% (48.1088 => 49.5449, std.dev.: 0.0873) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0175) MultiSource/Benchmarks/Bullet/bullet: 2.71% (37.0925 => 38.0966, std.dev.: 0.0546) MultiSource/Applications/JM/lencod/lencod: 2.68% (17.6165 => 18.0885, std.dev.: 0.0891) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (2.1201 => 2.1721, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.8322 => 2.9002, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 2.19% (23.7574 => 24.2775, std.dev.: 0.0587) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (7.8562 => 8.0242, std.dev.: 0.0337) MultiSource/Applications/kimwitu++/kc: 2.06% (18.8170 => 19.2051, std.dev.: 0.0336) MultiSource/Applications/siod/siod: 1.56% (2.5721 => 2.6121, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.52% (5.7964 => 5.8844, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 1.33% (17.4082 => 17.6402, std.dev.: 0.0260) MultiSource/Applications/SPASS/SPASS: 1.07% (17.5484 => 17.7364, std.dev.: 0.0416) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0031) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 21.43% (0.0560 => 0.0680, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.5040 => 0.5320, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: 3.44% (5.8164 => 6.0164, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (25.8896 => 26.7497, std.dev.: 0.0332) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.61% (3.2242 => 3.3082, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0107) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 1.57% (21.1533 => 21.4853, std.dev.: 0.0935) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0250) SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (14.0009 => 14.1609, std.dev.: 0.0518) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0044) SingleSource/UnitTests/blockstret: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.50% (10.8967 => 2.0161, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.64% (0.1760 => 0.1520, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0026) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -6.57% (1.3401 => 1.2521, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.30% (4.4683 => 4.2763, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0059) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.11% (3.7962 => 3.7162, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 20:02:04 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 22:02:04 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140501030204.29F602A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25187?compare_to=25186&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25187, Order: 207713, Start Time: 2014-04-30 22:29:02, End Time: 2014-05-01 03:08:51 To: 25186, Order: 207696, Start Time: 2014-04-30 20:34:30, End Time: 2014-05-01 01:16:34 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 12 (111 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1100 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.00% (0.0480 => 0.0600, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.64% (0.0880 => 0.1000, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.1640 => 0.1840, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/neural/neural: 11.11% (0.1800 => 0.2000, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.67% (0.4280 => 0.4480, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.26% (1.2401 => 1.2681, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.86% (1.2881 => 1.3121, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.62% (1.2361 => 1.2561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.52% (1.3201 => 1.3401, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 6.14% (0.4560 => 0.4840, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.62% (0.7120 => 0.7520, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (0.4760 => 0.4880, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0049) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.32% (0.1480 => 0.1840, std.dev.: 0.0071) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.39% (0.3680 => 0.4320, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 15.00% (0.1600 => 0.1840, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.81% (1.1241 => 1.2681, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.56% (1.1761 => 1.3121, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.35% (1.1281 => 1.2561, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.56% (1.1361 => 1.2561, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.71% (1.2361 => 1.3561, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.59% (1.1681 => 1.2801, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.52% (1.2601 => 1.3801, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.45% (1.2281 => 1.3441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (1.1441 => 1.2521, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.40% (1.1921 => 1.3041, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.35% (1.2401 => 1.3561, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.18% (1.2201 => 1.3321, std.dev.: 0.0127) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.80% (1.2721 => 1.3841, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/strcat: 8.77% (0.2280 => 0.2480, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 8.75% (1.1881 => 1.2921, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.45% (1.1841 => 1.2841, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.36% (1.1961 => 1.2961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.33% (1.2481 => 1.3521, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.30% (1.1561 => 1.2521, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.18% (0.4400 => 0.4760, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.85% (6.0160 => 6.4880, std.dev.: 0.0400) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3120 => 0.3360, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (10.6960 => 11.5040, std.dev.: 0.0694) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.3200 => 0.3440, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (1.2801 => 1.3761, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.8561 => 0.9201, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.35% (1.2521 => 1.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.04% (1.3641 => 1.4601, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.6840 => 0.7320, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.6520 => 0.6960, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.36% (0.2240 => 0.2360, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (8.1441 => 8.5361, std.dev.: 0.0565) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.7360 => 1.8160, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (1.7080 => 1.7840, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (4.9200 => 5.1240, std.dev.: 0.0396) MultiSource/Applications/Burg/burg: 4.11% (1.4600 => 1.5200, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3760 => 1.4320, std.dev.: 0.0185) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (10.4082 => 10.8042, std.dev.: 0.0353) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.9640 => 2.0360, std.dev.: 0.0263) MultiSource/Applications/lua/lua: 3.54% (4.5200 => 4.6800, std.dev.: 0.0398) MultiSource/Benchmarks/sim/sim: 3.53% (0.3400 => 0.3520, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 3.20% (17.6165 => 18.1805, std.dev.: 0.0341) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.17% (5.8000 => 5.9840, std.dev.: 0.0499) MultiSource/Applications/sqlite3/sqlite3: 2.88% (23.7574 => 24.4415, std.dev.: 0.0254) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.86% (48.1088 => 49.4850, std.dev.: 0.0828) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.62% (0.9161 => 0.9401, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.9000 => 5.0280, std.dev.: 0.0381) MultiSource/Benchmarks/Bullet/bullet: 2.60% (37.0925 => 38.0566, std.dev.: 0.0653) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.8322 => 2.8962, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (7.8562 => 8.0162, std.dev.: 0.0538) MultiSource/Applications/kimwitu++/kc: 2.00% (18.8170 => 19.1931, std.dev.: 0.0507) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0131) MultiSource/Applications/SPASS/SPASS: 1.32% (17.5484 => 17.7804, std.dev.: 0.0572) MultiSource/Applications/oggenc/oggenc: 1.24% (5.7964 => 5.8684, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 20.17% (0.9321 => 1.1201, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.53% (0.3040 => 0.3360, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.38% (3.5322 => 3.6162, std.dev.: 0.0309) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0099) MultiSource/Applications/lua/lua: 1.46% (21.1533 => 21.4613, std.dev.: 0.0557) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0120 => 0.0000, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -5.97% (1.3401 => 1.2601, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0066) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -2.29% (0.7000 => 0.6840, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (8.6165 => 8.4805, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 20:15:17 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 22:15:17 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140501031517.ED9252A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25188?compare_to=25178&baseline=21513 Nickname: pollyperf-O3-polly-scev-codegen-isl__clang_DEV__x86_64:39 Comparing: Run: 25188, Order: 207714, Start Time: 2014-04-30 22:39:41, End Time: 2014-05-01 03:22:06 To: 25178, Order: 207675, Start Time: 2014-04-30 17:49:34, End Time: 2014-04-30 22:31:54 Baseline: 21513, Order: 200427, Start Time: 2014-01-29 23:42:17, End Time: 2014-01-30 04:50:23 =============== Tests Summary =============== New Passes: 0 (2 on baseline) Performance Regressions: 13 (175 on baseline) Performance Improvements: 0 (27 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (906 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-31-CastToBool: 75.00% (0.0160 => 0.0280, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 10.00% (0.1600 => 0.1760, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/objinst: 8.47% (0.2360 => 0.2560, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.25% (0.3880 => 0.4200, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: 5.41% (0.2960 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.49% (1.6041 => 1.6441, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: 1.78% (2.0240 => 2.0600, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.61% (1.7441 => 1.7721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.37% (1.7521 => 1.7761, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.27% (1.5801 => 1.6001, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.26% (1.9041 => 1.9281, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: -73.22% (11.3687 => 3.0442, std.dev.: 0.0124) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7284, std.dev.: 0.0069) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 300.00% (0.0040 => 0.0160, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 298.28% (0.4600 => 1.8321, std.dev.: 0.0097) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0024) SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0038) SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Bubblesort: 57.14% (0.0280 => 0.0440, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/methcall: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0360 => 0.0480, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.27% (0.0880 => 0.1120, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/tsp/tsp: 25.81% (0.1240 => 0.1560, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 25.00% (0.0480 => 0.0600, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 23.08% (0.0520 => 0.0640, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.22% (0.0720 => 0.0880, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 21.74% (0.0920 => 0.1120, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 21.43% (0.0560 => 0.0680, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0560 => 0.0680, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 20.83% (0.0960 => 0.1160, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/dt: 20.00% (0.0600 => 0.0720, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 19.05% (0.3360 => 0.4000, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.92% (0.1480 => 0.1760, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 17.24% (0.1160 => 0.1360, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.19% (1.0240 => 1.2000, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0960 => 0.1120, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.38% (0.3640 => 0.4200, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.1080 => 0.1240, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 14.71% (0.1360 => 0.1560, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.29% (0.0840 => 0.0960, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 14.19% (0.6200 => 0.7080, std.dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.79% (0.1160 => 0.1320, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.2040 => 0.2320, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 13.64% (0.1760 => 0.2000, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.33% (0.1200 => 0.1360, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 12.12% (0.1320 => 0.1480, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (1.4241 => 1.5841, std.dev.: 0.0116) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 10.91% (0.6600 => 0.7320, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.83% (1.4401 => 1.5961, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.80% (0.7040 => 0.7800, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.78% (1.4841 => 1.6441, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2240 => 0.2480, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.71% (1.4561 => 1.6121, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.65% (1.6521 => 1.8281, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.64% (0.1880 => 0.2080, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.43% (0.4600 => 0.5080, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.41% (1.4601 => 1.6121, std.dev.: 0.0084) MultiSource/Applications/obsequi/Obsequi: 10.28% (1.8680 => 2.0600, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.26% (1.5601 => 1.7201, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.20% (1.6081 => 1.7721, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.17% (1.6121 => 1.7761, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.00% (0.1200 => 0.1320, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.97% (1.5241 => 1.6761, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.88% (0.3240 => 0.3560, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1640 => 0.1800, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.69% (1.8161 => 1.9921, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.69% (1.5281 => 1.6761, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.64% (0.3320 => 0.3640, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 9.56% (1.5481 => 1.6961, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.54% (1.5521 => 1.7001, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: 9.52% (0.3360 => 0.3680, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.43% (1.4841 => 1.6241, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.39% (0.9800 => 1.0720, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.36% (1.4961 => 1.6361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.22% (1.7361 => 1.8961, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.77% (0.2280 => 0.2480, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051) SingleSource/Regression/C/bigstack: 8.70% (0.1840 => 0.2000, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.56% (1.7761 => 1.9281, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.56% (0.8881 => 0.9641, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.51% (0.1880 => 0.2040, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.30% (1.7841 => 1.9321, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.17% (1.4201 => 1.5361, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.11% (1.4801 => 1.6001, std.dev.: 0.0071) MultiSource/Applications/spiff/spiff: 7.94% (1.0080 => 1.0880, std.dev.: 0.0231) SingleSource/UnitTests/2006-12-11-LoadConstants: 7.89% (0.1520 => 0.1640, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.81% (1.0240 => 1.1040, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.79% (1.5401 => 1.6601, std.dev.: 0.0085) MultiSource/Applications/sgefa/sgefa: 7.53% (0.5840 => 0.6280, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.44% (1.6121 => 1.7321, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.42% (1.4561 => 1.5641, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.34% (1.4161 => 1.5201, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.7680 => 0.8240, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.18% (1.4481 => 1.5521, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.10% (1.5201 => 1.6281, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.10% (1.4640 => 1.5680, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.09% (1.5801 => 1.6921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.08% (1.4681 => 1.5721, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 7.02% (0.4560 => 0.4880, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.01% (1.4841 => 1.5881, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.96% (1.4361 => 1.5361, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.94% (11.6440 => 12.4520, std.dev.: 0.0589) MultiSource/Applications/Burg/burg: 6.90% (1.5080 => 1.6120, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.87% (1.1640 => 1.2440, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.5240 => 0.5600, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: 6.85% (0.2920 => 0.3120, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2360 => 0.2520, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.76% (1.4201 => 1.5161, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.76% (0.2960 => 0.3160, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.67% (0.2400 => 0.2560, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 6.67% (0.2400 => 0.2560, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.67% (1.7400 => 1.8560, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.62% (1.6921 => 1.8041, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.4840 => 0.5160, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.57% (1.5841 => 1.6881, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.32% (1.5201 => 1.6161, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.20% (1.5480 => 1.6440, std.dev.: 0.0324) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.16% (9.4842 => 10.0682, std.dev.: 0.0444) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.98% (1.7401 => 1.8441, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.97% (0.2680 => 0.2840, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.94% (0.4040 => 0.4280, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (5.8121 => 6.1561, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3440 => 0.3640, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (6.4680 => 6.8440, std.dev.: 0.0642) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.71% (0.7000 => 0.7400, std.dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: 5.67% (1.1280 => 1.1920, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.54% (1.6601 => 1.7521, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.37% (0.9681 => 1.0201, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: 5.00% (0.4800 => 0.5040, std.dev.: 0.0047) SingleSource/Benchmarks/Linpack/linpack-pc: 4.94% (0.3240 => 0.3400, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (2.0440 => 2.1440, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2480 => 0.2600, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.82% (2.3281 => 2.4402, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.0443 => 10.5163, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (1.7320 => 1.8120, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.52% (0.7960 => 0.8320, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.4440 => 0.4640, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 4.48% (21.9606 => 22.9448, std.dev.: 0.0621) MultiSource/Benchmarks/MallocBench/gs/gs: 4.48% (5.3600 => 5.6000, std.dev.: 0.0413) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.41% (50.0290 => 52.2330, std.dev.: 0.1034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3680 => 0.3840, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 4.35% (0.4600 => 0.4800, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.7480 => 0.7800, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.24% (0.4720 => 0.4920, std.dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: 4.10% (38.4046 => 39.9806, std.dev.: 0.0614) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.7721 => 1.8441, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (3.0282 => 3.1482, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (6.5080 => 6.7640, std.dev.: 0.0395) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.87% (0.6200 => 0.6440, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.85% (1.5600 => 1.6200, std.dev.: 0.0210) MultiSource/Applications/lua/lua: 3.84% (4.7880 => 4.9720, std.dev.: 0.0225) MultiSource/Applications/oggenc/oggenc: 3.84% (6.9844 => 7.2525, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (6.5440 => 6.7920, std.dev.: 0.0537) MultiSource/Applications/d/make_dparser: 3.73% (3.9681 => 4.1161, std.dev.: 0.0255) MultiSource/Applications/treecc/treecc: 3.72% (2.5840 => 2.6800, std.dev.: 0.0221) MultiSource/Applications/SPASS/SPASS: 3.45% (18.4404 => 19.0766, std.dev.: 0.0449) MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.7921 => 1.8521, std.dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: 3.28% (19.0444 => 19.6683, std.dev.: 0.0415) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.14% (1.0201 => 1.0521, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 3.09% (19.6891 => 20.2971, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (16.3483 => 16.8523, std.dev.: 0.0513) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (4.1843 => 4.2963, std.dev.: 0.0169) MultiSource/Applications/siod/siod: 2.65% (2.7162 => 2.7882, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 1.67% (25.6856 => 26.1136, std.dev.: 0.0332) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (13.0563 => 13.2523, std.dev.: 0.0350) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (6.1044 => 6.1804, std.dev.: 0.0290) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7922 => 2.8242, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.84% (0.9241 => 1.1721, std.dev.: 0.0273) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.52% (2.1401 => 2.4722, std.dev.: 0.0439) MultiSource/Applications/siod/siod: 10.21% (2.8602 => 3.1522, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.56% (0.3600 => 0.3800, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.12% (1.6521 => 1.7201, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.04% (1.0881 => 1.1321, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.89% (0.7200 => 0.7480, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.4205 => 7.6565, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 2.58% (6.6684 => 6.8404, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.31% (3.9922 => 4.0843, std.dev.: 0.0264) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.15% (8.1845 => 8.3605, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 1.70% (11.5087 => 11.7047, std.dev.: 0.0178) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.58% (8.1245 => 8.2525, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/whetstone: 1.39% (1.4361 => 1.4561, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.06% (10.6247 => 2.0121, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.02% (2.9442 => 0.9120, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5641 => 1.0441, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -46.19% (91.8497 => 49.4271, std.dev.: 8.5384) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.57% (50.3031 => 32.9141, std.dev.: 0.2006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.52% (26.0616 => 17.0651, std.dev.: 0.1068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -32.72% (42.1466 => 28.3578, std.dev.: 0.3743) SingleSource/Benchmarks/CoyoteBench/fftbench: -24.17% (3.1122 => 2.3601, std.dev.: 0.1147) SingleSource/UnitTests/Vector/multiplies: -20.05% (1.6961 => 1.3561, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: -14.39% (7.7845 => 6.6644, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -5.13% (0.6240 => 0.5920, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: -4.38% (2.5562 => 2.4442, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.97% (4.0283 => 3.8682, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/power/power: -3.47% (1.3841 => 1.3361, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.13% (0.3840 => 0.3720, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (4.8083 => 4.6803, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: -2.55% (2.3561 => 2.2961, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (4.1243 => 4.0443, std.dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.59% (0.7560 => 0.7440, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.56% (2.8202 => 2.7762, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.54% (5.7084 => 5.6204, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.4602 => 2.4242, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (1.3761 => 1.3601, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 20:27:08 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 22:27:08 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results Message-ID: <20140501032708.9E2EE2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25189?compare_to=25179&baseline=21467 Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38 Comparing: Run: 25189, Order: 207714, Start Time: 2014-04-30 22:48:10, End Time: 2014-05-01 03:33:59 To: 25179, Order: 207676, Start Time: 2014-04-30 17:55:05, End Time: 2014-04-30 22:40:26 Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53 =============== Tests Summary =============== New Passes: 0 (11 on baseline) Performance Regressions: 16 (145 on baseline) Performance Improvements: 1 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1095 (931 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/initp1: 36.36% (0.0440 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: 16.67% (0.0720 => 0.0840, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.07% (0.2320 => 0.2600, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/exptree: 11.54% (0.1040 => 0.1160, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.52% (0.1840 => 0.1960, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 6.35% (0.2520 => 0.2680, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.95% (0.6720 => 0.7120, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/neural/neural: 5.88% (0.2040 => 0.2160, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 2.48% (0.6440 => 0.6600, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.88% (2.1321 => 2.1721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.73% (2.0841 => 2.1201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.49% (2.1521 => 2.1841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.45% (2.2041 => 2.2361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.39% (2.0121 => 2.0401, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 10.16% (1.0241 => 1.1281, std.dev.: 0.0358) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.75% (4.5843 => 4.5043, std.dev.: 0.0286) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: 11.43% (17.6723 => 19.6924, std.dev.: 0.0857) MultiSource/Applications/sqlite3/sqlite3: 1429.65% (1.7001 => 26.0056, std.dev.: 0.0574) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.50% (50.1010 => 52.3570, std.dev.: 0.0580) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (1.0520 => 1.0680, std.dev.: 0.0400) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.23% (11.3920 => 12.4440, std.dev.: 0.0704) SingleSource/Benchmarks/Misc/oourafft: -73.19% (11.3407 => 3.0402, std.dev.: 0.0228) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/Misc/oourafft MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.0363, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3601, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 6.7324, std.dev.: 0.0113) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 318.54% (0.4320 => 1.8081, std.dev.: 0.0080) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 50.00% (0.0320 => 0.0480, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Bubblesort: 50.00% (0.0320 => 0.0480, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/RealMM: 50.00% (0.0320 => 0.0480, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-7: 42.86% (0.0280 => 0.0400, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.82% (0.0880 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: 27.27% (0.0440 => 0.0560, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 25.00% (0.0640 => 0.0800, std.dev.: 0.0056) SingleSource/UnitTests/initp1: 25.00% (0.0480 => 0.0600, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/five11/five11: 23.53% (0.0680 => 0.0840, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 23.53% (0.0680 => 0.0840, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.92% (0.1920 => 0.2360, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 21.74% (0.0920 => 0.1120, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.69% (0.1160 => 0.1400, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 20.00% (0.0800 => 0.0960, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 20.00% (0.0600 => 0.0720, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.44% (0.1440 => 0.1720, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: 18.75% (0.1280 => 0.1520, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.95% (0.1560 => 0.1840, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (1.8081 => 2.0881, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 15.47% (1.8361 => 2.1201, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.21% (1.9721 => 2.2721, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.19% (2.0281 => 2.3361, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.94% (1.8201 => 2.0921, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 14.88% (1.8281 => 2.1001, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.80% (1.8921 => 2.1721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.61% (1.9161 => 2.1961, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.61% (2.1361 => 2.4482, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.55% (1.9521 => 2.2361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.41% (1.8601 => 2.1281, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.29% (0.1120 => 0.1280, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.28% (1.8761 => 2.1441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 14.23% (1.9121 => 2.1841, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.22% (1.8561 => 2.1201, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.08% (1.9601 => 2.2361, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.79% (0.3480 => 0.3960, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.51% (1.9241 => 2.1841, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.06% (2.1441 => 2.4242, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.90% (0.2480 => 0.2800, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.88% (2.1121 => 2.3841, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.83% (1.8081 => 2.0401, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.50% (0.4160 => 0.4680, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.50% (0.2240 => 0.2520, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.35% (1.9761 => 2.2201, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/08-main/main: 12.20% (0.3280 => 0.3680, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.00% (0.1000 => 0.1120, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.95% (0.6360 => 0.7120, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.83% (0.3720 => 0.4160, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.80% (1.7961 => 2.0081, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.41% (2.0681 => 2.3041, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 11.37% (1.9001 => 2.1161, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.33% (1.8361 => 2.0441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.29% (1.7721 => 1.9721, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.28% (1.8801 => 2.0921, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.25% (1.9201 => 2.1361, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.06% (1.8801 => 2.0881, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.03% (2.1041 => 2.3361, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.99% (1.8201 => 2.0201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 10.97% (1.8601 => 2.0641, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.85% (1.8441 => 2.0441, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.72% (2.0521 => 2.2721, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.68% (1.9481 => 2.1561, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.59% (0.3400 => 0.3760, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/EH/except: 10.34% (0.2320 => 0.2560, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.24% (1.7961 => 1.9801, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/neural/neural: 10.20% (0.1960 => 0.2160, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.02% (1.7961 => 1.9761, std.dev.: 0.0156) MultiSource/Applications/spiff/spiff: 9.84% (1.0160 => 1.1160, std.dev.: 0.0174) MultiSource/Benchmarks/McCat/05-eks/eks: 9.41% (0.6800 => 0.7440, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.89% (0.1800 => 0.1960, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.70% (0.1840 => 0.2000, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.65% (0.7400 => 0.8040, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.46% (1.0880 => 1.1800, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4320 => 0.4680, std.dev.: 0.0069) MultiSource/Applications/obsequi/Obsequi: 8.10% (1.8760 => 2.0280, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.59% (1.8440 => 1.9840, std.dev.: 0.0196) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.41% (6.4800 => 6.9600, std.dev.: 0.0262) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1640 => 0.1760, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 7.14% (0.6160 => 0.6600, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.14% (0.7280 => 0.7800, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.85% (0.2920 => 0.3120, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.82% (0.7040 => 0.7520, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (1.6960 => 1.8040, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.31% (0.8881 => 0.9441, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (2.9721 => 3.1562, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 6.03% (0.4640 => 0.4920, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.7400 => 0.7840, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.77% (1.6641 => 1.7601, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: 5.69% (0.4920 => 0.5200, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 5.65% (1.1320 => 1.1960, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.9960 => 1.0520, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2880 => 0.3040, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.19% (0.3080 => 0.3240, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 5.17% (0.4640 => 0.4880, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.08% (0.7080 => 0.7440, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops: 5.08% (0.4720 => 0.4960, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.08% (0.7880 => 0.8280, std.dev.: 0.0141) SingleSource/Benchmarks/Linpack/linpack-pc: 5.00% (0.3200 => 0.3360, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.00% (9.6042 => 10.0842, std.dev.: 0.0345) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (0.8280 => 0.8680, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.7721 => 1.8561, std.dev.: 0.0138) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (10.2283 => 10.7044, std.dev.: 0.0318) MultiSource/Applications/hbd/hbd: 4.63% (1.7280 => 1.8080, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (5.8281 => 6.0961, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.7480 => 1.8280, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.9801 => 1.0201, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/football/football: 4.06% (1.0840 => 1.1280, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (6.5320 => 6.7960, std.dev.: 0.0427) MultiSource/Applications/SIBsim4/SIBsim4: 3.81% (1.7841 => 1.8521, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.76% (2.3401 => 2.4282, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (2.1600 => 2.2400, std.dev.: 0.0149) MultiSource/Benchmarks/Bullet/bullet: 3.63% (38.6366 => 40.0406, std.dev.: 0.0510) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.39% (16.3003 => 16.8523, std.dev.: 0.0488) MultiSource/Applications/lua/lua: 3.34% (4.7920 => 4.9520, std.dev.: 0.0425) MultiSource/Applications/SPASS/SPASS: 3.30% (18.5284 => 19.1405, std.dev.: 0.0348) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.20% (2.1240 => 2.1920, std.dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.5040 => 1.5520, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (3.0562 => 3.1522, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (6.5360 => 6.7400, std.dev.: 0.0473) MultiSource/Applications/JM/lencod/lencod: 2.99% (22.2206 => 22.8847, std.dev.: 0.0545) MultiSource/Applications/treecc/treecc: 2.94% (2.5880 => 2.6640, std.dev.: 0.0293) MultiSource/Applications/oggenc/oggenc: 2.89% (7.0524 => 7.2565, std.dev.: 0.0140) MultiSource/Applications/d/make_dparser: 2.72% (3.9761 => 4.0841, std.dev.: 0.0299) MultiSource/Applications/kimwitu++/kc: 2.40% (19.8291 => 20.3051, std.dev.: 0.0557) MultiSource/Applications/siod/siod: 2.03% (2.7522 => 2.8082, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (4.2243 => 4.3083, std.dev.: 0.0133) MultiSource/Applications/lemon/lemon: 1.61% (1.4881 => 1.5121, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (13.0363 => 13.2203, std.dev.: 0.0291) MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.7842 => 2.8162, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.80% (2.8042 => 3.8642, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 20.78% (0.9241 => 1.1161, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 15.85% (2.1201 => 2.4562, std.dev.: 0.0370) MultiSource/Applications/siod/siod: 9.92% (2.8642 => 3.1482, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/salsa20: 4.07% (7.3725 => 7.6725, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.52% (3.4122 => 3.5322, std.dev.: 0.0134) MultiSource/Applications/minisat/minisat: 3.15% (6.5964 => 6.8044, std.dev.: 0.0479) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (4.0003 => 4.0683, std.dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: 1.67% (11.4967 => 11.6887, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/perlin: 1.47% (5.9684 => 6.0564, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.19% (5.0243 => 5.0843, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.15% (8.3605 => 8.4565, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5562 => 2.5842, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -80.58% (10.4007 => 2.0201, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -69.01% (2.9562 => 0.9160, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.25% (1.5881 => 1.0601, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -48.16% (94.8339 => 49.1591, std.dev.: 9.4980) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -34.50% (49.9431 => 32.7140, std.dev.: 0.3378) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -34.13% (25.7136 => 16.9371, std.dev.: 0.1133) SingleSource/Benchmarks/CoyoteBench/fftbench: -23.18% (3.0722 => 2.3601, std.dev.: 0.1027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -23.02% (37.0863 => 28.5498, std.dev.: 0.4974) SingleSource/UnitTests/Vector/multiplies: -20.28% (1.6961 => 1.3521, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -14.94% (7.8165 => 6.6484, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.1120 => 0.0960, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -10.82% (3.5122 => 3.1322, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -7.89% (1.2681 => 1.1681, std.dev.: 0.0115) MultiSource/Applications/aha/aha: -6.25% (2.7522 => 2.5802, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -4.49% (0.6240 => 0.5960, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: -3.77% (1.3801 => 1.3281, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.1563 => 5.0643, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.58% (4.8043 => 4.7283, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.55% (2.8442 => 2.8002, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.29% (2.8002 => 2.7642, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (0.9441 => 0.9321, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 20:27:55 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 22:27:55 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results Message-ID: <20140501032755.12F722A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25190?compare_to=25180&baseline=19899 Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35 Comparing: Run: 25190, Order: 207714, Start Time: 2014-04-30 22:49:21, End Time: 2014-05-01 03:34:44 To: 25180, Order: 207676, Start Time: 2014-04-30 17:56:48, End Time: 2014-04-30 22:41:35 Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02 =============== Tests Summary =============== Performance Regressions: 18 (166 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1093 (923 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-22-VarSizeArray: 300.00% (0.0040 => 0.0160, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.08% (0.1040 => 0.1280, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.75% (0.0640 => 0.0760, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 17.39% (0.0920 => 0.1080, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.38% (0.1040 => 0.1200, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2000 => 0.2160, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.4080 => 0.4360, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.31% (1.3881 => 1.4201, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.93% (1.4521 => 1.4801, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.78% (1.3521 => 1.3761, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.74% (1.3761 => 1.4001, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.35% (1.4841 => 1.5041, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.28% (1.5601 => 1.5801, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.24% (2.2641 => 2.2921, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.13% (0.9681 => 1.0081, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.12% (2.4962 => 2.4682, std.dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 2400.31% (0.0320 => 0.8001, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Puzzle: 1196.85% (0.1240 => 1.6081, std.dev.: 0.0080) SingleSource/Regression/C/sumarray2d: 988.89% (0.0360 => 0.3920, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 984.34% (0.0760 => 0.8241, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 400.00% (0.0040 => 0.0200, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 319.01% (0.2320 => 0.9721, std.dev.: 0.0122) SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/cast-bug: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 285.71% (0.0280 => 0.1080, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 204.76% (0.2520 => 0.7680, std.dev.: 0.0094) SingleSource/Regression/C++/EH/inlined_cleanup: 166.67% (0.0120 => 0.0320, std.dev.: 0.0050) SingleSource/Regression/C++/EH/ctor_dtor_count: 150.00% (0.0160 => 0.0400, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 100.00% (0.1040 => 0.2080, std.dev.: 0.0098) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0360 => 0.0680, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 75.00% (0.0800 => 0.1400, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 75.00% (0.0160 => 0.0280, std.dev.: 0.0038) SingleSource/UnitTests/Vector/sumarray: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 71.43% (0.1400 => 0.2400, std.dev.: 0.0058) SingleSource/Regression/C/bigstack: 69.23% (0.0520 => 0.0880, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 66.67% (0.0360 => 0.0600, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 53.41% (0.7040 => 1.0800, std.dev.: 0.0110) SingleSource/Regression/C/sumarray: 44.44% (0.0360 => 0.0520, std.dev.: 0.0053) MultiSource/Applications/obsequi/Obsequi: 43.68% (1.3920 => 2.0000, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/flops-3: 42.86% (0.0280 => 0.0400, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 42.31% (0.1040 => 0.1480, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 42.11% (0.0760 => 0.1080, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 41.67% (0.0960 => 0.1360, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.36% (0.0440 => 0.0600, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 33.33% (0.0720 => 0.0960, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 33.33% (0.0600 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.00% (0.1600 => 0.2080, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 29.94% (1.2160 => 1.5801, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 29.41% (0.0680 => 0.0880, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 29.17% (0.0960 => 0.1240, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.27% (0.0880 => 0.1120, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (1.2321 => 1.5561, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.80% (1.2401 => 1.5601, std.dev.: 0.0101) SingleSource/Benchmarks/McGill/misr: 25.00% (0.0640 => 0.0800, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 25.00% (0.1920 => 0.2400, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.2481 => 1.5521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.04% (1.2481 => 1.5481, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.84% (1.1561 => 1.4201, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.81% (1.1401 => 1.4001, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 22.73% (0.0880 => 0.1080, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.66% (1.2001 => 1.4721, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 22.22% (0.1080 => 0.1320, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.96% (1.1841 => 1.4441, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 21.77% (1.1761 => 1.4321, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.67% (1.2921 => 1.5721, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 21.43% (1.1761 => 1.4281, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.23% (1.3001 => 1.5761, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 21.20% (1.1321 => 1.3721, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.12% (1.1361 => 1.3761, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.09% (1.1761 => 1.4241, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/power/power: 21.05% (0.1520 => 0.1840, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 20.82% (1.1721 => 1.4161, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.78% (1.2321 => 1.4881, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.63% (1.1441 => 1.3801, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.52% (1.2281 => 1.4801, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 20.42% (1.1361 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.39% (1.2161 => 1.4641, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/bh/bh: 20.21% (0.3760 => 0.4520, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.20% (1.1881 => 1.4281, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 20.14% (1.1521 => 1.3841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.13% (1.1721 => 1.4081, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.13% (1.2321 => 1.4801, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.13% (1.2521 => 1.5041, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 20.13% (1.2521 => 1.5041, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.00% (1.1601 => 1.3921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.59% (1.1841 => 1.4161, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 19.58% (1.1441 => 1.3681, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.48% (1.2321 => 1.4721, std.dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 19.44% (8.5802 => 10.2483, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.75% (0.0640 => 0.0760, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.71% (1.3681 => 1.6241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 18.67% (1.2001 => 1.4241, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.60% (0.1720 => 0.2040, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 18.52% (0.1080 => 0.1280, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.32% (1.2881 => 1.5241, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.07% (1.2841 => 1.5161, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.63% (1.3841 => 1.6281, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.39% (0.0920 => 0.1080, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 16.96% (0.4480 => 0.5240, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 16.15% (19.5406 => 22.6967, std.dev.: 0.0466) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 15.79% (0.0760 => 0.0880, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.48% (0.3360 => 0.3880, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 15.09% (1.3521 => 1.5561, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.84% (5.3360 => 6.1281, std.dev.: 0.0410) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.71% (0.1360 => 0.1560, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 13.64% (0.0880 => 0.1000, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.1200 => 0.1360, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 13.04% (0.0920 => 0.1040, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.87% (1.7400 => 1.9640, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 12.50% (0.0960 => 0.1080, std.dev.: 0.0035) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.51% (0.5560 => 0.6200, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.96% (0.2920 => 0.3240, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (11.3843 => 12.4803, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.09% (11.4440 => 12.4840, std.dev.: 0.0295) MultiSource/Applications/oggenc/oggenc: 9.04% (6.2844 => 6.8524, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.03% (5.6680 => 6.1800, std.dev.: 0.0357) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.01% (5.7280 => 6.2440, std.dev.: 0.0429) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6800 => 0.7400, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/05-eks/eks: 8.50% (0.6120 => 0.6640, std.dev.: 0.0113) SingleSource/Benchmarks/Linpack/linpack-pc: 7.69% (0.3120 => 0.3360, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (9.5802 => 10.2482, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.88% (0.8721 => 0.9321, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (1.4760 => 1.5640, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/hash2: 5.65% (0.4960 => 0.5240, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.4320 => 0.4560, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.50% (0.8000 => 0.8440, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.3680 => 0.3880, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.4440 => 0.4680, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3760 => 0.3960, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 5.26% (0.8360 => 0.8800, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: 5.22% (0.4600 => 0.4840, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 5.11% (4.7720 => 5.0160, std.dev.: 0.0232) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.6240 => 1.7040, std.dev.: 0.0198) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.50% (49.1529 => 51.3649, std.dev.: 0.0635) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.45% (6.8280 => 7.1320, std.dev.: 0.0281) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.18% (1.3400 => 1.3960, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.91% (1.4320 => 1.4880, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.80% (2.2081 => 2.2921, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 3.70% (19.2243 => 19.9364, std.dev.: 0.0473) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (1.7320 => 1.7960, std.dev.: 0.0247) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.63% (1.3240 => 1.3720, std.dev.: 0.0179) MultiSource/Applications/sqlite3/sqlite3: 3.46% (24.7575 => 25.6136, std.dev.: 0.0492) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.45% (0.5800 => 0.6000, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 3.42% (5.3840 => 5.5680, std.dev.: 0.0513) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.7680 => 0.7920, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (2.0920 => 2.1560, std.dev.: 0.0240) MultiSource/Applications/kimwitu++/kc: 2.63% (19.7491 => 20.2691, std.dev.: 0.0430) MultiSource/Benchmarks/Bullet/bullet: 2.41% (39.0726 => 40.0126, std.dev.: 0.0836) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (2.7282 => 2.7802, std.dev.: 0.0167) MultiSource/Applications/d/make_dparser: 1.46% (4.1081 => 4.1681, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (3.0402 => 3.0842, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.40% (6.0124 => 6.0964, std.dev.: 0.0189) MultiSource/Applications/SPASS/SPASS: 1.34% (18.7966 => 19.0486, std.dev.: 0.0510) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (29.3298 => 29.6419, std.dev.: 0.0789) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 37.66% (2.8042 => 3.8602, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 19.05% (0.9241 => 1.1001, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.90% (1.2401 => 1.4001, std.dev.: 0.0200) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.03% (3.9842 => 4.3043, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.8281 => 0.8681, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.36% (1.6521 => 1.7241, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.35% (3.3122 => 3.4562, std.dev.: 0.0504) MultiSource/Applications/minisat/minisat: 3.93% (6.8204 => 7.0884, std.dev.: 0.0302) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.64% (1.1001 => 1.1401, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 3.62% (2.9842 => 3.0922, std.dev.: 0.0132) SingleSource/Benchmarks/McGill/queens: 3.49% (2.1801 => 2.2561, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (0.5920 => 0.6120, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.3085 => 7.4965, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.37% (1.3521 => 1.3841, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.72% (3.4802 => 3.5402, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 1.71% (1.4041 => 1.4281, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.51% (25.4536 => 25.8376, std.dev.: 0.0561) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0681 => 1.0841, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 1.46% (7.3965 => 7.5045, std.dev.: 0.0149) MultiSource/Applications/SIBsim4/SIBsim4: 1.41% (4.2403 => 4.3003, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 1.34% (5.9724 => 6.0524, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.24% (3.2362 => 3.2762, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (2.5442 => 2.5722, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.67% (11.0207 => 2.0201, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -18.94% (8.9566 => 7.2605, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.55% (21.6534 => 17.8531, std.dev.: 0.0604) SingleSource/Benchmarks/Linpack/linpack-pc: -16.54% (7.8605 => 6.5604, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: -12.58% (0.6040 => 0.5280, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -9.91% (3.4722 => 3.1282, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.75% (5.2763 => 4.9203, std.dev.: 0.0922) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.84% (1.7121 => 1.6121, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.96% (4.5123 => 4.2883, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.66% (2.0601 => 1.9641, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout/matrix: -4.08% (2.5482 => 2.4442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.83% (2.9242 => 2.8122, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: -2.65% (1.3601 => 1.3241, std.dev.: 0.0093) MultiSource/Applications/aha/aha: -2.50% (2.8802 => 2.8082, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.80% (0.6680 => 0.6560, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.73% (5.0963 => 5.0083, std.dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 20:30:36 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 22:30:36 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64 test results Message-ID: <20140501033036.671112A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25191?compare_to=25181&baseline=18670 Nickname: pollyperf-O3-polly-codegen-isl__clang_DEV__x86_64:33 Comparing: Run: 25191, Order: 207714, Start Time: 2014-04-30 22:50:43, End Time: 2014-05-01 03:37:24 To: 25181, Order: 207676, Start Time: 2014-04-30 17:56:47, End Time: 2014-04-30 22:43:06 Baseline: 18670, Order: 197769, Start Time: 2013-12-20 02:56:00, End Time: 2013-12-20 02:56:07 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (0 on baseline) Performance Improvements: 0 (1 on baseline) Added Tests: 0 (990 on baseline) Unchanged Tests: 1091 (120 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-12-13-MishaTest: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/UnitTests/Vector/simple: 60.00% (0.0200 => 0.0320, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.00% (0.0640 => 0.0800, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.11% (0.1080 => 0.1200, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (0.2440 => 0.2600, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 5.19% (0.3080 => 0.3240, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: 3.85% (1.5600 => 1.6200, std.dev.: 0.0218) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.99% (0.6680 => 0.6880, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 2.92% (1.7800 => 1.8320, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.86% (1.7201 => 1.7521, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/nestedloop: 1.68% (1.4281 => 1.4521, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.60% (2.0041 => 2.0361, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.34% (1.7881 => 1.8121, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.27% (1.8841 => 1.9081, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.17% (1.7081 => 1.7281, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.17% (1.7161 => 1.7361, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.06% (1.8801 => 1.9001, std.dev.: 0.0077) MultiSource/Benchmarks/Bullet/bullet: 1.05% (39.7646 => 40.1806, std.dev.: 0.0924) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.52% (0.9521 => 0.9761, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 129.82% (0.2280 => 0.5240, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -23.63% (0.7280 => 0.5560, std.dev.: 0.0128) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/EH/except SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/class_hierarchy SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/recursive-throw SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR10189 SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 20:38:37 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 22:38:37 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3-polly__clang_DEV__x86_64 test results Message-ID: <20140501033837.E9ECA2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25192?compare_to=25182&baseline=21370 Nickname: pollyperf-O3-polly__clang_DEV__x86_64:37 Comparing: Run: 25192, Order: 207714, Start Time: 2014-04-30 22:57:02, End Time: 2014-05-01 03:45:26 To: 25182, Order: 207676, Start Time: 2014-04-30 18:01:01, End Time: 2014-04-30 22:49:09 Baseline: 21370, Order: 200157, Start Time: 2014-01-26 21:14:24, End Time: 2014-01-27 02:07:54 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (135 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1094 (936 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-09-LoadShorts: 60.00% (0.0200 => 0.0320, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/15-trie/trie: 20.00% (0.0600 => 0.0720, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.52% (0.1080 => 0.1280, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1440 => 0.1600, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2440 => 0.2600, std.dev.: 0.0052) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.29% (0.6520 => 0.6800, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.14% (2.0561 => 2.1001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.95% (2.0561 => 2.0961, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 1.93% (5.5840 => 5.6920, std.dev.: 0.0419) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (1.7281 => 1.7561, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.53% (2.3521 => 2.3881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.43% (2.2401 => 2.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.37% (2.0441 => 2.0721, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.30% (2.1521 => 2.1801, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 1.24% (10.6203 => 10.7524, std.dev.: 0.0223) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: -27.27% (0.0440 => 0.0320, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- MultiSource/Applications/sgefa/sgefa MultiSource/Applications/sgefa/sgefa: 133.93% (0.2240 => 0.5240, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 300.90% (0.4560 => 1.8281, std.dev.: 0.0061) SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: 266.67% (0.0120 => 0.0440, std.dev.: 0.0040) SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0120 => 0.0240, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/strcat: 80.00% (0.0200 => 0.0360, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.00% (0.0400 => 0.0600, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 31.91% (0.1880 => 0.2480, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_shift: 30.00% (0.0400 => 0.0520, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/dt: 28.57% (0.0560 => 0.0720, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.86% (0.1400 => 0.1720, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.17% (1.6961 => 2.0721, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.74% (0.0920 => 0.1120, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 21.25% (1.7321 => 2.1001, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (1.6681 => 2.0201, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.05% (1.6721 => 2.0241, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 20.76% (1.6761 => 2.0241, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 20.75% (1.6961 => 2.0481, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.64% (1.7441 => 2.1041, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.63% (1.7641 => 2.1281, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.61% (1.6881 => 2.0361, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 20.59% (1.7681 => 2.1321, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 20.57% (1.6921 => 2.0401, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 20.53% (1.7921 => 2.1601, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.47% (1.6801 => 2.0241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.46% (1.7201 => 2.0721, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 20.46% (1.7401 => 2.0961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 20.37% (1.7081 => 2.0561, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.23% (1.7201 => 2.0681, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.18% (1.8041 => 2.1681, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.14% (1.7481 => 2.1001, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 20.13% (1.8281 => 2.1961, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 20.12% (1.9881 => 2.3881, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.00% (1.8001 => 2.1601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 19.95% (1.7241 => 2.0681, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.91% (1.8881 => 2.2641, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 19.86% (1.6921 => 2.0281, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 19.78% (1.8201 => 2.1801, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.69% (1.8081 => 2.1641, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.51% (1.8041 => 2.1561, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 19.39% (1.9801 => 2.3641, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.39% (1.8361 => 2.1921, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.26% (1.7241 => 2.0561, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 19.08% (1.9081 => 2.2721, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.33% (1.9641 => 2.3241, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.81% (1.9761 => 2.3281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.78% (1.9801 => 2.3321, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.75% (1.9601 => 2.3081, std.dev.: 0.0164) SingleSource/Benchmarks/McGill/exptree: 17.39% (0.0920 => 0.1080, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.95% (0.2360 => 0.2760, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 15.69% (0.6120 => 0.7080, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.94% (0.3480 => 0.4000, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.89% (0.1440 => 0.1640, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ffbench: 13.79% (0.1160 => 0.1320, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 10.53% (0.2280 => 0.2520, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.00% (0.1200 => 0.1320, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 10.00% (0.2000 => 0.2200, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.30% (0.8601 => 0.9401, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.11% (0.1480 => 0.1600, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.5560 => 0.6000, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.18% (0.7800 => 0.8360, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (3.5002 => 3.7442, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (6.7200 => 7.1880, std.dev.: 0.0413) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (11.7880 => 12.5680, std.dev.: 0.0874) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.55% (1.6481 => 1.7561, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.45% (0.2480 => 0.2640, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 6.43% (1.6801 => 1.7881, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.4400 => 0.4680, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.35% (0.7560 => 0.8040, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.12% (0.7840 => 0.8320, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.79% (1.7280 => 1.8280, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.75% (0.3480 => 0.3680, std.dev.: 0.0066) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.59% (0.6440 => 0.6800, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 5.26% (0.4560 => 0.4800, std.dev.: 0.0087) MultiSource/Applications/d/make_dparser: 5.15% (3.9641 => 4.1681, std.dev.: 0.0295) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.4160 => 1.4880, std.dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.8201 => 1.9121, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3200 => 0.3360, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 4.84% (4.7920 => 5.0240, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.5000 => 0.5240, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.5240 => 1.5960, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/wc: 4.69% (0.2560 => 0.2680, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 4.59% (0.4360 => 0.4560, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.6120 => 0.6400, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.57% (9.9842 => 10.4402, std.dev.: 0.0675) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.1440 => 1.1960, std.dev.: 0.0162) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.45% (1.3480 => 1.4080, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (1.7320 => 1.8080, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (1.1000 => 1.1480, std.dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: 4.19% (10.3203 => 10.7524, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (6.8321 => 7.1161, std.dev.: 0.0295) MultiSource/Applications/oggenc/oggenc: 4.05% (6.9124 => 7.1924, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (1.0001 => 1.0401, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (2.0680 => 2.1480, std.dev.: 0.0287) MultiSource/Applications/SPASS/SPASS: 3.53% (18.4924 => 19.1445, std.dev.: 0.0547) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.47% (1.0361 => 1.0721, std.dev.: 0.0053) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.27% (51.1089 => 52.7809, std.dev.: 0.1281) MultiSource/Applications/treecc/treecc: 3.21% (2.6200 => 2.7040, std.dev.: 0.0259) MultiSource/Applications/JM/lencod/lencod: 2.97% (22.6287 => 23.3007, std.dev.: 0.0755) MultiSource/Applications/kimwitu++/kc: 2.96% (19.7371 => 20.3211, std.dev.: 0.0373) MultiSource/Applications/ClamAV/clamscan: 2.94% (20.2445 => 20.8405, std.dev.: 0.0741) MultiSource/Benchmarks/Bullet/bullet: 2.85% (38.9366 => 40.0446, std.dev.: 0.0966) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (16.5963 => 17.0523, std.dev.: 0.0420) MultiSource/Benchmarks/MallocBench/gs/gs: 2.60% (5.5480 => 5.6920, std.dev.: 0.0419) MultiSource/Applications/lemon/lemon: 2.41% (1.4921 => 1.5281, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (3.0122 => 3.0842, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.29% (25.1895 => 25.7656, std.dev.: 0.0489) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.18% (4.2203 => 4.3123, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.11% (2.2721 => 2.3201, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.93% (6.0244 => 6.1404, std.dev.: 0.0256) MultiSource/Applications/siod/siod: 1.89% (2.7562 => 2.8082, std.dev.: 0.0154) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (2.7722 => 2.8082, std.dev.: 0.0120) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.10% (29.4578 => 29.7819, std.dev.: 0.0624) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/sieve: 157.50% (6.6644 => 17.1611, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 24.41% (7.3405 => 9.1326, std.dev.: 0.0033) SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 18.10% (0.9281 => 1.0961, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.56% (1.2681 => 1.4401, std.dev.: 0.0112) MultiSource/Applications/siod/siod: 9.90% (2.8282 => 3.1082, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.60% (1.6521 => 1.7281, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 4.40% (1.0921 => 1.1401, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: 3.68% (2.1761 => 2.2561, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (1.0881 => 1.1281, std.dev.: 0.0120) MultiSource/Applications/minisat/minisat: 3.58% (6.8204 => 7.0644, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.10% (3.4842 => 3.5922, std.dev.: 0.0419) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.91% (3.4402 => 3.5402, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (4.2443 => 4.3283, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.73% (5.0963 => 5.1843, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (2.5322 => 2.5722, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: 1.54% (5.9604 => 6.0524, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 1.54% (7.5485 => 7.6645, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.36% (2.0601 => 2.0881, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.36% (4.1323 => 4.1883, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 1.27% (3.4682 => 3.5122, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -86.39% (6.2884 => 0.8560, std.dev.: 0.0137) SingleSource/UnitTests/Vector/constpool: -81.52% (10.9087 => 2.0161, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/nestedloop: -60.19% (2.9642 => 1.1801, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: -57.18% (3.1762 => 1.3601, std.dev.: 0.0086) SingleSource/Regression/C++/EH/ConditionalExpr: -42.86% (0.0280 => 0.0160, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -26.32% (0.7600 => 0.5600, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -25.94% (1.5881 => 1.1761, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/matrix: -21.87% (0.1280 => 0.1000, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: -21.15% (2.6481 => 2.0880, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.36% (7.4801 => 6.2560, std.dev.: 0.0556) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -15.46% (7.5041 => 6.3440, std.dev.: 0.0462) SingleSource/Regression/C/sumarray2d: -7.82% (0.7160 => 0.6600, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -7.32% (0.1640 => 0.1520, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -2.84% (13.5243 => 13.1403, std.dev.: 0.0574) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -26.67% (0.0600 => 0.0440, std.dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -17.33% (21.6534 => 17.9011, std.dev.: 0.0355) SingleSource/Benchmarks/Linpack/linpack-pc: -15.23% (7.8005 => 6.6124, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.43% (3.4442 => 3.0162, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.71% (0.1120 => 0.1000, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/mandel-text: -8.45% (2.2241 => 2.0361, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.46% (0.9281 => 0.8681, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: -5.77% (0.6240 => 0.5880, std.dev.: 0.0088) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.10% (5.8884 => 5.5883, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.3280 => 0.3120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -4.54% (2.5562 => 2.4402, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.56% (2.9202 => 2.8162, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -3.43% (2.9122 => 2.8122, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.21% (1.3721 => 1.3281, std.dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: -2.79% (5.1603 => 5.0163, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.50% (3.3602 => 3.2762, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (4.6083 => 4.4963, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.8002 => 3.7122, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -1.85% (11.6527 => 11.4367, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (2.6202 => 2.5722, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -1.25% (8.3085 => 8.2045, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.7041 => 1.6841, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 20:48:45 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Apr 2014 22:48:45 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140501034845.2859C2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25193?compare_to=25187&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25193, Order: 207718, Start Time: 2014-04-30 23:11:52, End Time: 2014-05-01 03:55:32 To: 25187, Order: 207713, Start Time: 2014-04-30 22:29:02, End Time: 2014-05-01 03:08:51 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 13 (111 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1099 (979 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/build: 300.00% (0.0040 => 0.0160, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0760 => 0.0960, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: 16.67% (0.0720 => 0.0840, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.00% (0.0800 => 0.0920, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.33% (0.1440 => 0.1560, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.55% (1.2881 => 1.3081, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (1.3801 => 1.4001, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 1.25% (8.0162 => 8.1162, std.dev.: 0.0231) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/obsequi/Obsequi: 2.53% (2.0521 => 2.1041, std.dev.: 0.0137) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 166.67% (0.0120 => 0.0320, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 27.78% (0.0720 => 0.0920, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 23.53% (0.0680 => 0.0840, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.51% (0.1560 => 0.1880, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.48% (0.3680 => 0.4360, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.29% (0.1960 => 0.2240, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/exptree: 13.04% (0.0920 => 0.1040, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.90% (0.2480 => 0.2800, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (1.2081 => 1.3481, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.45% (1.1881 => 1.3241, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.43% (0.1400 => 0.1560, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.39% (1.1241 => 1.2521, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.99% (1.1281 => 1.2521, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.91% (1.1361 => 1.2601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.81% (1.1841 => 1.3121, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.54% (1.1761 => 1.3001, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.06% (1.2721 => 1.4001, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.03% (1.2361 => 1.3601, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.00% (1.1601 => 1.2761, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.87% (1.2161 => 1.3361, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.68% (1.2401 => 1.3601, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.41% (1.1481 => 1.2561, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.3040 => 0.3320, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0112) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.97% (0.6240 => 0.6800, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.65% (1.2481 => 1.3561, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.56% (1.1681 => 1.2681, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3280 => 0.3560, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.52% (1.2201 => 1.3241, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.12% (1.2801 => 1.3841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.03% (1.1961 => 1.2921, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.72% (1.1921 => 1.2841, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.67% (1.2521 => 1.3481, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.62% (1.3641 => 1.4681, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (10.6960 => 11.4960, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.41% (0.2160 => 0.2320, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.4400 => 0.4720, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (6.0160 => 6.4520, std.dev.: 0.0292) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.02% (1.3681 => 1.4641, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.01% (0.8561 => 0.9161, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.6640 => 0.7080, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/matrix: 6.15% (0.2600 => 0.2760, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.35% (8.1441 => 8.5801, std.dev.: 0.0480) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.09% (1.9640 => 2.0640, std.dev.: 0.0138) MultiSource/Applications/lua/lua: 4.69% (4.5200 => 4.7320, std.dev.: 0.0258) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (10.4082 => 10.8242, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.7360 => 1.8040, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0521) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.43% (4.9000 => 5.0680, std.dev.: 0.0321) MultiSource/Applications/JM/lencod/lencod: 3.41% (17.6165 => 18.2165, std.dev.: 0.0423) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.40% (2.1201 => 2.1921, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 3.32% (23.7574 => 24.5455, std.dev.: 0.0333) MultiSource/Applications/JM/ldecod/ldecod: 3.31% (7.8562 => 8.1162, std.dev.: 0.0231) MultiSource/Benchmarks/Bullet/bullet: 3.11% (37.0925 => 38.2446, std.dev.: 0.0514) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.09% (48.1088 => 49.5969, std.dev.: 0.0775) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9480 => 0.9760, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.7080 => 1.7560, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.7120 => 0.7320, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (5.8000 => 5.9600, std.dev.: 0.0573) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (5.8400 => 5.9600, std.dev.: 0.0416) MultiSource/Applications/kimwitu++/kc: 1.93% (18.8170 => 19.1811, std.dev.: 0.0381) MultiSource/Applications/siod/siod: 1.87% (2.5721 => 2.6201, std.dev.: 0.0176) MultiSource/Applications/SPASS/SPASS: 1.71% (17.5484 => 17.8484, std.dev.: 0.0393) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.50% (4.0122 => 4.0723, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 1.38% (5.7964 => 5.8764, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.21% (15.2282 => 15.4122, std.dev.: 0.0559) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.0800 => 0.1000, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0196) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (25.8896 => 26.7617, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.13% (1.6601 => 1.7121, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.20% (1.0921 => 1.1161, std.dev.: 0.0088) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0020) MultiSource/Applications/obsequi/Obsequi: 1.74% (2.0681 => 2.1041, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.57% (21.1533 => 21.4853, std.dev.: 0.0443) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0165) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (5.0123 => 5.0843, std.dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -81.61% (10.8967 => 2.0041, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -6.27% (1.3401 => 1.2561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (2.3881 => 2.2601, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.57% (4.4683 => 4.2643, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.09% (2.0561 => 1.9721, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -3.59% (2.6762 => 2.5802, std.dev.: 0.0334) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0073) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 22:13:12 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 May 2014 00:13:12 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140501051312.835852A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25194?compare_to=25193&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25194, Order: 207728, Start Time: 2014-05-01 00:39:15, End Time: 2014-05-01 05:19:59 To: 25193, Order: 207718, Start Time: 2014-04-30 23:11:52, End Time: 2014-05-01 03:55:32 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 10 (138 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1102 (949 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/testtrace: 75.00% (0.0160 => 0.0280, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 22.22% (0.0720 => 0.0880, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 4.60% (0.3480 => 0.3640, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 2.59% (2.4720 => 2.5360, std.dev.: 0.0162) MultiSource/Applications/lambda-0_1_3/lambda: 2.55% (0.7840 => 0.8040, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 2.43% (1.1520 => 1.1800, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.59% (1.2561 => 1.2761, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.37% (1.4641 => 1.4841, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 1.05% (17.5522 => 17.7362, std.dev.: 0.0373) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0048) SingleSource/Regression/C/compare: 100.00% (0.0120 => 0.0240, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-7: 50.00% (0.0240 => 0.0360, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: 37.50% (0.0320 => 0.0440, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/objinst: 30.00% (0.0400 => 0.0520, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.27% (0.0440 => 0.0560, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.92% (0.1480 => 0.1760, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.65% (0.0680 => 0.0800, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0720 => 0.0840, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.30% (0.3680 => 0.4280, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/fbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.38% (0.1560 => 0.1800, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.73% (0.2200 => 0.2480, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.50% (0.1600 => 0.1800, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.62% (1.1361 => 1.2681, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (1.1841 => 1.3201, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.38% (1.1601 => 1.2921, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.26% (1.2081 => 1.3441, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.15% (1.1481 => 1.2761, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.11% (1.1881 => 1.3201, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.80% (1.1481 => 1.2721, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 10.71% (0.1120 => 0.1240, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.53% (1.2161 => 1.3441, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.49% (1.2201 => 1.3481, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.49% (1.1441 => 1.2641, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.40% (1.1921 => 1.3161, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.32% (1.2401 => 1.3681, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.20% (1.1761 => 1.2961, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.13% (1.1841 => 1.3041, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.10% (1.1881 => 1.3081, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.94% (1.2481 => 1.3721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.77% (1.2281 => 1.3481, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.73% (1.1921 => 1.3081, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.70% (1.1961 => 1.3121, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.43% (1.2721 => 1.3921, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.38% (1.2361 => 1.3521, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.37% (1.2801 => 1.4001, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.21% (1.2601 => 1.3761, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 9.09% (0.3960 => 0.4320, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.6640 => 0.7240, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.00% (1.1561 => 1.2601, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.91% (1.2121 => 1.3201, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.80% (1.3641 => 1.4841, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.77% (1.2321 => 1.3401, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/neural/neural: 8.70% (0.1840 => 0.2000, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.41% (0.8561 => 0.9281, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.33% (0.6240 => 0.6760, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.31% (1.2521 => 1.3561, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.06% (0.2480 => 0.2680, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (10.6960 => 11.5120, std.dev.: 0.0750) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.60% (0.6840 => 0.7360, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.3200 => 0.3440, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (6.0160 => 6.4640, std.dev.: 0.0311) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2280 => 0.2440, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/EH/except: 6.67% (0.2400 => 0.2560, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.30% (1.9640 => 2.0680, std.dev.: 0.0210) MultiSource/Benchmarks/McCat/05-eks/eks: 5.29% (0.6800 => 0.7160, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.5200 => 1.6000, std.dev.: 0.0249) SingleSource/Benchmarks/McGill/chomp: 5.26% (0.2280 => 0.2400, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.3760 => 1.4480, std.dev.: 0.0144) SingleSource/Benchmarks/Linpack/linpack-pc: 5.06% (0.3160 => 0.3320, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 4.98% (1.1240 => 1.1800, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (8.1441 => 8.5441, std.dev.: 0.0628) MultiSource/Applications/lua/lua: 4.87% (4.5200 => 4.7400, std.dev.: 0.0423) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 4.65% (10.4082 => 10.8922, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.7360 => 1.8080, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: 4.11% (1.2640 => 1.3160, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/gs/gs: 4.07% (4.9200 => 5.1200, std.dev.: 0.0340) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3800 => 1.4360, std.dev.: 0.0195) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.04% (1.1880 => 1.2360, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.00% (4.9000 => 5.0960, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.96% (2.1201 => 2.2041, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.95% (0.6080 => 0.6320, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 3.80% (0.9480 => 0.9840, std.dev.: 0.0114) MultiSource/Applications/JM/lencod/lencod: 3.77% (17.6165 => 18.2805, std.dev.: 0.0403) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4400 => 0.4560, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: 3.59% (2.4480 => 2.5360, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4520 => 0.4680, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.52% (5.8000 => 6.0040, std.dev.: 0.0508) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (1.7080 => 1.7680, std.dev.: 0.0203) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.7120 => 0.7360, std.dev.: 0.0078) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.33% (48.1088 => 49.7130, std.dev.: 0.0746) MultiSource/Applications/sqlite3/sqlite3: 3.28% (23.7574 => 24.5375, std.dev.: 0.0546) MultiSource/Applications/JM/ldecod/ldecod: 3.21% (7.8562 => 8.1082, std.dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.8322 => 2.9202, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.06% (0.9161 => 0.9441, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.01% (5.8400 => 6.0160, std.dev.: 0.0341) MultiSource/Benchmarks/Bullet/bullet: 2.89% (37.0925 => 38.1646, std.dev.: 0.1080) MultiSource/Applications/kimwitu++/kc: 2.81% (18.8170 => 19.3451, std.dev.: 0.0349) MultiSource/Applications/siod/siod: 2.18% (2.5721 => 2.6281, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (4.0122 => 4.0963, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 2.05% (17.5484 => 17.9084, std.dev.: 0.0566) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (2.5882 => 2.6402, std.dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 2.00% (5.7964 => 5.9124, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 1.88% (17.4082 => 17.7362, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.76% (15.2282 => 15.4962, std.dev.: 0.0495) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (5.7564 => 5.8444, std.dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.29% (28.1538 => 28.5178, std.dev.: 0.0620) MultiSource/Applications/d/make_dparser: 1.26% (3.8240 => 3.8721, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.9321 => 1.1161, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.87% (1.0881 => 1.2281, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0169) MultiSource/Benchmarks/llubenchmark/llu: 3.31% (5.1963 => 5.3683, std.dev.: 0.0655) SingleSource/Benchmarks/Shootout/lists: 3.30% (5.8164 => 6.0084, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (25.8896 => 26.7257, std.dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 1.83% (1.3121 => 1.3361, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 1.51% (21.1533 => 21.4733, std.dev.: 0.1185) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 1.45% (4.6843 => 4.7523, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.4081 => 1.4281, std.dev.: 0.0036) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.0009 => 14.1569, std.dev.: 0.0482) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.9443 => 4.9963, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.23% (1.7001 => 1.3561, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -12.96% (7.7485 => 6.7444, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.81% (3.3482 => 3.1202, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: -6.27% (1.3401 => 1.2561, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: -3.29% (0.6080 => 0.5880, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.17% (1.2601 => 1.2201, std.dev.: 0.0146) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.98% (4.5603 => 4.4243, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.84% (3.9202 => 3.8482, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.61% (2.9722 => 2.9242, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (8.6165 => 8.4845, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.16% (2.0681 => 2.0441, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 22:26:15 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 May 2014 00:26:15 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140501052615.9D5C62A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25195?compare_to=25194&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25195, Order: 207730, Start Time: 2014-05-01 00:50:51, End Time: 2014-05-01 05:33:02 To: 25194, Order: 207728, Start Time: 2014-05-01 00:39:15, End Time: 2014-05-01 05:19:59 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 7 (120 on baseline) Performance Improvements: 0 (23 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1105 (967 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Oscar: 28.57% (0.0560 => 0.0720, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.00% (0.3000 => 0.3360, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.85% (1.2961 => 1.3201, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.54% (1.2961 => 1.3161, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.68% (4.5203 => 4.5963, std.dev.: 0.0212) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0030) SingleSource/Regression/C++/fixups: 100.00% (0.0120 => 0.0240, std.dev.: 0.0035) SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0120 => 0.0240, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.27% (0.0440 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.00% (0.0960 => 0.1200, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.22% (0.1080 => 0.1320, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/ffbench: 21.05% (0.0760 => 0.0920, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.35% (0.1240 => 0.1480, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 18.18% (0.1320 => 0.1560, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.67% (0.0720 => 0.0840, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.33% (0.1960 => 0.2280, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.22% (0.1480 => 0.1720, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.3680 => 0.4160, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.46% (1.1881 => 1.3361, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.41% (1.1601 => 1.3041, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.41% (1.1281 => 1.2681, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.24% (1.1761 => 1.3201, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.10% (1.1241 => 1.2601, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.27% (1.1361 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1840 => 0.2040, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.81% (1.1841 => 1.3121, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.77% (1.1881 => 1.3161, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.74% (1.1921 => 1.3201, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.68% (1.2361 => 1.3681, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.60% (1.2081 => 1.3361, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.42% (1.2281 => 1.3561, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.16% (1.2201 => 1.3441, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.07% (1.1921 => 1.3121, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.03% (1.1561 => 1.2721, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.94% (1.2481 => 1.3721, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.93% (1.1681 => 1.2841, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.84% (1.2601 => 1.3841, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.80% (1.1841 => 1.3001, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.79% (1.1441 => 1.2561, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3280 => 0.3600, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.24% (1.2121 => 1.3241, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.12% (1.2721 => 1.3881, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.06% (1.2801 => 1.3961, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.06% (1.1921 => 1.3001, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.06% (1.1481 => 1.2521, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.03% (1.2401 => 1.3521, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/09-vor/vor: 8.89% (0.3600 => 0.3920, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.63% (1.2521 => 1.3601, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.50% (1.3641 => 1.4801, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.48% (1.3681 => 1.4841, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.2321 => 1.3361, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.36% (1.1481 => 1.2441, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.8561 => 0.9241, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/matrix: 7.69% (0.2600 => 0.2800, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 7.59% (0.3160 => 0.3400, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.3200 => 0.3440, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.23% (1.2721 => 1.3641, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 7.02% (0.2280 => 0.2440, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.77% (10.6960 => 11.4200, std.dev.: 0.1108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (1.5200 => 1.6200, std.dev.: 0.0222) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.6800 => 0.7240, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.45% (6.0160 => 6.4040, std.dev.: 0.0673) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3120 => 0.3320, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.9640 => 2.0800, std.dev.: 0.0183) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.52% (0.6520 => 0.6880, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.40% (8.1441 => 8.5841, std.dev.: 0.0632) MultiSource/Applications/lua/lua: 5.13% (4.5200 => 4.7520, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.10% (0.3920 => 0.4120, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: 4.71% (0.3400 => 0.3560, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.4320 => 0.4520, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.6080 => 0.6360, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 4.53% (10.4082 => 10.8802, std.dev.: 0.0338) SingleSource/Benchmarks/Misc-C++/bigfib: 4.49% (0.7120 => 0.7440, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (4.9200 => 5.1400, std.dev.: 0.0394) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.8000 => 6.0480, std.dev.: 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.15% (2.1201 => 2.2081, std.dev.: 0.0088) MultiSource/Applications/obsequi/Obsequi: 3.80% (1.2640 => 1.3120, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.76% (4.9000 => 5.0840, std.dev.: 0.0340) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.69% (48.1088 => 49.8850, std.dev.: 0.0596) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.62% (1.5480 => 1.6040, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 3.60% (23.7574 => 24.6135, std.dev.: 0.0434) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (7.8562 => 8.1282, std.dev.: 0.0346) MultiSource/Applications/JM/lencod/lencod: 3.41% (17.6165 => 18.2165, std.dev.: 0.0534) MultiSource/Benchmarks/Bullet/bullet: 3.40% (37.0925 => 38.3526, std.dev.: 0.0879) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.39% (2.8322 => 2.9282, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.4400 => 1.4840, std.dev.: 0.0134) MultiSource/Applications/kimwitu++/kc: 2.96% (18.8170 => 19.3731, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.40% (4.0122 => 4.1083, std.dev.: 0.0108) MultiSource/Applications/SPASS/SPASS: 2.37% (17.5484 => 17.9644, std.dev.: 0.0506) MultiSource/Benchmarks/PAQ8p/paq8p: 2.32% (2.5882 => 2.6482, std.dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 2.21% (5.7964 => 5.9244, std.dev.: 0.0134) MultiSource/Applications/d/make_dparser: 2.09% (3.8240 => 3.9041, std.dev.: 0.0208) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (1.1480 => 1.1720, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 2.02% (2.5721 => 2.6241, std.dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: 1.86% (17.4082 => 17.7322, std.dev.: 0.0519) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.9561 => 0.9721, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (15.2282 => 15.4562, std.dev.: 0.0514) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.36% (28.1538 => 28.5378, std.dev.: 0.0362) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (5.7564 => 5.8244, std.dev.: 0.0256) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.00% (0.0400 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: 19.31% (0.9321 => 1.1121, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.13% (1.0881 => 1.2201, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 11.94% (2.8802 => 3.2242, std.dev.: 0.0239) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2480 => 0.2760, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (25.8896 => 26.7297, std.dev.: 0.0480) SingleSource/Benchmarks/Shootout/lists: 3.23% (5.8164 => 6.0044, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.48% (3.2242 => 3.3042, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.04% (4.5043 => 4.5963, std.dev.: 0.0212) SingleSource/Benchmarks/McGill/queens: 1.64% (2.1921 => 2.2281, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.62% (4.6843 => 4.7603, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.56% (2.5602 => 2.6002, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.49% (3.4842 => 3.5362, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 1.40% (21.1533 => 21.4493, std.dev.: 0.0761) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -16.90% (0.2840 => 0.2360, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: -13.01% (7.7485 => 6.7404, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.11% (0.1080 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.24% (0.3400 => 0.3120, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: -7.84% (0.4080 => 0.3760, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.69% (3.3482 => 3.1242, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -6.57% (1.3401 => 1.2521, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.40% (1.2601 => 1.1921, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.81% (4.5603 => 4.4323, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (3.7962 => 3.7082, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (4.2563 => 4.1803, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.75% (2.9722 => 2.9202, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.6165 => 8.4765, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.36% (4.1123 => 4.0563, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Apr 30 23:00:50 2014 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 May 2014 01:00:50 -0500 (CDT) Subject: [llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results Message-ID: <20140501060050.DF0FD2A6C026@llvm.org> http://llvm.org/perf/db_default/v4/nts/25196?compare_to=25195&baseline=19898 Nickname: pollyperf-O3__clang_DEV__x86_64:34 Comparing: Run: 25196, Order: 207732, Start Time: 2014-05-01 01:26:20, End Time: 2014-05-01 06:07:38 To: 25195, Order: 207730, Start Time: 2014-05-01 00:50:51, End Time: 2014-05-01 05:33:02 Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29 =============== Tests Summary =============== Performance Regressions: 4 (104 on baseline) Performance Improvements: 4 (21 on baseline) Added Tests: 0 (2 on baseline) Unchanged Tests: 1104 (985 on baseline) Total Tests: 1112 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/ConstructorDestructorAttributes: 300.00% (0.0040 => 0.0160, std.dev.: 0.0031) SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0120 => 0.0240, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/methcall: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.36% (1.1921 => 1.2441, std.dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.73% (1.3201 => 1.2841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.13% (1.3161 => 1.2881, std.dev.: 0.0109) MultiSource/Applications/d/make_dparser: -1.64% (3.9041 => 3.8401, std.dev.: 0.0246) MultiSource/Benchmarks/Bullet/bullet: -1.13% (38.3526 => 37.9206, std.dev.: 0.0853) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/ctor_dtor_count: 200.00% (0.0120 => 0.0360, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/methcall: 37.50% (0.0320 => 0.0440, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Treesort: 33.33% (0.0360 => 0.0480, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 23.53% (0.0680 => 0.0840, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 23.08% (0.0520 => 0.0640, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.21% (0.1320 => 0.1600, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.42% (0.1520 => 0.1800, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 16.67% (0.0720 => 0.0840, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.13% (0.1240 => 0.1440, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 13.04% (0.0920 => 0.1040, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.50% (0.1600 => 0.1800, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.24% (0.1960 => 0.2200, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.78% (1.1881 => 1.3281, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.74% (1.1241 => 1.2561, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.70% (1.1281 => 1.2601, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.03% (1.1601 => 1.2881, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.82% (1.2201 => 1.3521, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.47% (1.1841 => 1.3081, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.36% (1.2361 => 1.3641, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.27% (1.1681 => 1.2881, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.26% (0.6240 => 0.6880, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.20% (1.2161 => 1.3401, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.1841 => 1.3041, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3960 => 0.4360, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.10% (1.2281 => 1.3521, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.86% (1.1361 => 1.2481, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.76% (1.1481 => 1.2601, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.60% (1.2081 => 1.3241, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.36% (1.1961 => 1.3081, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.34% (1.1561 => 1.2641, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.18% (1.1761 => 1.2841, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.15% (1.1361 => 1.2401, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.09% (1.1881 => 1.2961, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.06% (1.1921 => 1.3001, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.97% (1.2481 => 1.3601, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.94% (1.2521 => 1.3641, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.89% (1.2601 => 1.3721, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.75% (1.2801 => 1.3921, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.74% (1.1441 => 1.2441, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.72% (1.1921 => 1.2961, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.71% (1.2401 => 1.3481, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.58% (1.2121 => 1.3161, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.49% (1.2721 => 1.3801, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (1.1881 => 1.2881, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.41% (0.8561 => 0.9281, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.12% (1.2321 => 1.3321, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.92% (1.3641 => 1.4721, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.86% (1.2721 => 1.3721, std.dev.: 0.0130) MultiSource/Benchmarks/McCat/09-vor/vor: 7.78% (0.3600 => 0.3880, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.60% (1.3681 => 1.4721, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3280 => 0.3520, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.6640 => 0.7120, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (6.0160 => 6.4400, std.dev.: 0.0448) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.03% (10.6960 => 11.4480, std.dev.: 0.0651) MultiSource/Benchmarks/FreeBench/neural/neural: 6.52% (0.1840 => 0.1960, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (0.6520 => 0.6920, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/05-eks/eks: 5.88% (0.6800 => 0.7200, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.6080 => 0.6400, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.7080 => 1.7920, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.3760 => 1.4400, std.dev.: 0.0182) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (8.1441 => 8.5201, std.dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.7360 => 1.8120, std.dev.: 0.0167) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (10.4082 => 10.8442, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.9640 => 2.0440, std.dev.: 0.0218) MultiSource/Applications/lua/lua: 3.98% (4.5200 => 4.7000, std.dev.: 0.0322) MultiSource/Applications/hexxagon/hexxagon: 3.91% (1.1240 => 1.1680, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (4.9200 => 5.0920, std.dev.: 0.0440) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.8000 => 5.9960, std.dev.: 0.0448) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (2.1201 => 2.1881, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 3.06% (23.7574 => 24.4855, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.02% (4.9000 => 5.0480, std.dev.: 0.0351) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.95% (48.1088 => 49.5290, std.dev.: 0.0801) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.94% (0.5440 => 0.5600, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.91% (17.6165 => 18.1285, std.dev.: 0.0792) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.8322 => 2.9122, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.8562 => 8.0522, std.dev.: 0.0369) MultiSource/Applications/kimwitu++/kc: 2.30% (18.8170 => 19.2491, std.dev.: 0.0459) MultiSource/Benchmarks/Bullet/bullet: 2.23% (37.0925 => 37.9206, std.dev.: 0.0853) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.00% (4.0122 => 4.0923, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.74% (1.1480 => 1.1680, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 1.57% (17.5484 => 17.8244, std.dev.: 0.0465) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.5882 => 2.6242, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 1.33% (17.4082 => 17.6402, std.dev.: 0.0409) MultiSource/Applications/oggenc/oggenc: 1.31% (5.7964 => 5.8724, std.dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 37.94% (2.8042 => 3.8682, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.00% (0.0800 => 0.0960, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 18.88% (0.9321 => 1.1081, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (1.0881 => 1.2241, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 12.08% (2.8802 => 3.2282, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 3.86% (1.6601 => 1.7241, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: 3.58% (5.8164 => 6.0244, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 3.21% (25.8896 => 26.7217, std.dev.: 0.0363) SingleSource/Regression/C/uint64_to_float: 2.04% (0.5880 => 0.6000, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (0.6320 => 0.6440, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (2.5602 => 2.6042, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/whetstone: 1.70% (1.4081 => 1.4321, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.61% (3.4842 => 3.5402, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.50% (1.0641 => 1.0801, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1921 => 2.2241, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 1.37% (4.6843 => 4.7483, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/block-byref-test: -100.00% (0.0120 => 0.0000, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -81.46% (10.8967 => 2.0201, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -20.47% (1.7001 => 1.3521, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -18.31% (0.2840 => 0.2320, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: -12.91% (7.7485 => 6.7484, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.06% (0.3400 => 0.3160, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.57% (3.3482 => 3.1282, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -5.97% (1.3401 => 1.2601, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.19% (2.3881 => 2.2641, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.39% (4.4683 => 4.2723, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.89% (2.0561 => 1.9761, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -3.74% (2.6762 => 2.5762, std.dev.: 0.0335) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (4.5603 => 4.4283, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (0.6080 => 0.5920, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.21% (3.7962 => 3.7122, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.88% (2.9722 => 2.9162, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.69% (4.2563 => 4.1843, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (8.6165 => 8.4885, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (4.1123 => 4.0523, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.9401 => 0.9281, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Regression/C++/EH/class_hierarchy Added Tests - Execution Time ---------------------------- SingleSource/Regression/C++/EH/class_hierarchy Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: